TY - JOUR
T1 - Hypothesis Testing Preferences in Research Decision Making
AU - Anglin, Stephanie M.
AU - Otten, Caitlin Drummond
AU - Broomell, Stephen B.
N1 - Funding Information: This research was supported in part by Carnegie Mellon University’s Department of Social and Decision Sciences. The funding source had no involvement in any stage of this research. Data for the first experiment were collected while the first author was affiliated with Carnegie Mellon University. Funding Information: This research was supported in part by Carnegie Mellon University's Department of Social and Decision Sciences. The funding source had no involvement in any stage of this research. Data for the first experiment were collected while the first author was affiliated with Carnegie Mellon University. Publisher Copyright: © 2023 University of California Press. All rights reserved.
PY - 2023/3/27
Y1 - 2023/3/27
N2 - Public opinion about research can affect how society gathers evidence through public support for research funding. Studies consistently show that people selectively search for and evaluate evidence in ways that are partial to their pre-existing views. The present research tested how these processes influence public support for new research on politicized topics, examining individuals' preferences for conducting studies that were otherwise identical except for the direction of the hypothesis. In two preregistered experiments, participants made choices between two hypothetical studies with opposing hypotheses on a polarized topic, first in the absence of evidence and then with conflicting evidence after researchers had collected evidence supporting their respective hypotheses. We predicted that participants would report greater belief-consistent preferences in the absence of evidence than presence of conflicting evidence. However, participants preferred to conduct the belief-consistent study in both the absence and presence of conflicting evidence. Importantly, individual differences emerged in participants' preferences and reasoning: those who reported no preference scored higher in scientific reasoning and actively open-minded thinking. These findings suggest that, on average, laypeople prioritize research with belief-consistent hypotheses, but those with stronger scientific reasoning and actively open-minded thinking were more likely to recognize the studies were scientifically equivalent and report a neutral preference.
AB - Public opinion about research can affect how society gathers evidence through public support for research funding. Studies consistently show that people selectively search for and evaluate evidence in ways that are partial to their pre-existing views. The present research tested how these processes influence public support for new research on politicized topics, examining individuals' preferences for conducting studies that were otherwise identical except for the direction of the hypothesis. In two preregistered experiments, participants made choices between two hypothetical studies with opposing hypotheses on a polarized topic, first in the absence of evidence and then with conflicting evidence after researchers had collected evidence supporting their respective hypotheses. We predicted that participants would report greater belief-consistent preferences in the absence of evidence than presence of conflicting evidence. However, participants preferred to conduct the belief-consistent study in both the absence and presence of conflicting evidence. Importantly, individual differences emerged in participants' preferences and reasoning: those who reported no preference scored higher in scientific reasoning and actively open-minded thinking. These findings suggest that, on average, laypeople prioritize research with belief-consistent hypotheses, but those with stronger scientific reasoning and actively open-minded thinking were more likely to recognize the studies were scientifically equivalent and report a neutral preference.
KW - confirmation bias
KW - hypothesis testing
KW - individual differences
KW - motivated reasoning
KW - scientific reasoning
UR - http://www.scopus.com/inward/record.url?scp=85152101253&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85152101253&partnerID=8YFLogxK
U2 - 10.1525/collabra.73029
DO - 10.1525/collabra.73029
M3 - Article
SN - 2474-7394
VL - 9
JO - Collabra: Psychology
JF - Collabra: Psychology
IS - 1
M1 - 73029
ER -