Survey question wording introduces systematic bias based on positive or negative framing
Is it true that survey question wording introduces systematic bias based on positive or negative framing?
Yes. Multiple studies demonstrate that survey question wording, including positive and negative framing, introduces systematic bias into respondent and model evaluations.
Verdict: SUPPORTED · 3 sources for, 0 against · Last checked
The retrieved papers include direct evidence demonstrating that question wording and positive or negative framing systematically bias survey and evaluation outcomes. Studies such as [0], [2], and [6] specifically highlight how framing and item formulation alter responses. None of the papers refute the claim. Thus, the verdict is SUPPORTED.
Get citation
Lehman, D. R., Krosnick, J. A., West, R. L., & Li, F. (1992). The Focus of Judgment Effect: A Question Wording Effect Due to Hypothesis Confirnation Bias. doi.org. https://doi.org/10.1177/0146167292186005
See more details
Get citation
Hwang, Y., Lee, D., Kang, T., Lee, M., & Jung, K. (2026). When Wording Steers the Evaluation: Framing Bias in LLM judges. doi.org. https://doi.org/10.48550/arXiv.2601.13537
Get citation
Elson, M. (2016). Question Wording and Item Formulation. doi.org. https://doi.org/10.31234/osf.io/e4ktc
What does the evidence say?
The retrieved papers include direct evidence demonstrating that question wording and positive or negative framing systematically bias survey and evaluation outcomes. Studies such as [0], [2], and [6] specifically highlight how framing and item formulation alter responses. None of the papers refute the claim. Thus, the verdict is SUPPORTED.
Receipt History
Challenge the receipt
Citation formatting by citeproc-js (Frank Bennett) and the Citation Style Language project. Source and licenses.
Terms · Privacy · How verdicts work