{"id":142296,"date":"2026-02-26T10:11:59","date_gmt":"2026-02-26T15:11:59","guid":{"rendered":"https:\/\/www.bumc.bu.edu\/camed\/?post_type=bu-article&p=142296"},"modified":"2026-02-26T10:12:00","modified_gmt":"2026-02-26T15:12:00","slug":"new-study-highlights-the-importance-of-careful-multiple-choice-question-construction-to-ensure-fairness-and-accurately-reflect-student-abilities","status":"publish","type":"bu-article","link":"https:\/\/www.bumc.bu.edu\/camed\/news-events\/articles\/2026\/new-study-highlights-the-importance-of-careful-multiple-choice-question-construction-to-ensure-fairness-and-accurately-reflect-student-abilities\/","title":{"rendered":"New Study Highlights the Importance of Careful Multiple-Choice Question Construction to Ensure Fairness and Accurately Reflect Student Abilities"},"content":{"rendered":"\t
\n\t\t
\n\n\t\t\t
\n\t\t\t\t\n\t\t\t\t\"Back\n\t\t\t\t\t\t\t<\/div>\n\n\t\t\t\t\t\t\t

Photo by Ellie Ellien<\/a> on Unsplash<\/a>.<\/p>\n\t\t\t\n\n\t\t\t\n\t\t\t\t

\n\n\t\t\t\t\t\n\t\t\t\t\t
\n\n\t\t\t\t\t\t\t\t\t\t\t\t\t\tResearch<\/span>\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\tNew Study Highlights the Importance of Careful Multiple-Choice Question Construction to Ensure Fairness and Accurately Reflect Student Abilities<\/strong>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/h1>\n\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t\t\t\t

\u201cQuestion flaws do not affect all students equally\u2014they create a barrier for weaker students, unintentionally widening performance gaps.\u201d<\/em><\/h4>\n\t\t\t\t\t\t\n\t\t\t\t\t<\/div>\n\n\t\t\t\t<\/div>\n\n\t\t\t\n\t\t<\/div>\n\n\t\t\n\t<\/div>\n\n\t\n
\n\t
\n\t\t\t\t\t
February 26, 2026<\/div>\n\t\t\n\t\t\t\t
\n\t\t\t\t\t<\/div>\n\t\t
\n\t\t\tTwitter<\/span><\/span>\n\t\t\tFacebook<\/span><\/span>\n\t\t\t<\/span>\n\t\t<\/div>\n\t<\/div>\n<\/div>\n\n\t\n\n\n

Medical, dental and master\u2019s students in biomedical sciences frequently take standardized, multiple-choice question tests to assess their foundational knowledge. Reasons for its widespread use include reliability, efficiency, low cost and when the questions are well-constructed, high accuracy. However, multiple choice questions may present challenges for test-takers when they contain item writing flaws (flawed, ambiguous, or poorly constructed test questions)<\/strong> that can potentially compromise the fairness and validity of the assessment.<\/p>\n\n\n\n

New research<\/a>, led by scientists at Boston University Chobanian & Avedisian School of Medicine, suggests that an increased number of total flaws in questions could lead to disadvantages among lower-performing students, not because the content is more difficult, but rather that these students may be less able to navigate item writing flaws.<\/p>\n\n\n\n

\"head
Marisol Lopez<\/figcaption><\/figure><\/div>\n\n\n\n

\u201cOur study highlights the importance of careful multiple-choice question construction to ensure assessments are fair and accurately reflect student abilities,\u201d explains corresponding author Marisol E. Lopez<\/a>, PhD, assistant professor of pharmacology, physiology & biophysics at the school. \u201cBased on our findings, we recommend the identification and elimination of item writing flaws to promote greater equity.\u201d<\/p>\n\n\n\n

To study if poorly written questions affect student performance, the researchers created a physiology test and demographic survey that was given to 31 BU dental as well as graduate medical science master\u2019s students and 54 University of Central Florida medical students.<\/p>\n\n\n\n

After analyzing the results, they found test performance did not differ among demographic groups (sex, race\/ethnicity, English language proficiency, birth country, and primary home language) and question difficulty was not affected by the number of flaws present in the question. However, they did find that questions with more flaws have a greater impact on low performing students. Specifically, certain flaws such as when questions have unclear stems (prompts) affect weaker students disproportionately. These findings suggest that high performing students can better navigate question flaws.<\/p>\n\n\n\n

According to the researchers, these findings highlight the need for improved faculty training and rigorous review of test questions before exams are administered. \u201cFixing unclear wording, simplifying stems, and eliminating common structure mistakes could help ensure that all students, no matter their background, are evaluated fairly,\u201d adds Lopez.<\/p>\n\n\n\n

These findings appear online<\/a> in the journal Medical Science Educator.<\/p>\n","protected":false},"excerpt":{"rendered":"

Medical, dental and master\u2019s students in biomedical sciences frequently take standardized, multiple-choice question tests to assess their foundational knowledge. Reasons for its widespread use include reliability, efficiency, low cost and when the questions are well-constructed, high accuracy. However, multiple choice questions may present challenges for test-takers when they contain item writing flaws (flawed, ambiguous, or […]<\/p>\n","protected":false},"author":903,"featured_media":142306,"comment_status":"closed","ping_status":"closed","template":"","meta":{"bu_prepress_billboard":"","_bu_prepress_primary_term":"Research","_bu_prepress_primary_term_manual":""},"tags":[409,94],"bu-publication":[367],"medicine-article-category":[],"medicine-topic":[],"news-article-category":[385],"news-topic":[],"bu_edition":[],"media_type":[],"_links":{"self":[{"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/bu-article\/142296"}],"collection":[{"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/bu-article"}],"about":[{"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/types\/bu-article"}],"author":[{"embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/users\/903"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/comments?post=142296"}],"version-history":[{"count":4,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/bu-article\/142296\/revisions"}],"predecessor-version":[{"id":142309,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/bu-article\/142296\/revisions\/142309"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/media\/142306"}],"wp:attachment":[{"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/media?parent=142296"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/tags?post=142296"},{"taxonomy":"bu-publication","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/bu-publication?post=142296"},{"taxonomy":"medicine-article-category","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/medicine-article-category?post=142296"},{"taxonomy":"medicine-topic","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/medicine-topic?post=142296"},{"taxonomy":"news-article-category","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/news-article-category?post=142296"},{"taxonomy":"news-topic","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/news-topic?post=142296"},{"taxonomy":"bu_edition","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/bu_edition?post=142296"},{"taxonomy":"media_type","embeddable":true,"href":"https:\/\/www.bumc.bu.edu\/camed\/wp-json\/wp\/v2\/media_type?post=142296"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}