AI detection tools flag neurodivergent and ESL students' work as AI-generated
AI detection tools used in academic settings have reportedly misidentified writing by neurodivergent and ESL students as AI-generated, resulting in false cheating accusations. A student with autism spectrum disorder at Central Methodist University received a zero grade that was later reversed, though she faced a warning about future flagging, while independent testing found these tools falsely flag 1-2% of human-written essays.", <parameter name="event_date">2023-09
What happened
Moira Olmsted, a student with autism spectrum disorder at Central Methodist University, submitted a written assignment in fall 2023 and received a zero grade after an AI detection tool flagged her work as likely AI-generated. Olmsted disputed the accusation, noting that she has autism and writes in a formulaic manner that might be mistaken for AI-generated text.
Bloomberg Businessweek tested two leading AI detection services, GPTZero and Copyleaks, on 500 college application essays from Texas A&M University submitted in summer 2022, before ChatGPT's release. The testing found that the services falsely flagged 1% to 2% of the essays as likely written by AI.
Reported impact
Olmsted's grade was ultimately changed after she disputed the accusation, but she received a strict warning that any future flagging would be treated as plagiarism, creating a threat to her academic standing. Olmsted described the accusation as a 'punch in the gut.'
Index analysis
About two-thirds of teachers report using AI checkers regularly, according to a survey of more than 450 instructors published in March 2024 by the Center for Democracy & Technology. The best AI writing detectors are described as highly accurate but not foolproof.
Classification
Sources and evidence
This record was researched and written by the Index, based on the following original reporting.