How accurate are AI detectors? Every study, indexed
How accurate AI detectors are depends on who measured, on what text, and when. This hub holds one record for each published evaluation the index has read in full: fifteen independent studies, three vendor or lab reports and one human-rater study, 35 records in all as of 9 November 2026, nine of them on the morning of that day, eight added later the same day (Sadasivan 2023, Krishna 2023, Orenstrakh 2023, Gao 2023, Jabarian and Imas 2025, Van Vlasselaer 2026, NIST AI 700-1 and Ha and Passananti 2024) and two in the fifth wave (Pegoraro 2023, a 20-method sweep on ChatGPT question-and-answer text, and Fleckenstein 2024, in which 89 novice and 200 experienced teachers judged essays and no software was tested). Each record states who ran the test and when, which detectors it covered, the sample by class and count, the results exactly as the paper reports them with their base, the limits the authors state, and the cards in the index the record feeds. Nothing on a record comes from a write-up of the paper; every figure was read in the paper itself. The methodology page sets out what a study needs before it is indexed.
The thirty-five records do not agree, and the hub does not average them. Weber-Wulff and colleagues tested fourteen detectors on 54 documents in spring 2023 and found that no tool reached 80% on their averaged accuracy measures, with Turnitin highest at 41 of 54 documents classified correctly (DOI 10.1007/s40979-023-00146-z). Walters ran sixteen detectors over 126 student and generated essays a few months later and found Copyleaks and Turnitin correct on all of them, with other tools far lower on GPT-4 text (DOI 10.1515/opis-2022-0158). Liang and colleagues reported an average false positive rate of 61.22% across seven detectors on 91 essays by non-native English writers, against near-perfect accuracy on essays by US eighth graders (DOI 10.1016/j.patter.2023.100779). Jabarian and Imas 2025 ran four detectors over 1,992 human and 7,968 AI passages and report false positive rates at a 0.5 threshold of 0.0000 for Pangram, 0.0011 for Originality.ai, 0.0071 for GPTZero and 0.9503 for the RoBERTa-base baseline (NBER w34223, read 9 November 2026); Van Vlasselaer 2026 ran four tools over 160 academic papers and found Turnitin, GPTZero and Copyleaks scoring 70% to 100% of the fully AI-generated papers under 20% while all four cleared every human paper (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). The same tool can look strong in one record and weak in the next because the samples, versions, thresholds and metrics differ. That is why every value on a record carries its base, and why the rankings derived from these records count evidence and report rates rather than declare a winner.
The table below is the hub's view of the thirty-five records: register ID, the study's short name, the year, how many detectors it tested, the size of its sample as the record states it, and the metric it reports. The three vendor or lab reports, the OpenAI classifier announcement of 2023, Turnitin's statements on its own detector and the NIST GenAI pilot report of 2025, are indexed in their own column of the table as reports rather than studies, so that a reader can weigh them apart from the fourteen independent evaluations. One record, Ha and Passananti 2024, scored images rather than text, and the ranking by content type reads it.
Records feed cards. When a study tested a tool that has a card in the detector index, the card's Independent studies field counts the record and quotes its result with a link back here. 35 of the 72 cards have at least one record; GPTZero has twelve and the GPT-2 Output Detector ten, both lifted by one when Pegoraro 2023 was added on 9 November 2026. A card with no record says so by leaving the field out, and the ranking of independently tested detectors lists only the cards that have one. Where a record reports a false positive rate on human-written text, that figure also enters the false positive rate ranking, again with its base and the study year; where it reports a miss rate or a result after a paraphrase, the false negative rate ranking and the robustness ranking read it, and the 2026 false positive evidence review lists every false positive figure in one table.
On 10 November 2026 seven records gained a card row without a new record being added: Weber-Wulff 2023 now feeds PlagiarismCheck, Walters 2023, Kar 2024 and Alshammari and Rao 2025 feed Content Detector AI, Orenstrakh 2023 and Perkins 2024 feed GPTKit, and the RAID benchmark feeds Fast-DetectGPT; the Q2 2027 studies digest lists the seven with the figure each new card records.
Later the same day the tenth wave gave five records a further card row: Weber-Wulff 2023 now feeds Check For AI and Writefull (12 of its 14 tools carded), Pegoraro 2023 feeds Writefull, Kar 2024 feeds Wordtune, and the RAID benchmark and DAMAGE 2025 feed Binoculars, whose 0.00% at threshold 0.5 and 80.3 under paraphrase enter the false positive and robustness rankings; the four non-text cards of the same wave attach to no record, and the three voice and video challenges still name no indexed product.
The eleventh wave, the same day, added five records and gave four older records new card rows: Rashidi 2023 ran the RoBERTa GPT-2 detector on 14,400 real journal abstracts and feeds the GPT-2 Output Detector card's base (up to 8.69% of a 1,600-abstract range above a 50% score, no AI text scored); ASVspoof 2021 and ADD 2023 are voice challenges and FaceForensics++ 2019 a video benchmark, none scoring an indexed card; and the Originality.ai compilation is the vendor's own meta-analysis of 17 studies, recorded as a vendor statement on the Originality.ai card and never as a study result. Walters 2023 now feeds GPT Radar, Grammica, IvyPanda and SEO.ai (14 of its 16 tools carded), Liang 2023 feeds AI Writing Check, and the RAID benchmark and DAMAGE 2025 feed RADAR; the launch year ranking dates each of these tools from its own page.
A study describes the versions it tested on the dates it tested them. Detectors change after publication, and several vendors have replaced their models since 2023, so a 2023 result is a dated fact about a dated version, not a statement about today's tool. Each record shows its year beside every figure for that reason, and the home board shows which AI detectors exist and who has tested them in one view. To suggest a study for the index, send the citation through the contact page; accepted additions are logged in the corrections log with their date and gathered in the dated index updates.
No record joined in the twelfth wave on 10 November 2026; the Q3 2027 studies digest lists the five eleventh-wave records with their figures and bases, and the 2027 census tabulates all 35 records by year and kind, 17 of them from 2023.
Every study record, the same fields
Updated
| Record ID | Study | Year | Detectors tested | Documents | Reported metric |
|---|---|---|---|---|---|
| AIDI-S-0001 | Weber-Wulff 2023Testing of detection tools for AI-generated text | 2023 | 14 | 54 | Binary accuracy, false accusations, undetected cases |
| AIDI-S-0002 | Liang 2023Detectors and non-native English writers | 2023 | 7 | 91 TOEFL essays, 88 US essays | False positive rate |
| AIDI-S-0003 | Walters 2023The effectiveness of software designed to detect AI-generated writing | 2023 | 16 | 126 | Accuracy, false positives, uncertain responses |
| AIDI-S-0004 | Elkhatat 2023Evaluating AI content detection tools | 2023 | 5 | 35 paragraphs | Sensitivity and specificity |
| AIDI-S-0005 | Perkins 2024Detection tools and adversarial techniques | 2024 | 7 | 114 | Accuracy under adversarial edits |
| AIDI-S-0006 | RAID 2024A shared benchmark for text detectors | 2024 | 6 | 6,287,820 texts | Accuracy at a fixed false positive rate |
| AIDI-S-0007 | OpenAI classifier 2023A lab classifier, released and withdrawn | 2023 | 1 | Challenge set, size not published | True and false positive rate |
| AIDI-S-0008 | Turnitin claimsVendor statements on AI writing detection | 2023 | 1 | 800,000 pre-ChatGPT papers (vendor statement) | Document false positive rate (vendor statement) |
| AIDI-S-0009 | Chaka 2023Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic | 2023 | 5 | 21 responses and 30 translations | Correct, misclassified and indecisive counts |
| AIDI-S-0010 | Sadasivan 2023Can AI-Generated Text be Reliably Detected? | 2023 | 7 | 2,000 passages of about 300 tokens | True positive rate at 1% false positive rate, AUROC |
| AIDI-S-0011 | Krishna 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense | 2023 | 5 | 3,000 prompts per task, 300 generated tokens each | Detection accuracy at 1% false positive rate |
| AIDI-S-0012 | Orenstrakh 2023Detecting LLM-Generated Text in Computing Education: A Comparative Study for ChatGPT Cases | 2023 | 8 | 164 | Threshold accuracy, false positives, resilience to QuillBot |
| AIDI-S-0013 | Gao 2023Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers | 2023 | 1 | 100 abstracts | AUROC, sensitivity and specificity, reviewer accuracy |
| AIDI-S-0014 | Jabarian and Imas 2025Artificial Writing and Automated Detection | 2025 | 4 | 1,992 human passages and 7,968 AI passages (1,992 per model from four models) | False positive rate, false negative rate, AUROC at fixed and Youden-optimised thresholds |
| AIDI-S-0015 | Van Vlasselaer 2026Who wrote this? Evaluating the reliability of AI detection tools in higher education | 2026 | 4 | 160 papers (40 human, 40 fully AI, 40 hybrid, 40 humanised) plus 1,163 theses without ground truth | Strict and inclusive classification accuracy per paper category |
| AIDI-S-0016 | NIST AI 700-1 20252024 NIST GenAI (Pilot Study): Text-to-Text Evaluation Overview and Results | 2025 | 3 | 104, 530 and 1,683 summaries across three test sets | AUC, BrierT and BrierN per generator and detector pair |
| AIDI-S-0017 | Ha and Passananti 2024Organic or Diffused: Can We Distinguish Human Art from AI-generated Images? | 2024 | 5 | 280 human artworks and 350 AI-generated images, plus 40 hybrid and 70 upscaled images | Accuracy, false positive rate and false negative rate at a 40% and 60% score boundary |
| AIDI-S-0018 | Pegoraro 2023To ChatGPT, or not to ChatGPT: That is the question! | 2023 | 20 | About 10% of 131,512 responses (58,546 human, 72,966 ChatGPT) to 24,322 questions | True positive rate on ChatGPT text and true negative rate on human text per tool |
| AIDI-S-0019 | Fleckenstein 2024Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays | 2024 | 0 | 4 essays per rater: 2 ChatGPT, 2 student; 89 and 200 raters | Share of essays whose source (ChatGPT or student) was identified correctly, with rater confidence |
| AIDI-S-0021 | Ibrahim 2023Using AI-based detectors to control AI-assisted plagiarism in ESL writing: The Terminator Versus the Machines | 2023 | 2 | 120 human-written ESL essays and 120 ChatGPT (GPT-3.5, January 2023) essays | Share of essays past a 95% or 5% originality cut per detector, plus the author's average accuracy rate |
| AIDI-S-0023 | Kar 2024How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools | 2024 | 10 | One ChatGPT 3.5 article of under 500 words and three paraphrased versions of it (QuillBot, Grammarly, ChatGPT); no human text | AI-content percentage reported by each free tool on each text |
| AIDI-S-0024 | Alshammari and Rao 2025Evaluating the Performance of AI Text Detectors, Few-Shot and Chain-of-Thought Prompting Using DeepSeek Generated Text | 2025 | 6 | 49 human question-and-answer pairs (2011 to 2021), 49 DeepSeek-V3 answers, 49 QuillBot paraphrases, 49 DeepThink answers and 98 DeepThink paraphrases (standard and humanized), 294 samples | Average AI-content score per detector on each sample set, plus recall at a 50% threshold |
| AIDI-S-0025 | DAMAGE 2025Detecting Adversarially Modified AI Generated Text | 2025 | 5 | Seven student essay corpora (64,391 human essays listed in Table 6) with one AI mirror essay per human essay, humanized by 19 tools; 2,000 adversarially humanized test essays | True positive rate at a fixed 5% false positive rate, and true positive and false positive rates at each tool's default threshold |
| AIDI-S-0026 | Epoch AI 2026AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors | 2026 | 3 | 495 human passages of about 500 words from 99 pre-2022 authors; 297 AI passages from a basic prompt and 297 imitating an author's style, from Claude Opus 4.8, GPT-5.5 and Gemini 3.1 Pro | False positive rate on human passages and false negative rate on AI passages at each detector's default document verdict, with 90% confidence intervals |
| AIDI-S-0027 | ASVspoof 5Evaluation of Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech | 2026 | 0 | Track 1 evaluation set of 138,688 bona fide and 542,086 spoofed utterances from 737 speakers, 16 attacks (7 adversarial), 11 codec conditions | Minimum detection cost function (minDCF) and equal error rate for stand-alone detectors; minimum a-DCF for spoofing-robust speaker verification |
| AIDI-S-0028 | SAFE 2025Synthetic Audio Forensics Evaluation (SAFE) Challenge | 2025 | 0 | 4,200 real clips from 21 sources (200 each) and 2,600 generated clips from 13 text-to-speech models (200 each), plus 380 processed clips per model in Task 2 and 200 laundered clips per model in Task 3 | Balanced accuracy (mean of true positive and true negative rates) at each team's own binary decision threshold, on a private split |
| AIDI-S-0029 | DFDC 2020The DeepFake Detection Challenge (DFDC) Dataset | 2020 | 0 | 128,154 video clips from 960 consenting actors, 104,500 of them face swaps; private test set of 10,000 ten-second clips, half of them organic internet videos | Log loss on the private test set (ranking metric); accuracy on the black-box set as stated by Meta; precision at fixed recall and average precision on real videos |
| AIDI-S-0030 | RAID image 2025RAID: A Benchmark Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors | 2025 | 4 | 24,000 clean images (4,800 real from LAION, 19,200 from four text-to-image models) and 216,000 adversarial versions in three attack splits; 50 real and 50 clean-adversarial pairs for the two commercial detectors | AUROC and attack success rate (relative AUROC drop) on 1,000 images per class; accuracy at a 0.5 threshold for the commercial detectors |
| AIDI-S-0031 | Vanderbilt 2023Guidance on AI Detection and Why We're Disabling Turnitin's AI Detector | 2023 | 0 | 75,000 papers submitted by Vanderbilt to Turnitin in 2022 (institutional figure); 800,000 pre-ChatGPT papers behind the vendor's false positive claim (vendor figure) | Expected false positives per year, computed by the university from the vendor's stated document false positive rate |
| AIDI-S-0032 | GPTZero and Pangram vendor benchmarksVendor-run benchmarks for GPTZero and Pangram | 2026 | 5 | GPTZero: 1,000 human and 1,000 AI texts per domain, four domains; Pangram 4.1: 781,981 human FineWeb texts and 520,000 AI generations; Pangram 2024 report: 1,976 documents | False positive rate, recall, precision and accuracy as each vendor defines and reports them, on the vendor's own test sets |
| AIDI-S-0033 | Rashidi 2023The ChatGPT conundrum: Human-generated scientific manuscripts misidentified as AI creations by AI text detection tool | 2023 | 1 | 14,400 abstracts | Share of human-written abstracts scored above 50%, 60%, 70%, 80% and 90% AI probability, by five-year range and by journal |
| AIDI-S-0034 | ASVspoof 2021ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild | 2023 | 0 | Evaluation trials: LA 14,816 bona fide and 133,360 spoofed; PA 94,068 and 627,264; DF 14,869 and 519,059 | Pooled normalised minimum tandem detection cost function (min t-DCF) and pooled equal error rate for LA and PA; pooled EER for DF |
| AIDI-S-0035 | ADD 2023ADD 2023: the Second Audio Deepfake Detection Challenge | 2023 | 0 | Track 1.2 test sets of 80,000 real and 31,976 fake utterances (round 1) and 87,500 and 30,977 (round 2); Track 2 20,000 real and 30,000 partially fake; Track 3 10,507 real and 68,983 fake | Weighted equal error rate (Track 1.2); deception success rate (Track 1.1); weighted sum of sentence accuracy and segment F1 (Track 2); macro-average F1 (Track 3) |
| AIDI-S-0036 | FaceForensics++ 2019FaceForensics++: Learning to Detect Manipulated Facial Images | 2019 | 0 | 1,000 pristine YouTube videos (509,914 frames) and four manipulated copies of each, over 1.8 million manipulated images; 140 test videos; a 1,000-image hidden benchmark | Binary detection accuracy per frame at three compression levels; per-class precision on the hidden benchmark; human observer accuracy |
| AIDI-S-0037 | Originality.ai vendor compilationVendor compilation of Originality.ai accuracy claims and third-party studies | 2026 | 10 | 17 third-party studies and two humanizer benchmarks listed by the vendor; the RAID post summarises 6,287,820 texts; model release notes from 1.1 (November 2022) to 5.0 (October 2026) | Accuracy, false positive rate and false negative rate as the vendor states them for its own models, and one headline figure per study as the vendor restates it |
| No entry matches that name. See all studies | |||||
Which detectors have the most study records?
- AIDI-S-0018Pegoraro et al. 2023: to ChatGPT or not to ChatGPT, 20 detection methods and no true positive rate above 47.3%20 detection methods on a ChatGPT and human Q&A benchmark, no true positive rate above 47.3%, ZeroGPT the best online tool at 45.7%.Read the record
- AIDI-S-0019Fleckenstein et al. 2024: do teachers spot AI? 89 novice and 200 experienced teachers on ChatGPT and student essaysthe human baseline, 89 pre-service teachers identified 45.1% of ChatGPT essays and 200 experienced teachers 37.8%.Read the record
- AIDI-R-01AI detectors ranked by independent testing Two records added in the fifth wave on 9 November 2026, Pegoraro 2023 and Fleckenstein 2024, changed nine counts and none: Pegoraro 2023 tested ZeroGPT, GPTZero, Copyleaks, Originality.ai, Writer, Content at Scale (BrandWell), DetectGPT, the GPT-2 Output Detector and GLTR, lifting GPTZero to 12, the GPT-2 Output Detector to 10, Copyleaks to 7 and Originality.ai and ZeroGPT to 6; Fleckenstein 2024 tested 289 teachers and no software, so it counts for no card ([Fleckenstein 2024 record](/studies/fleckenstein-2024-teachers/)). Illuminarty, one of four cards added in the same wave, joined with its one image record from Ha and Passananti 2024, so 18 of 72 cards now qualify.the 35 cards with at least one study record, ordered by count.Read the ranking
- AIDI-R-02AI detector false positive rates, rankedevery false positive rate a study reports on human-written text, with its base.Read the ranking
Questions about the studies
Which studies are in the index?
35 records as of 9 November 2026: Weber-Wulff 2023, Liang 2023, Walters 2023, Elkhatat 2023, Perkins 2024, the RAID benchmark of 2024, Chaka 2023, Sadasivan 2023, Krishna 2023, Orenstrakh 2023, Gao 2023, Jabarian and Imas 2025, Van Vlasselaer 2026 and Ha and Passananti 2024 as independent studies, plus the OpenAI classifier announcement of 2023, Turnitin's own detection statements and the NIST AI 700-1 pilot report as vendor or lab reports. Each has its own record with the citation and DOI or source URL; eight were on the hub on 8 November 2026.
Why do studies report different accuracy for the same detector?
Because they test different texts, different versions and different thresholds, and they report different metrics. Weber-Wulff 2023 counted documents in six classes; Walters 2023 used student essays; RAID reports accuracy at a fixed false positive rate. A figure means something only next to its base, which every record shows.
What is a false positive in these studies?
A human-written text that a detector labels as AI-generated. Studies count it per document, per paragraph or per sentence, and the record states which. Liang 2023 reports an average of 61.22% across seven detectors on 91 essays by non-native English writers, the highest false positive figure in the index.
Does a study result still apply to today's version of a tool?
A result applies to the version the authors tested on the dates they tested it, which each record states where the paper does. Detectors change after a study is published, so the index shows the study year beside every result and never carries a figure forward to a newer version.
). Illuminarty, one of four cards added in the same wave, joined with its one image record from Ha and Passananti 2024, so 18 of 72 cards now qualify.: register plate](/img/independently-tested-480.webp)


