How accurate are AI detectors? Every study, indexed

How accurate AI detectors are depends on who measured, on what text, and when. This hub holds one record for each published evaluation the index has read in full: fifteen independent studies, three vendor or lab reports and one human-rater study, 35 records in all as of 9 November 2026, nine of them on the morning of that day, eight added later the same day (Sadasivan 2023, Krishna 2023, Orenstrakh 2023, Gao 2023, Jabarian and Imas 2025, Van Vlasselaer 2026, NIST AI 700-1 and Ha and Passananti 2024) and two in the fifth wave (Pegoraro 2023, a 20-method sweep on ChatGPT question-and-answer text, and Fleckenstein 2024, in which 89 novice and 200 experienced teachers judged essays and no software was tested). Each record states who ran the test and when, which detectors it covered, the sample by class and count, the results exactly as the paper reports them with their base, the limits the authors state, and the cards in the index the record feeds. Nothing on a record comes from a write-up of the paper; every figure was read in the paper itself. The methodology page sets out what a study needs before it is indexed.

The thirty-five records do not agree, and the hub does not average them. Weber-Wulff and colleagues tested fourteen detectors on 54 documents in spring 2023 and found that no tool reached 80% on their averaged accuracy measures, with Turnitin highest at 41 of 54 documents classified correctly (DOI 10.1007/s40979-023-00146-z). Walters ran sixteen detectors over 126 student and generated essays a few months later and found Copyleaks and Turnitin correct on all of them, with other tools far lower on GPT-4 text (DOI 10.1515/opis-2022-0158). Liang and colleagues reported an average false positive rate of 61.22% across seven detectors on 91 essays by non-native English writers, against near-perfect accuracy on essays by US eighth graders (DOI 10.1016/j.patter.2023.100779). Jabarian and Imas 2025 ran four detectors over 1,992 human and 7,968 AI passages and report false positive rates at a 0.5 threshold of 0.0000 for Pangram, 0.0011 for Originality.ai, 0.0071 for GPTZero and 0.9503 for the RoBERTa-base baseline (NBER w34223, read 9 November 2026); Van Vlasselaer 2026 ran four tools over 160 academic papers and found Turnitin, GPTZero and Copyleaks scoring 70% to 100% of the fully AI-generated papers under 20% while all four cleared every human paper (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). The same tool can look strong in one record and weak in the next because the samples, versions, thresholds and metrics differ. That is why every value on a record carries its base, and why the rankings derived from these records count evidence and report rates rather than declare a winner.

The table below is the hub's view of the thirty-five records: register ID, the study's short name, the year, how many detectors it tested, the size of its sample as the record states it, and the metric it reports. The three vendor or lab reports, the OpenAI classifier announcement of 2023, Turnitin's statements on its own detector and the NIST GenAI pilot report of 2025, are indexed in their own column of the table as reports rather than studies, so that a reader can weigh them apart from the fourteen independent evaluations. One record, Ha and Passananti 2024, scored images rather than text, and the ranking by content type reads it.

Records feed cards. When a study tested a tool that has a card in the detector index, the card's Independent studies field counts the record and quotes its result with a link back here. 35 of the 72 cards have at least one record; GPTZero has twelve and the GPT-2 Output Detector ten, both lifted by one when Pegoraro 2023 was added on 9 November 2026. A card with no record says so by leaving the field out, and the ranking of independently tested detectors lists only the cards that have one. Where a record reports a false positive rate on human-written text, that figure also enters the false positive rate ranking, again with its base and the study year; where it reports a miss rate or a result after a paraphrase, the false negative rate ranking and the robustness ranking read it, and the 2026 false positive evidence review lists every false positive figure in one table.

On 10 November 2026 seven records gained a card row without a new record being added: Weber-Wulff 2023 now feeds PlagiarismCheck, Walters 2023, Kar 2024 and Alshammari and Rao 2025 feed Content Detector AI, Orenstrakh 2023 and Perkins 2024 feed GPTKit, and the RAID benchmark feeds Fast-DetectGPT; the Q2 2027 studies digest lists the seven with the figure each new card records.

Later the same day the tenth wave gave five records a further card row: Weber-Wulff 2023 now feeds Check For AI and Writefull (12 of its 14 tools carded), Pegoraro 2023 feeds Writefull, Kar 2024 feeds Wordtune, and the RAID benchmark and DAMAGE 2025 feed Binoculars, whose 0.00% at threshold 0.5 and 80.3 under paraphrase enter the false positive and robustness rankings; the four non-text cards of the same wave attach to no record, and the three voice and video challenges still name no indexed product.

The eleventh wave, the same day, added five records and gave four older records new card rows: Rashidi 2023 ran the RoBERTa GPT-2 detector on 14,400 real journal abstracts and feeds the GPT-2 Output Detector card's base (up to 8.69% of a 1,600-abstract range above a 50% score, no AI text scored); ASVspoof 2021 and ADD 2023 are voice challenges and FaceForensics++ 2019 a video benchmark, none scoring an indexed card; and the Originality.ai compilation is the vendor's own meta-analysis of 17 studies, recorded as a vendor statement on the Originality.ai card and never as a study result. Walters 2023 now feeds GPT Radar, Grammica, IvyPanda and SEO.ai (14 of its 16 tools carded), Liang 2023 feeds AI Writing Check, and the RAID benchmark and DAMAGE 2025 feed RADAR; the launch year ranking dates each of these tools from its own page.

A study describes the versions it tested on the dates it tested them. Detectors change after publication, and several vendors have replaced their models since 2023, so a 2023 result is a dated fact about a dated version, not a statement about today's tool. Each record shows its year beside every figure for that reason, and the home board shows which AI detectors exist and who has tested them in one view. To suggest a study for the index, send the citation through the contact page; accepted additions are logged in the corrections log with their date and gathered in the dated index updates.

No record joined in the twelfth wave on 10 November 2026; the Q3 2027 studies digest lists the five eleventh-wave records with their figures and bases, and the 2027 census tabulates all 35 records by year and kind, 17 of them from 2023.

How a record is made

Every study record, the same fields

Updated

Every study record in the index with the same fields
Record IDStudyYearDetectors testedDocumentsReported metric
AIDI-S-0001Weber-Wulff 2023Testing of detection tools for AI-generated text20231454Binary accuracy, false accusations, undetected cases
AIDI-S-0002Liang 2023Detectors and non-native English writers2023791 TOEFL essays, 88 US essaysFalse positive rate
AIDI-S-0003Walters 2023The effectiveness of software designed to detect AI-generated writing202316126Accuracy, false positives, uncertain responses
AIDI-S-0004Elkhatat 2023Evaluating AI content detection tools2023535 paragraphsSensitivity and specificity
AIDI-S-0005Perkins 2024Detection tools and adversarial techniques20247114Accuracy under adversarial edits
AIDI-S-0006RAID 2024A shared benchmark for text detectors202466,287,820 textsAccuracy at a fixed false positive rate
AIDI-S-0007OpenAI classifier 2023A lab classifier, released and withdrawn20231Challenge set, size not publishedTrue and false positive rate
AIDI-S-0008Turnitin claimsVendor statements on AI writing detection20231800,000 pre-ChatGPT papers (vendor statement)Document false positive rate (vendor statement)
AIDI-S-0009Chaka 2023Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic2023521 responses and 30 translationsCorrect, misclassified and indecisive counts
AIDI-S-0010Sadasivan 2023Can AI-Generated Text be Reliably Detected?202372,000 passages of about 300 tokensTrue positive rate at 1% false positive rate, AUROC
AIDI-S-0011Krishna 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense202353,000 prompts per task, 300 generated tokens eachDetection accuracy at 1% false positive rate
AIDI-S-0012Orenstrakh 2023Detecting LLM-Generated Text in Computing Education: A Comparative Study for ChatGPT Cases20238164Threshold accuracy, false positives, resilience to QuillBot
AIDI-S-0013Gao 2023Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers20231100 abstractsAUROC, sensitivity and specificity, reviewer accuracy
AIDI-S-0014Jabarian and Imas 2025Artificial Writing and Automated Detection202541,992 human passages and 7,968 AI passages (1,992 per model from four models)False positive rate, false negative rate, AUROC at fixed and Youden-optimised thresholds
AIDI-S-0015Van Vlasselaer 2026Who wrote this? Evaluating the reliability of AI detection tools in higher education20264160 papers (40 human, 40 fully AI, 40 hybrid, 40 humanised) plus 1,163 theses without ground truthStrict and inclusive classification accuracy per paper category
AIDI-S-0016NIST AI 700-1 20252024 NIST GenAI (Pilot Study): Text-to-Text Evaluation Overview and Results20253104, 530 and 1,683 summaries across three test setsAUC, BrierT and BrierN per generator and detector pair
AIDI-S-0017Ha and Passananti 2024Organic or Diffused: Can We Distinguish Human Art from AI-generated Images?20245280 human artworks and 350 AI-generated images, plus 40 hybrid and 70 upscaled imagesAccuracy, false positive rate and false negative rate at a 40% and 60% score boundary
AIDI-S-0018Pegoraro 2023To ChatGPT, or not to ChatGPT: That is the question!202320About 10% of 131,512 responses (58,546 human, 72,966 ChatGPT) to 24,322 questionsTrue positive rate on ChatGPT text and true negative rate on human text per tool
AIDI-S-0019Fleckenstein 2024Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays202404 essays per rater: 2 ChatGPT, 2 student; 89 and 200 ratersShare of essays whose source (ChatGPT or student) was identified correctly, with rater confidence
AIDI-S-0021Ibrahim 2023Using AI-based detectors to control AI-assisted plagiarism in ESL writing: The Terminator Versus the Machines20232120 human-written ESL essays and 120 ChatGPT (GPT-3.5, January 2023) essaysShare of essays past a 95% or 5% originality cut per detector, plus the author's average accuracy rate
AIDI-S-0023Kar 2024How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools202410One ChatGPT 3.5 article of under 500 words and three paraphrased versions of it (QuillBot, Grammarly, ChatGPT); no human textAI-content percentage reported by each free tool on each text
AIDI-S-0024Alshammari and Rao 2025Evaluating the Performance of AI Text Detectors, Few-Shot and Chain-of-Thought Prompting Using DeepSeek Generated Text2025649 human question-and-answer pairs (2011 to 2021), 49 DeepSeek-V3 answers, 49 QuillBot paraphrases, 49 DeepThink answers and 98 DeepThink paraphrases (standard and humanized), 294 samplesAverage AI-content score per detector on each sample set, plus recall at a 50% threshold
AIDI-S-0025DAMAGE 2025Detecting Adversarially Modified AI Generated Text20255Seven student essay corpora (64,391 human essays listed in Table 6) with one AI mirror essay per human essay, humanized by 19 tools; 2,000 adversarially humanized test essaysTrue positive rate at a fixed 5% false positive rate, and true positive and false positive rates at each tool's default threshold
AIDI-S-0026Epoch AI 2026AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors20263495 human passages of about 500 words from 99 pre-2022 authors; 297 AI passages from a basic prompt and 297 imitating an author's style, from Claude Opus 4.8, GPT-5.5 and Gemini 3.1 ProFalse positive rate on human passages and false negative rate on AI passages at each detector's default document verdict, with 90% confidence intervals
AIDI-S-0027ASVspoof 5Evaluation of Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech20260Track 1 evaluation set of 138,688 bona fide and 542,086 spoofed utterances from 737 speakers, 16 attacks (7 adversarial), 11 codec conditionsMinimum detection cost function (minDCF) and equal error rate for stand-alone detectors; minimum a-DCF for spoofing-robust speaker verification
AIDI-S-0028SAFE 2025Synthetic Audio Forensics Evaluation (SAFE) Challenge202504,200 real clips from 21 sources (200 each) and 2,600 generated clips from 13 text-to-speech models (200 each), plus 380 processed clips per model in Task 2 and 200 laundered clips per model in Task 3Balanced accuracy (mean of true positive and true negative rates) at each team's own binary decision threshold, on a private split
AIDI-S-0029DFDC 2020The DeepFake Detection Challenge (DFDC) Dataset20200128,154 video clips from 960 consenting actors, 104,500 of them face swaps; private test set of 10,000 ten-second clips, half of them organic internet videosLog loss on the private test set (ranking metric); accuracy on the black-box set as stated by Meta; precision at fixed recall and average precision on real videos
AIDI-S-0030RAID image 2025RAID: A Benchmark Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors2025424,000 clean images (4,800 real from LAION, 19,200 from four text-to-image models) and 216,000 adversarial versions in three attack splits; 50 real and 50 clean-adversarial pairs for the two commercial detectorsAUROC and attack success rate (relative AUROC drop) on 1,000 images per class; accuracy at a 0.5 threshold for the commercial detectors
AIDI-S-0031Vanderbilt 2023Guidance on AI Detection and Why We're Disabling Turnitin's AI Detector2023075,000 papers submitted by Vanderbilt to Turnitin in 2022 (institutional figure); 800,000 pre-ChatGPT papers behind the vendor's false positive claim (vendor figure)Expected false positives per year, computed by the university from the vendor's stated document false positive rate
AIDI-S-0032GPTZero and Pangram vendor benchmarksVendor-run benchmarks for GPTZero and Pangram20265GPTZero: 1,000 human and 1,000 AI texts per domain, four domains; Pangram 4.1: 781,981 human FineWeb texts and 520,000 AI generations; Pangram 2024 report: 1,976 documentsFalse positive rate, recall, precision and accuracy as each vendor defines and reports them, on the vendor's own test sets
AIDI-S-0033Rashidi 2023The ChatGPT conundrum: Human-generated scientific manuscripts misidentified as AI creations by AI text detection tool2023114,400 abstractsShare of human-written abstracts scored above 50%, 60%, 70%, 80% and 90% AI probability, by five-year range and by journal
AIDI-S-0034ASVspoof 2021ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild20230Evaluation trials: LA 14,816 bona fide and 133,360 spoofed; PA 94,068 and 627,264; DF 14,869 and 519,059Pooled normalised minimum tandem detection cost function (min t-DCF) and pooled equal error rate for LA and PA; pooled EER for DF
AIDI-S-0035ADD 2023ADD 2023: the Second Audio Deepfake Detection Challenge20230Track 1.2 test sets of 80,000 real and 31,976 fake utterances (round 1) and 87,500 and 30,977 (round 2); Track 2 20,000 real and 30,000 partially fake; Track 3 10,507 real and 68,983 fakeWeighted equal error rate (Track 1.2); deception success rate (Track 1.1); weighted sum of sentence accuracy and segment F1 (Track 2); macro-average F1 (Track 3)
AIDI-S-0036FaceForensics++ 2019FaceForensics++: Learning to Detect Manipulated Facial Images201901,000 pristine YouTube videos (509,914 frames) and four manipulated copies of each, over 1.8 million manipulated images; 140 test videos; a 1,000-image hidden benchmarkBinary detection accuracy per frame at three compression levels; per-class precision on the hidden benchmark; human observer accuracy
AIDI-S-0037Originality.ai vendor compilationVendor compilation of Originality.ai accuracy claims and third-party studies20261017 third-party studies and two humanizer benchmarks listed by the vendor; the RAID post summarises 6,287,820 texts; model release notes from 1.1 (November 2022) to 5.0 (October 2026)Accuracy, false positive rate and false negative rate as the vendor states them for its own models, and one headline figure per study as the vendor restates it

Which detectors have the most study records?

Questions about the studies

Which studies are in the index?

35 records as of 9 November 2026: Weber-Wulff 2023, Liang 2023, Walters 2023, Elkhatat 2023, Perkins 2024, the RAID benchmark of 2024, Chaka 2023, Sadasivan 2023, Krishna 2023, Orenstrakh 2023, Gao 2023, Jabarian and Imas 2025, Van Vlasselaer 2026 and Ha and Passananti 2024 as independent studies, plus the OpenAI classifier announcement of 2023, Turnitin's own detection statements and the NIST AI 700-1 pilot report as vendor or lab reports. Each has its own record with the citation and DOI or source URL; eight were on the hub on 8 November 2026.

Why do studies report different accuracy for the same detector?

Because they test different texts, different versions and different thresholds, and they report different metrics. Weber-Wulff 2023 counted documents in six classes; Walters 2023 used student essays; RAID reports accuracy at a fixed false positive rate. A figure means something only next to its base, which every record shows.

What is a false positive in these studies?

A human-written text that a detector labels as AI-generated. Studies count it per document, per paragraph or per sentence, and the record states which. Liang 2023 reports an average of 61.22% across seven detectors on 91 essays by non-native English writers, the highest false positive figure in the index.

Does a study result still apply to today's version of a tool?

A result applies to the version the authors tested on the dates they tested it, which each record states where the paper does. Detectors change after a study is published, so the index shows the study year beside every result and never carries a figure forward to a newer version.

Related reading