Epoch AI 2026: Pangram, GPTZero and Originality.ai on 495 human passages and 594 AI passages
- Authors
- Lee (Epoch AI)
- Venue
- Epoch AI Data Insight, epoch.ai, with data and code on GitHub
- Published
Epoch AI's July 2026 data insight scored 495 human passages and 594 AI passages with Pangram, GPTZero and Originality.ai and found that Pangram and GPTZero flagged 0 of the 495 human passages, Originality.ai flagged 19 (3.84%), and all three missed between 30 and 53 of 297 AI passages written to imitate a named author (10.10% to 17.85%) while missing at most 2 of 297 passages written from a plain prompt (epoch.ai data insight, results table and CSV, read 9 November 2026). The insight, "AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors", is by Jaeho Lee and was published on epoch.ai on 15 July 2026 under a CC BY licence, with the error-rate CSV updated on 16 July 2026 and the passages, detector responses and analysis code in a public GitHub repository (jaeholee-brown/ai-text-detectors, README, read 9 November 2026). The study is not peer reviewed.
The record joins the studies index as the first in which two detectors returned zero false positives on a human set of this size (epoch.ai data insight, results table, read 9 November 2026).
Three detectors, all with a card in this index, each at a named version. Pangram (version 3.3.2) and GPTZero (model 2026-05-11-base) were called through their APIs; Originality.ai (Turbo 3.0.2) "offers no API at the Pro subscription tier", so it was scored through the web bulk uploader, where two passages failed and were rescored by hand (epoch.ai data insight, Data section, read 9 November 2026).
What was tested
Detectors tested
| Detector | Index card |
|---|---|
| Pangram 3.3.2 (API) | Pangram |
| GPTZero, model 2026-05-11-base (API) | GPTZero |
| Originality.ai Turbo 3.0.2 (web bulk uploader) | Originality.ai |
Sample
| Text set | Count | Source |
|---|---|---|
| Human passages | 495 | 99 authors, 5 each; blog, fiction and arXiv, pre-2022 |
| AI, direct prompt | 297 | 99 topics x Claude Opus 4.8, GPT-5.5, Gemini 3.1 Pro |
| AI, imitating a human author | 297 | Same models, five of the author's passages as examples |
Detectors and versions as named in the insight's Data section; scoring took place in June and July 2026 per the repository README.
The human corpus is 495 passages of roughly 500 words from 99 authors, 33 each in blogging, fiction and scientific writing, five passages per author, every one published before 30 November 2022 and extracted verbatim from a Wayback Machine snapshot or arXiv source. For each author and each of three models, Claude Opus 4.8, GPT-5.5 and Gemini 3.1 Pro, the study produced one passage after showing the model five of the author's real passages and asking for a new piece in that style, and one passage from a derived one-line prompt on the same topic, giving 297 passages per condition. Titles and headings were removed and passages trimmed at a sentence boundary (epoch.ai data insight, Data section, read 9 November 2026).
Sample as described in the insight; the repository README gives the 30 November 2022 cutoff and the 8-gram verification.
The metric is each detector's document-level verdict at its default setting. Only a clean "AI" verdict counts as a detection; a "Mixed" verdict from Pangram or GPTZero counts as a non-detection on AI text and would count as a false positive on human text, though neither returned one on the 495 human passages. Error rates carry 90% confidence intervals (epoch.ai data insight, "Learn more about this graph", read 9 November 2026).
What the study reports
| Metric | Value | Base |
|---|---|---|
| False positive rate, human writing | Pangram 0.00% (0), GPTZero 0.00% (0), Originality.ai 3.84% (19; 90% CI 2.65% to 5.53%) | 495 human passages |
| False negative rate, AI from a direct prompt | Pangram 0.00% (0), Originality.ai 0.34% (1), GPTZero 0.67% (2) | 297 AI passages |
| False negative rate, AI imitating an author | Pangram 10.10% (30; CI 7.58% to 13.35%), GPTZero 10.77% (32; CI 8.16% to 14.10%), Originality.ai 17.85% (53; CI 14.49% to 21.78%) | 297 AI passages |
| Originality.ai false positives by genre | Fiction 16 of 165 (10%), blog 2 of 165 (1%), scientific 1 of 165 (1%) | 165 human passages per genre |
| Misses on imitation text, scientific genre | Pangram 25 of 99 (25%), GPTZero 24 of 99 (24%), Originality.ai 29 of 99 (29%) | 99 imitation passages per genre |
| Misses on imitation text by generator | Pangram: Claude 5, GPT-5.5 5, Gemini 20 of 99; GPTZero 8, 10, 14; Originality.ai 12, 27, 14 | 99 imitation passages per model |
| Most-evaded cell | Pangram 16 of 33 (48%) and GPTZero 12 of 33 (36%) on Gemini scientific; Originality.ai 13 of 33 (39%) on GPT-5.5 scientific | 33 passages per genre and model |
Every figure below is printed in the insight's results table, its CSV and its Analysis tables (epoch.ai data insight and detector_error_rates.csv, read 9 November 2026).
Values as printed in the insight's tables and CSV. The insight's prose rounds 3.84% to 3.8% and the CSV prints 3.84; this record carries the CSV value. Counting "Mixed" as a detection would lower the imitation false negative rate to 6.1% for Pangram and 8.8% for GPTZero (Assumptions and limitations).
The false positive result is the headline for this index: across 495 pre-ChatGPT passages, two detectors returned no false positives and Originality.ai's 19 were concentrated in fiction, 16 of 165, against 2 in blogging and 1 in scientific writing; the author notes all 19 "were flags of writing that predates ChatGPT" (epoch.ai data insight, Analysis, read 9 November 2026). On plainly prompted AI text the three detectors missed 0, 1 and 2 of 297 passages.
Style imitation is the study's evasion method, and it worked unevenly: the three tools missed 10% to 18% of imitation passages overall but 24% to 29% of imitation passages in the scientific genre, and Gemini 3.1 Pro text evaded Pangram four times as often as Claude or GPT-5.5 text (20 of 99 against 5 of 99) (epoch.ai data insight, Analysis tables, read 9 November 2026).
Limits the authors state
The author lists five: the treatment of "Mixed" verdicts changes two detectors' imitation rates (10.1% to 6.1% for Pangram, 10.8% to 8.8% for GPTZero); genre-by-model cells hold only 33 passages; the five human passages per author come from one writer, which bears on the false positive rate only; detector versions were pinned in June 2026 and "can be updated by their makers without notice"; and the study tests "a single evasion method", few-shot style imitation, with no paraphrasing tools or manual editing, at default verdicts and one length of about 500 words (epoch.ai data insight, Assumptions and limitations, read 9 November 2026). Evident from the sources: the work is a web publication by one author, not a peer-reviewed paper; the repository README carries an earlier title than the published page; and the human authors are "well-known writers", not students or non-native writers.
Which cards this study feeds
- AIDI-R-01AI detectors ranked by independent testing Two records added in the fifth wave on 9 November 2026, Pegoraro 2023 and Fleckenstein 2024, changed nine counts and none: Pegoraro 2023 tested ZeroGPT, GPTZero, Copyleaks, Originality.ai, Writer, Content at Scale (BrandWell), DetectGPT, the GPT-2 Output Detector and GLTR, lifting GPTZero to 12, the GPT-2 Output Detector to 10, Copyleaks to 7 and Originality.ai and ZeroGPT to 6; Fleckenstein 2024 tested 289 teachers and no software, so it counts for no card ([Fleckenstein 2024 record](/studies/fleckenstein-2024-teachers/)). Illuminarty, one of four cards added in the same wave, joined with its one image record from Ha and Passananti 2024, so 18 of 72 cards now qualify.
- AIDI-R-02AI detector false positive rates, ranked
- AIDI-R-09AI detector false negative rates, ranked
- AIDI-R-08AI detectors ranked by published robustness to paraphrased and edited text
All three detectors have cards, and each card takes the three error rates with their bases (epoch.ai data insight, results table, read 9 November 2026).
All three appear in the ranking of detectors by test record. The human-text rates are printed counts at a default verdict and qualify for the false positive rate ranking, where Originality.ai's 3.84% of 495 sits beside the 0.47% at a 0.25 threshold that RAID 2024 reports. The direct-prompt and imitation misses are printed counts of AI passages not flagged and qualify for the false negative rate ranking as rates, never as complements. The imitation drop is an evasion result on 297 passages for the adversarial robustness ranking, with the caveat that no paraphraser or humanizer was used. The home page lists which AI detectors exist and who has tested them.
Related records: Jabarian and Imas 2025 scored the same three detectors a year earlier on 1,992 human passages and reports false positive rates of 0.0000 for Pangram, 0.0011 for Originality.ai and 0.0071 for GPTZero at a 0.5 threshold; Liang 2023 found the false positives this study did not, on non-native student essays.
Questions about this study
What false positive rates did Epoch AI 2026 find?
0 of 495 human passages for Pangram, 0 of 495 for GPTZero and 19 of 495 (3.84%, 90% CI 2.65% to 5.53%) for Originality.ai, at each detector's default verdict on about 500-word passages by 99 pre-2022 authors (epoch.ai, results table).
How much AI text did the detectors miss in Epoch AI 2026?
At most 2 of 297 passages written from a plain prompt (GPTZero 0.67%, Originality.ai 0.34%, Pangram 0.00%), but 30 of 297 (10.10%) for Pangram, 32 (10.77%) for GPTZero and 53 (17.85%) for Originality.ai when the model imitated a named author's style (epoch.ai, results table).
Which detector versions did Epoch AI 2026 test?
Pangram 3.3.2 and GPTZero model 2026-05-11-base through their APIs, and Originality.ai Turbo 3.0.2 through its web bulk uploader, scored in June and July 2026 (epoch.ai, Data section; repository README).
Source and revisions
Source
Lee, J. (2026). AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors. Epoch AI Data Insight, published 15 July 2026, https://epoch.ai/data-insights/ai-detectors-false-negatives, read 9 November 2026. Data: detector_error_rates.csv, updated 16 July 2026, read 9 November 2026. Methodology, corpus and code: https://github.com/jaeholee-brown/ai-text-detectors, README, read 9 November 2026.



