Epoch AI 2026: Pangram, GPTZero and Originality.ai on 495 human passages and 594 AI passages

Authors
Lee (Epoch AI)
Venue
Epoch AI Data Insight, epoch.ai, with data and code on GitHub
Published
AIDI-S-0026

Updated ·

Epoch AI's July 2026 data insight scored 495 human passages and 594 AI passages with Pangram, GPTZero and Originality.ai and found that Pangram and GPTZero flagged 0 of the 495 human passages, Originality.ai flagged 19 (3.84%), and all three missed between 30 and 53 of 297 AI passages written to imitate a named author (10.10% to 17.85%) while missing at most 2 of 297 passages written from a plain prompt (epoch.ai data insight, results table and CSV, read 9 November 2026). The insight, "AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors", is by Jaeho Lee and was published on epoch.ai on 15 July 2026 under a CC BY licence, with the error-rate CSV updated on 16 July 2026 and the passages, detector responses and analysis code in a public GitHub repository (jaeholee-brown/ai-text-detectors, README, read 9 November 2026). The study is not peer reviewed.

Epoch AI 2026: Pangram, GPTZero and Originality.ai on 495 human passages and 594 AI passages: register plate with the page title and its register ID
The record plate: register ID and title, drawn from the index data.

The record joins the studies index as the first in which two detectors returned zero false positives on a human set of this size (epoch.ai data insight, results table, read 9 November 2026).

Three detectors, all with a card in this index, each at a named version. Pangram (version 3.3.2) and GPTZero (model 2026-05-11-base) were called through their APIs; Originality.ai (Turbo 3.0.2) "offers no API at the Pro subscription tier", so it was scored through the web bulk uploader, where two passages failed and were rescored by hand (epoch.ai data insight, Data section, read 9 November 2026).

What was tested

Detectors tested

The 3 detectors tested and their index cards
DetectorIndex card
Pangram 3.3.2 (API)Pangram
GPTZero, model 2026-05-11-base (API)GPTZero
Originality.ai Turbo 3.0.2 (web bulk uploader)Originality.ai

Sample

The sample as the paper describes it
Text setCountSource
Human passages49599 authors, 5 each; blog, fiction and arXiv, pre-2022
AI, direct prompt29799 topics x Claude Opus 4.8, GPT-5.5, Gemini 3.1 Pro
AI, imitating a human author297Same models, five of the author's passages as examples

Detectors and versions as named in the insight's Data section; scoring took place in June and July 2026 per the repository README.

The human corpus is 495 passages of roughly 500 words from 99 authors, 33 each in blogging, fiction and scientific writing, five passages per author, every one published before 30 November 2022 and extracted verbatim from a Wayback Machine snapshot or arXiv source. For each author and each of three models, Claude Opus 4.8, GPT-5.5 and Gemini 3.1 Pro, the study produced one passage after showing the model five of the author's real passages and asking for a new piece in that style, and one passage from a derived one-line prompt on the same topic, giving 297 passages per condition. Titles and headings were removed and passages trimmed at a sentence boundary (epoch.ai data insight, Data section, read 9 November 2026).

Sample as described in the insight; the repository README gives the 30 November 2022 cutoff and the 8-gram verification.

The metric is each detector's document-level verdict at its default setting. Only a clean "AI" verdict counts as a detection; a "Mixed" verdict from Pangram or GPTZero counts as a non-detection on AI text and would count as a false positive on human text, though neither returned one on the 495 human passages. Error rates carry 90% confidence intervals (epoch.ai data insight, "Learn more about this graph", read 9 November 2026).

What the study reports

Results as the study reports them, with their base
MetricValueBase
False positive rate, human writingPangram 0.00% (0), GPTZero 0.00% (0), Originality.ai 3.84% (19; 90% CI 2.65% to 5.53%)495 human passages
False negative rate, AI from a direct promptPangram 0.00% (0), Originality.ai 0.34% (1), GPTZero 0.67% (2)297 AI passages
False negative rate, AI imitating an authorPangram 10.10% (30; CI 7.58% to 13.35%), GPTZero 10.77% (32; CI 8.16% to 14.10%), Originality.ai 17.85% (53; CI 14.49% to 21.78%)297 AI passages
Originality.ai false positives by genreFiction 16 of 165 (10%), blog 2 of 165 (1%), scientific 1 of 165 (1%)165 human passages per genre
Misses on imitation text, scientific genrePangram 25 of 99 (25%), GPTZero 24 of 99 (24%), Originality.ai 29 of 99 (29%)99 imitation passages per genre
Misses on imitation text by generatorPangram: Claude 5, GPT-5.5 5, Gemini 20 of 99; GPTZero 8, 10, 14; Originality.ai 12, 27, 1499 imitation passages per model
Most-evaded cellPangram 16 of 33 (48%) and GPTZero 12 of 33 (36%) on Gemini scientific; Originality.ai 13 of 33 (39%) on GPT-5.5 scientific33 passages per genre and model

Every figure below is printed in the insight's results table, its CSV and its Analysis tables (epoch.ai data insight and detector_error_rates.csv, read 9 November 2026).

Values as printed in the insight's tables and CSV. The insight's prose rounds 3.84% to 3.8% and the CSV prints 3.84; this record carries the CSV value. Counting "Mixed" as a detection would lower the imitation false negative rate to 6.1% for Pangram and 8.8% for GPTZero (Assumptions and limitations).

The false positive result is the headline for this index: across 495 pre-ChatGPT passages, two detectors returned no false positives and Originality.ai's 19 were concentrated in fiction, 16 of 165, against 2 in blogging and 1 in scientific writing; the author notes all 19 "were flags of writing that predates ChatGPT" (epoch.ai data insight, Analysis, read 9 November 2026). On plainly prompted AI text the three detectors missed 0, 1 and 2 of 297 passages.

Style imitation is the study's evasion method, and it worked unevenly: the three tools missed 10% to 18% of imitation passages overall but 24% to 29% of imitation passages in the scientific genre, and Gemini 3.1 Pro text evaded Pangram four times as often as Claude or GPT-5.5 text (20 of 99 against 5 of 99) (epoch.ai data insight, Analysis tables, read 9 November 2026).

Limits the authors state

The author lists five: the treatment of "Mixed" verdicts changes two detectors' imitation rates (10.1% to 6.1% for Pangram, 10.8% to 8.8% for GPTZero); genre-by-model cells hold only 33 passages; the five human passages per author come from one writer, which bears on the false positive rate only; detector versions were pinned in June 2026 and "can be updated by their makers without notice"; and the study tests "a single evasion method", few-shot style imitation, with no paraphrasing tools or manual editing, at default verdicts and one length of about 500 words (epoch.ai data insight, Assumptions and limitations, read 9 November 2026). Evident from the sources: the work is a web publication by one author, not a peer-reviewed paper; the repository README carries an earlier title than the published page; and the human authors are "well-known writers", not students or non-native writers.

Which cards this study feeds

All three detectors have cards, and each card takes the three error rates with their bases (epoch.ai data insight, results table, read 9 November 2026).

All three appear in the ranking of detectors by test record. The human-text rates are printed counts at a default verdict and qualify for the false positive rate ranking, where Originality.ai's 3.84% of 495 sits beside the 0.47% at a 0.25 threshold that RAID 2024 reports. The direct-prompt and imitation misses are printed counts of AI passages not flagged and qualify for the false negative rate ranking as rates, never as complements. The imitation drop is an evasion result on 297 passages for the adversarial robustness ranking, with the caveat that no paraphraser or humanizer was used. The home page lists which AI detectors exist and who has tested them.

Related records: Jabarian and Imas 2025 scored the same three detectors a year earlier on 1,992 human passages and reports false positive rates of 0.0000 for Pangram, 0.0011 for Originality.ai and 0.0071 for GPTZero at a 0.5 threshold; Liang 2023 found the false positives this study did not, on non-native student essays.

Questions about this study

What false positive rates did Epoch AI 2026 find?

0 of 495 human passages for Pangram, 0 of 495 for GPTZero and 19 of 495 (3.84%, 90% CI 2.65% to 5.53%) for Originality.ai, at each detector's default verdict on about 500-word passages by 99 pre-2022 authors (epoch.ai, results table).

How much AI text did the detectors miss in Epoch AI 2026?

At most 2 of 297 passages written from a plain prompt (GPTZero 0.67%, Originality.ai 0.34%, Pangram 0.00%), but 30 of 297 (10.10%) for Pangram, 32 (10.77%) for GPTZero and 53 (17.85%) for Originality.ai when the model imitated a named author's style (epoch.ai, results table).

Which detector versions did Epoch AI 2026 test?

Pangram 3.3.2 and GPTZero model 2026-05-11-base through their APIs, and Originality.ai Turbo 3.0.2 through its web bulk uploader, scored in June and July 2026 (epoch.ai, Data section; repository README).

Is Epoch AI 2026 peer reviewed?

No. The work is a data insight by Jaeho Lee published on epoch.ai on 15 July 2026 under a CC BY licence, with the passages, detector responses and analysis code released on GitHub so the rates can be recomputed (epoch.ai; GitHub).

Source and revisions

Source

Lee, J. (2026). AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors. Epoch AI Data Insight, published 15 July 2026, https://epoch.ai/data-insights/ai-detectors-false-negatives, read 9 November 2026. Data: detector_error_rates.csv, updated 16 July 2026, read 9 November 2026. Methodology, corpus and code: https://github.com/jaeholee-brown/ai-text-detectors, README, read 9 November 2026.

Revision log

  1. Record created

Corrections log

Related reading