Which AI detectors were tested on GPT-4 text? The 13 cards scored on GPT-4 family output in 7 study records, with every result and its base
Thirteen of the 72 AI detectors in the index have been scored on text from a GPT-4 family model, in 7 of the 35 study records, counted from each record's sample table read 9 November 2026 in the data file. The earliest, Walters 2023, ran 16 detectors on 42 literature reviews generated by ChatGPT-4 in the first week of April 2023 and found Copyleaks, Turnitin and Originality.ai correct on all 42, GPTZero correct on 57%, and the 16-detector average at 61% (DOI 10.1515/opis-2022-0158, read 9 November 2026). The largest GPT-4 family sample is Jabarian and Imas 2025's 1,992 GPT-4.1 passages, one of four generators on which Pangram, GPTZero, Originality.ai and the GPT-2 Output Detector were scored (NBER w34223, read 9 November 2026), and the most recent, Van Vlasselaer 2026, used GPT-4o to write the AI sections of 40 hybrid and 40 humanised papers (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). GPTZero is the only card in all 7 records; Pangram is in 3, none earlier than 2025.
"Tested on GPT-4" is read literally from each record's sample table: the generator must be named as GPT-4, ChatGPT-4, GPT-4.1, GPT-4o or the GPT-4 family, and the card must appear in that record's detectors table. Where a record prints a result for GPT-4 text alone, the row gives it; where the record pools GPT-4 with other generators, the row gives the record's result for that card and says so, because the base is what makes the number readable. Two records that used GPT-4 text score no card and are left out of the table: the NIST GenAI pilot, whose 40 GPT-4 summaries were scored by anonymised teams (DOI 10.6028/NIST.AI.700-1, read 9 November 2026), and Epoch AI 2026, which used GPT-5.5, Claude Opus 4.8 and Gemini 3.1 Pro rather than a GPT-4 model (epoch.ai, read 9 November 2026). This page is one of the questions answered from the index; the ranking by independent testing counts every record per card, the question on ChatGPT coverage claims sets the vendors' generator lists beside these tests, and the AI detector register carries every card.
| Detector | Study record | Generator, as the record names it | Result on that text, with base | Source |
|---|---|---|---|---|
| Copyleaks | Walters 2023 | ChatGPT-4 (GPT-4 documents, Table 4) | 100% of 42 GPT-4 documents correct | DOI 10.1515/opis-2022-0158 |
| Turnitin | Walters 2023 | ChatGPT-4 | 100% of 42 GPT-4 documents correct | DOI 10.1515/opis-2022-0158 |
| Originality.ai | Walters 2023 | ChatGPT-4 | 100% of 42 GPT-4 documents correct (detection model 1.4) | DOI 10.1515/opis-2022-0158 |
| ZeroGPT | Walters 2023 | ChatGPT-4 | 83% of 42 GPT-4 documents correct | DOI 10.1515/opis-2022-0158 |
| Scribbr | Walters 2023 | ChatGPT-4 | 69% of 42 GPT-4 documents correct | DOI 10.1515/opis-2022-0158 |
| GPTZero | Walters 2023 | ChatGPT-4 | 57% of 42 GPT-4 documents correct (Pro plan) | DOI 10.1515/opis-2022-0158 |
| BrandWell | Walters 2023 | ChatGPT-4 | 52% of 42 GPT-4 documents correct, 29% incorrect (tested as Content at Scale) | DOI 10.1515/opis-2022-0158 |
| Sapling | Walters 2023 | ChatGPT-4 | 33% of 42 GPT-4 documents correct | DOI 10.1515/opis-2022-0158 |
| Writer | Walters 2023 | ChatGPT-4 | Scored on the same 42; the record prints Writer's false negative rate with Crossplag and GPT Radar, 23% to 36%, across all 84 AI documents | DOI 10.1515/opis-2022-0158 |
| Copyleaks | Elkhatat 2023 | GPT-4 | 14 of 15 GPT-4 paragraphs flagged (sensitivity 93%) | DOI 10.1007/s40979-023-00140-5 |
| GPTZero | Elkhatat 2023 | GPT-4 | 4 of 15 GPT-4 paragraphs flagged, 11 missed | DOI 10.1007/s40979-023-00140-5 |
| Writer | Elkhatat 2023 | GPT-4 | 1 of 15 GPT-4 paragraphs flagged, 11 missed, 3 uncertain | DOI 10.1007/s40979-023-00140-5 |
| Copyleaks | Perkins 2024 | GPT-4 (5 of 15 original samples, about 500 words) | Baseline mean accuracy 64.8% on 15 AI and 10 human samples; GPT-4 output identified 23.9% of the time, pooled across seven tools | DOI 10.1186/s41239-024-00487-w |
| Turnitin | Perkins 2024 | GPT-4 | Baseline mean accuracy 61% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9% | DOI 10.1186/s41239-024-00487-w |
| GPT-2 Output Detector | Perkins 2024 | GPT-4 | Baseline mean accuracy 57.2% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9% | DOI 10.1186/s41239-024-00487-w |
| ZeroGPT | Perkins 2024 | GPT-4 | Baseline mean accuracy 46.1% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9% | DOI 10.1186/s41239-024-00487-w |
| GPTZero | Perkins 2024 | GPT-4 | Baseline mean accuracy 26.3% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9% | DOI 10.1186/s41239-024-00487-w |
| GPTZero | RAID 2024 | GPT-4, one of 11 generators from GPT-2 to GPT-4 | Pooled across generators: 98.8 (accuracy) at 5% FPR on open chat models with greedy decoding, 9.4 on open non-chat models with sampling; 0.00% false positives at threshold 0.5 | DOI 10.18653/v1/2024.acl-long.674 |
| Originality.ai | RAID 2024 | GPT-4, one of 11 generators | Pooled: 98.6 and 89.0 (accuracy) at 5% FPR on the same two groups; 0.25% false positives at 0.5 | DOI 10.18653/v1/2024.acl-long.674 |
| Winston AI | RAID 2024 | GPT-4, one of 11 generators | Pooled: 97.2 and 29.5 (accuracy) at 5% FPR on the same two groups; 0.55% false positives at 0.5 | DOI 10.18653/v1/2024.acl-long.674 |
| ZeroGPT | RAID 2024 | GPT-4, one of 11 generators | Pooled: 95.4 and 16.0 (accuracy) at 5% FPR on the same two groups; 1.42% false positives at 0.5 | DOI 10.18653/v1/2024.acl-long.674 |
| GLTR | RAID 2024 | GPT-4, one of 11 generators | Pooled: 89.8 (accuracy) at 5% FPR on open chat models with greedy decoding, 0.5 on open non-chat models under sampling with a repetition penalty; 99.3% false positives at 0.5 | DOI 10.18653/v1/2024.acl-long.674 |
| GPT-2 Output Detector | RAID 2024 | GPT-4, one of 11 generators | Pooled, RoBERTa-Large: 79.7 (accuracy) at 5% FPR on open chat models with greedy decoding, 98.5 on open non-chat models with greedy decoding; 2.91% false positives at 0.5 (6.59% for RoBERTa-Base) | DOI 10.18653/v1/2024.acl-long.674 |
| Pangram | Jabarian and Imas 2025 | GPT-4.1 (1,992 passages, one of four generators) | False negative rate 0.0131 of 1,992 GPT-4.1 passages at threshold 0.5 (Table 4); 0.0000 false positives on 1,992 human passages | NBER w34223 |
| GPTZero | Jabarian and Imas 2025 | GPT-4.1 | False negative rate 0.0025 of 1,992 GPT-4.1 passages at threshold 0.5 (Table 4); 0.0071 false positives | NBER w34223 |
| Originality.ai | Jabarian and Imas 2025 | GPT-4.1 | False negative rate between 0.1606 and 0.3733 at threshold 0.5 on the GPT-4.1 and Claude Opus 4 passages (Table 4); 0.0011 false positives | NBER w34223 |
| GPT-2 Output Detector | Jabarian and Imas 2025 | GPT-4.1 | Run as the RoBERTa-base baseline: up to 51% of AI passages missed at Youden-optimised thresholds; 0.9503 false positives | NBER w34223 |
| Pangram | Van Vlasselaer 2026 | GPT-4o (AI sections of 40 hybrid and 40 humanised papers) | 37 of 40 hybrid and 37 of 40 humanised papers within their known AI range | DOI 10.1007/s40979-026-00226-w |
| Turnitin | Van Vlasselaer 2026 | GPT-4o | 60.0% (accuracy) on 40 hybrid and 50.0% on 40 humanised papers | DOI 10.1007/s40979-026-00226-w |
| Copyleaks | Van Vlasselaer 2026 | GPT-4o | 30.0% on 40 hybrid and 22.5% on 40 humanised papers | DOI 10.1007/s40979-026-00226-w |
| GPTZero | Van Vlasselaer 2026 | GPT-4o | 0.0% on 40 hybrid papers (all 40 missed) and 2.5% on 40 humanised papers (1 of 40) | DOI 10.1007/s40979-026-00226-w |
| GPTZero | DAMAGE 2025 | GPT-4 family, among the mirror-essay generators | Pooled across generators: true positive rate at 5% FPR 99.73% on AI student essays, 60.04% after humanizing (essay count not printed) | ACL Anthology 2025.genaidetect-1.9 |
| Pangram | DAMAGE 2025 | GPT-4 family; GPT-4o for the 2,000 mirror essays of Table 5 | Pooled: DAMAGE model 100.00% and 98.26% at 5% FPR; 100% at 5% FPR on 2,000 GPT-4o mirror essays against a humanizer fine-tuned to beat it (vendor's own research models) | ACL Anthology 2025.genaidetect-1.9 |
Results as each record prints them, with the base the record gives; every record was read in the primary source on 9 November 2026, and "pooled" marks a figure the record does not separate by generator.
Which studies used GPT-4 text, and how much?
Seven records, and the GPT-4 share runs from 5 samples to 1,992 passages. Walters 2023 generated 42 literature reviews with ChatGPT-4 in the first week of April 2023, matched to 42 from ChatGPT-3.5 and 42 student essays, and tested 16 detectors between 25 June and 12 July 2023 (DOI 10.1515/opis-2022-0158, read 9 November 2026). Elkhatat 2023 wrote 15 GPT-4 paragraphs and 15 GPT-3.5 paragraphs against 5 human controls (DOI 10.1007/s40979-023-00140-5, read 9 November 2026). Perkins 2024 had GPT-4 write 5 of its 15 original samples of about 500 words, beside Claude 2 and Bard, then applied six adversarial techniques (DOI 10.1186/s41239-024-00487-w, read 9 November 2026). RAID 2024 lists GPT-4 among 11 generators behind 509,014 non-adversarial generations and prints its detector results pooled (DOI 10.18653/v1/2024.acl-long.674, read 9 November 2026). Jabarian and Imas 2025 generated 1,992 passages each from GPT-4.1, Claude Opus 4, Claude Sonnet 4 and Gemini 2.0 Flash (NBER w34223, read 9 November 2026). Van Vlasselaer 2026 used GPT-4o for the literature review and conclusion of 40 hybrid papers and a GPT-4o prompt to humanise them, while its 40 fully AI papers came from ChatGPT Deep Research mode (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). DAMAGE 2025 names the GPT-4 family among the models that wrote one mirror essay per human essay and uses 2,000 GPT-4o mirrors in its fine-tuned humanizer test (ACL Anthology 2025.genaidetect-1.9, read 9 November 2026).
Which detectors scored best and worst on GPT-4 text?
In the two records that print GPT-4 results alone, Copyleaks is at the top both times: 100% of 42 GPT-4 documents in Walters 2023, shared with Turnitin and Originality.ai, and 14 of 15 GPT-4 paragraphs in Elkhatat 2023, where GPTZero fell from 14 of 15 GPT-3.5 paragraphs to 4 of 15 and Writer flagged 1 of 15 (DOI 10.1007/s40979-023-00140-5, read 9 November 2026). Walters 2023 shows the same version gap across its field: 61% average on GPT-4 documents against a higher or equal figure on GPT-3.5 for every card with a printed split, with Sapling at 33% and GPTZero at 57% on GPT-4 (DOI 10.1515/opis-2022-0158, read 9 November 2026). Perkins 2024 is the low point: GPT-4 output was identified 23.9% of the time across seven tools, against 76.9% for Bard and 17.7% for Claude 2 (DOI 10.1186/s41239-024-00487-w, read 9 November 2026). On the 2025 and 2026 text the order changes: GPTZero missed 0.0025 and Pangram 0.0131 of 1,992 GPT-4.1 passages at threshold 0.5 in Jabarian and Imas 2025 (NBER w34223, read 9 November 2026), while Pangram placed 37 of 40 GPT-4o hybrid papers in range in Van Vlasselaer 2026, where GPTZero placed 0 of 40 (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). The false negative rate ranking orders the cards on the miss rates these records produce.
Which detectors have never been tested on GPT-4 text?
Twenty-nine cards. Eight have study records whose generators are something else, from ChatGPT 3.5 in Kar 2024 to DeepSeek-V3 in Alshammari and Rao 2025 and images in Ha and Passananti 2024, and the table below names them. The other 21 cards have no study record at all: Grammarly, Phrasly, JustDone, Proofademic, Walter Writes, AIDetectPlus, Codequiry, WasItAI, Reality Defender, Grammarly Authorship, Turnitin Clarity, SynthID, Smodin, Surfer, Quetext, TruthScan, Deepware, Sensity, Codeleaks, Pindrop Pulse and Resemble Detect, by the study lists on their cards read 9 November 2026. Of the 13 cards that were tested, 11 name GPT-4, a later GPT model or ChatGPT in the generator field of their card, while GLTR and the GPT-2 Output Detector name only GPT-2 and were scored on GPT-4 era text anyway; the ChatGPT coverage question sets the vendor lists beside the tests.
Cards with study records but no GPT-4 text test
| Detector | Study records | Generators the records name | Source |
|---|---|---|---|
| QuillBot | Kar 2024, Alshammari and Rao 2025 | ChatGPT 3.5 (one article and three paraphrases); DeepSeek-V3 and DeepThink | DOI 10.1177/02537176241247934 |
| Undetectable AI | Kar 2024 | ChatGPT 3.5 | DOI 10.1177/02537176241247934 |
| Compilatio | Weber-Wulff 2023 | ChatGPT, March 2023 | DOI 10.1007/s40979-023-00146-z |
| DetectGPT | Weber-Wulff 2023, Sadasivan 2023, Krishna 2023, Pegoraro 2023 | ChatGPT; GPT-2 Medium; GPT-2 XL, OPT-13B and GPT-3.5 text-davinci-003; ChatGPT | arXiv 2303.13408 |
| Hive | Ha and Passananti 2024, RAID image 2025 | Images from five generators; four text-to-image models | DOI 10.1145/3658644.3670306 |
| AI or Not | Ha and Passananti 2024 | Images from five generators (tested as Optic) | DOI 10.1145/3658644.3670306 |
| Illuminarty | Ha and Passananti 2024 | Images from five generators | DOI 10.1145/3658644.3670306 |
| Sightengine | RAID image 2025 | Images from four text-to-image models | arXiv 2506.03988 |
Records and generators as each record's sample table names them, read 9 November 2026.
A GPT-4 result dates the detector as much as the generator: the 2023 figures came from versions that Turnitin, GPTZero and Originality.ai have each replaced by their own dated release notes, and no GPT-4 record scores the versions of November 2026.
Questions about AI detectors tested on GPT-4
Has any AI detector been tested on GPT-4 text?
13 of 42 cards, in 7 study records read 9 November 2026: Copyleaks, Turnitin, Originality.ai, ZeroGPT, Scribbr, GPTZero, BrandWell, Sapling and Writer in Walters 2023 (42 ChatGPT-4 documents); Copyleaks, GPTZero and Writer in Elkhatat 2023 (15 paragraphs); five cards in Perkins 2024; six in RAID 2024; Pangram, GPTZero, Originality.ai and the GPT-2 Output Detector in Jabarian and Imas 2025 (1,992 GPT-4.1 passages); four in Van Vlasselaer 2026; and GPTZero and Pangram in DAMAGE 2025.
Which AI detector scored highest on GPT-4 text?
100% of 42 GPT-4 documents for Copyleaks, Turnitin and Originality.ai in Walters 2023 (DOI 10.1515/opis-2022-0158), and 14 of 15 GPT-4 paragraphs for Copyleaks in Elkhatat 2023 (DOI 10.1007/s40979-023-00140-5), both read 9 November 2026; on 1,992 GPT-4.1 passages in Jabarian and Imas 2025, GPTZero missed 0.0025 and Pangram 0.0131 at threshold 0.5.
Did GPTZero detect GPT-4?
57% of 42 GPT-4 documents in Walters 2023, 4 of 15 GPT-4 paragraphs in Elkhatat 2023, and 0 of 40 GPT-4o hybrid papers in Van Vlasselaer 2026, by the records read 9 November 2026; on 1,992 GPT-4.1 passages in Jabarian and Imas 2025 its false negative rate at threshold 0.5 was 0.0025, the lowest of the four tools in that table.
Has Pangram been tested on GPT-4?
3 records, all from 2025 and 2026: Jabarian and Imas 2025 (1,992 GPT-4.1 passages, false negative rate 0.0131 at threshold 0.5), Van Vlasselaer 2026 (37 of 40 GPT-4o hybrid and 37 of 40 humanised papers in range) and DAMAGE 2025 (100% at 5% FPR on 2,000 GPT-4o mirror essays, the vendor's own research model), read 9 November 2026.
Which studies tested detectors on GPT-5 or later models?
1 record: Epoch AI 2026 scored Pangram, GPTZero and Originality.ai on 297 passages each from GPT-5.5, Claude Opus 4.8 and Gemini 3.1 Pro, pooled, and recorded 0 false positives for Pangram and GPTZero on 495 human passages (epoch.ai, read 9 November 2026).
Sources
All read 9 November 2026 in the primary source; the source of every row is linked in the tables.
- Walters 2023: https://doi.org/10.1515/opis-2022-0158
- Elkhatat 2023: https://doi.org/10.1007/s40979-023-00140-5
- Perkins 2024: https://doi.org/10.1186/s41239-024-00487-w
- RAID 2024 (Dugan et al.): https://doi.org/10.18653/v1/2024.acl-long.674
- Jabarian and Imas 2025, NBER w34223: https://www.nber.org/papers/w34223
- Van Vlasselaer 2026: https://doi.org/10.1007/s40979-026-00226-w
- DAMAGE 2025: https://aclanthology.org/2025.genaidetect-1.9/
- NIST AI 700-1 (2025): https://doi.org/10.6028/NIST.AI.700-1
- Epoch AI 2026 data insight: https://epoch.ai/data-insights/ai-detectors-false-negatives
- Kar 2024: https://doi.org/10.1177/02537176241247934
- Alshammari and Rao 2025: https://arxiv.org/abs/2507.17944
- Weber-Wulff 2023: https://doi.org/10.1007/s40979-023-00146-z
- Sadasivan 2023: https://arxiv.org/abs/2303.11156
- Krishna 2023: https://arxiv.org/abs/2303.13408
- Pegoraro 2023: https://arxiv.org/abs/2304.01487
- Ha and Passananti 2024: https://doi.org/10.1145/3658644.3670306
- RAID image 2025: https://arxiv.org/abs/2506.03988
Revision log: 2026-11-09: page created from the sample and results tables of 7 study records and the study lists of 42 cards at index version 2026.11.7.
Related pages: Which AI detectors have the most false positive studies? GPTZero with 11 records, the GPT-2 Output Detector with 8, and every human-text figure the index holds for 15 text cards, Which AI detectors run in Canvas without Turnitin? The seven cards that name a Canvas integration of their own, how each connects, and what the plan costs, AI detector false negative rates, ranked and Questions about AI detectors, answered from the index.