Which AI detectors were tested on GPT-4 text? The 13 cards scored on GPT-4 family output in 7 study records, with every result and its base

AIDI-Q-25

Updated ·

Thirteen of the 72 AI detectors in the index have been scored on text from a GPT-4 family model, in 7 of the 35 study records, counted from each record's sample table read 9 November 2026 in the data file. The earliest, Walters 2023, ran 16 detectors on 42 literature reviews generated by ChatGPT-4 in the first week of April 2023 and found Copyleaks, Turnitin and Originality.ai correct on all 42, GPTZero correct on 57%, and the 16-detector average at 61% (DOI 10.1515/opis-2022-0158, read 9 November 2026). The largest GPT-4 family sample is Jabarian and Imas 2025's 1,992 GPT-4.1 passages, one of four generators on which Pangram, GPTZero, Originality.ai and the GPT-2 Output Detector were scored (NBER w34223, read 9 November 2026), and the most recent, Van Vlasselaer 2026, used GPT-4o to write the AI sections of 40 hybrid and 40 humanised papers (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). GPTZero is the only card in all 7 records; Pangram is in 3, none earlier than 2025.

"Tested on GPT-4" is read literally from each record's sample table: the generator must be named as GPT-4, ChatGPT-4, GPT-4.1, GPT-4o or the GPT-4 family, and the card must appear in that record's detectors table. Where a record prints a result for GPT-4 text alone, the row gives it; where the record pools GPT-4 with other generators, the row gives the record's result for that card and says so, because the base is what makes the number readable. Two records that used GPT-4 text score no card and are left out of the table: the NIST GenAI pilot, whose 40 GPT-4 summaries were scored by anonymised teams (DOI 10.6028/NIST.AI.700-1, read 9 November 2026), and Epoch AI 2026, which used GPT-5.5, Claude Opus 4.8 and Gemini 3.1 Pro rather than a GPT-4 model (epoch.ai, read 9 November 2026). This page is one of the questions answered from the index; the ranking by independent testing counts every record per card, the question on ChatGPT coverage claims sets the vendors' generator lists beside these tests, and the AI detector register carries every card.

DetectorStudy recordGenerator, as the record names itResult on that text, with baseSource
CopyleaksWalters 2023ChatGPT-4 (GPT-4 documents, Table 4)100% of 42 GPT-4 documents correctDOI 10.1515/opis-2022-0158
TurnitinWalters 2023ChatGPT-4100% of 42 GPT-4 documents correctDOI 10.1515/opis-2022-0158
Originality.aiWalters 2023ChatGPT-4100% of 42 GPT-4 documents correct (detection model 1.4)DOI 10.1515/opis-2022-0158
ZeroGPTWalters 2023ChatGPT-483% of 42 GPT-4 documents correctDOI 10.1515/opis-2022-0158
ScribbrWalters 2023ChatGPT-469% of 42 GPT-4 documents correctDOI 10.1515/opis-2022-0158
GPTZeroWalters 2023ChatGPT-457% of 42 GPT-4 documents correct (Pro plan)DOI 10.1515/opis-2022-0158
BrandWellWalters 2023ChatGPT-452% of 42 GPT-4 documents correct, 29% incorrect (tested as Content at Scale)DOI 10.1515/opis-2022-0158
SaplingWalters 2023ChatGPT-433% of 42 GPT-4 documents correctDOI 10.1515/opis-2022-0158
WriterWalters 2023ChatGPT-4Scored on the same 42; the record prints Writer's false negative rate with Crossplag and GPT Radar, 23% to 36%, across all 84 AI documentsDOI 10.1515/opis-2022-0158
CopyleaksElkhatat 2023GPT-414 of 15 GPT-4 paragraphs flagged (sensitivity 93%)DOI 10.1007/s40979-023-00140-5
GPTZeroElkhatat 2023GPT-44 of 15 GPT-4 paragraphs flagged, 11 missedDOI 10.1007/s40979-023-00140-5
WriterElkhatat 2023GPT-41 of 15 GPT-4 paragraphs flagged, 11 missed, 3 uncertainDOI 10.1007/s40979-023-00140-5
CopyleaksPerkins 2024GPT-4 (5 of 15 original samples, about 500 words)Baseline mean accuracy 64.8% on 15 AI and 10 human samples; GPT-4 output identified 23.9% of the time, pooled across seven toolsDOI 10.1186/s41239-024-00487-w
TurnitinPerkins 2024GPT-4Baseline mean accuracy 61% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9%DOI 10.1186/s41239-024-00487-w
GPT-2 Output DetectorPerkins 2024GPT-4Baseline mean accuracy 57.2% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9%DOI 10.1186/s41239-024-00487-w
ZeroGPTPerkins 2024GPT-4Baseline mean accuracy 46.1% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9%DOI 10.1186/s41239-024-00487-w
GPTZeroPerkins 2024GPT-4Baseline mean accuracy 26.3% on 15 AI and 10 human samples; GPT-4 pooled figure 23.9%DOI 10.1186/s41239-024-00487-w
GPTZeroRAID 2024GPT-4, one of 11 generators from GPT-2 to GPT-4Pooled across generators: 98.8 (accuracy) at 5% FPR on open chat models with greedy decoding, 9.4 on open non-chat models with sampling; 0.00% false positives at threshold 0.5DOI 10.18653/v1/2024.acl-long.674
Originality.aiRAID 2024GPT-4, one of 11 generatorsPooled: 98.6 and 89.0 (accuracy) at 5% FPR on the same two groups; 0.25% false positives at 0.5DOI 10.18653/v1/2024.acl-long.674
Winston AIRAID 2024GPT-4, one of 11 generatorsPooled: 97.2 and 29.5 (accuracy) at 5% FPR on the same two groups; 0.55% false positives at 0.5DOI 10.18653/v1/2024.acl-long.674
ZeroGPTRAID 2024GPT-4, one of 11 generatorsPooled: 95.4 and 16.0 (accuracy) at 5% FPR on the same two groups; 1.42% false positives at 0.5DOI 10.18653/v1/2024.acl-long.674
GLTRRAID 2024GPT-4, one of 11 generatorsPooled: 89.8 (accuracy) at 5% FPR on open chat models with greedy decoding, 0.5 on open non-chat models under sampling with a repetition penalty; 99.3% false positives at 0.5DOI 10.18653/v1/2024.acl-long.674
GPT-2 Output DetectorRAID 2024GPT-4, one of 11 generatorsPooled, RoBERTa-Large: 79.7 (accuracy) at 5% FPR on open chat models with greedy decoding, 98.5 on open non-chat models with greedy decoding; 2.91% false positives at 0.5 (6.59% for RoBERTa-Base)DOI 10.18653/v1/2024.acl-long.674
PangramJabarian and Imas 2025GPT-4.1 (1,992 passages, one of four generators)False negative rate 0.0131 of 1,992 GPT-4.1 passages at threshold 0.5 (Table 4); 0.0000 false positives on 1,992 human passagesNBER w34223
GPTZeroJabarian and Imas 2025GPT-4.1False negative rate 0.0025 of 1,992 GPT-4.1 passages at threshold 0.5 (Table 4); 0.0071 false positivesNBER w34223
Originality.aiJabarian and Imas 2025GPT-4.1False negative rate between 0.1606 and 0.3733 at threshold 0.5 on the GPT-4.1 and Claude Opus 4 passages (Table 4); 0.0011 false positivesNBER w34223
GPT-2 Output DetectorJabarian and Imas 2025GPT-4.1Run as the RoBERTa-base baseline: up to 51% of AI passages missed at Youden-optimised thresholds; 0.9503 false positivesNBER w34223
PangramVan Vlasselaer 2026GPT-4o (AI sections of 40 hybrid and 40 humanised papers)37 of 40 hybrid and 37 of 40 humanised papers within their known AI rangeDOI 10.1007/s40979-026-00226-w
TurnitinVan Vlasselaer 2026GPT-4o60.0% (accuracy) on 40 hybrid and 50.0% on 40 humanised papersDOI 10.1007/s40979-026-00226-w
CopyleaksVan Vlasselaer 2026GPT-4o30.0% on 40 hybrid and 22.5% on 40 humanised papersDOI 10.1007/s40979-026-00226-w
GPTZeroVan Vlasselaer 2026GPT-4o0.0% on 40 hybrid papers (all 40 missed) and 2.5% on 40 humanised papers (1 of 40)DOI 10.1007/s40979-026-00226-w
GPTZeroDAMAGE 2025GPT-4 family, among the mirror-essay generatorsPooled across generators: true positive rate at 5% FPR 99.73% on AI student essays, 60.04% after humanizing (essay count not printed)ACL Anthology 2025.genaidetect-1.9
PangramDAMAGE 2025GPT-4 family; GPT-4o for the 2,000 mirror essays of Table 5Pooled: DAMAGE model 100.00% and 98.26% at 5% FPR; 100% at 5% FPR on 2,000 GPT-4o mirror essays against a humanizer fine-tuned to beat it (vendor's own research models)ACL Anthology 2025.genaidetect-1.9

Results as each record prints them, with the base the record gives; every record was read in the primary source on 9 November 2026, and "pooled" marks a figure the record does not separate by generator.

Which studies used GPT-4 text, and how much?

Seven records, and the GPT-4 share runs from 5 samples to 1,992 passages. Walters 2023 generated 42 literature reviews with ChatGPT-4 in the first week of April 2023, matched to 42 from ChatGPT-3.5 and 42 student essays, and tested 16 detectors between 25 June and 12 July 2023 (DOI 10.1515/opis-2022-0158, read 9 November 2026). Elkhatat 2023 wrote 15 GPT-4 paragraphs and 15 GPT-3.5 paragraphs against 5 human controls (DOI 10.1007/s40979-023-00140-5, read 9 November 2026). Perkins 2024 had GPT-4 write 5 of its 15 original samples of about 500 words, beside Claude 2 and Bard, then applied six adversarial techniques (DOI 10.1186/s41239-024-00487-w, read 9 November 2026). RAID 2024 lists GPT-4 among 11 generators behind 509,014 non-adversarial generations and prints its detector results pooled (DOI 10.18653/v1/2024.acl-long.674, read 9 November 2026). Jabarian and Imas 2025 generated 1,992 passages each from GPT-4.1, Claude Opus 4, Claude Sonnet 4 and Gemini 2.0 Flash (NBER w34223, read 9 November 2026). Van Vlasselaer 2026 used GPT-4o for the literature review and conclusion of 40 hybrid papers and a GPT-4o prompt to humanise them, while its 40 fully AI papers came from ChatGPT Deep Research mode (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). DAMAGE 2025 names the GPT-4 family among the models that wrote one mirror essay per human essay and uses 2,000 GPT-4o mirrors in its fine-tuned humanizer test (ACL Anthology 2025.genaidetect-1.9, read 9 November 2026).

Which detectors scored best and worst on GPT-4 text?

In the two records that print GPT-4 results alone, Copyleaks is at the top both times: 100% of 42 GPT-4 documents in Walters 2023, shared with Turnitin and Originality.ai, and 14 of 15 GPT-4 paragraphs in Elkhatat 2023, where GPTZero fell from 14 of 15 GPT-3.5 paragraphs to 4 of 15 and Writer flagged 1 of 15 (DOI 10.1007/s40979-023-00140-5, read 9 November 2026). Walters 2023 shows the same version gap across its field: 61% average on GPT-4 documents against a higher or equal figure on GPT-3.5 for every card with a printed split, with Sapling at 33% and GPTZero at 57% on GPT-4 (DOI 10.1515/opis-2022-0158, read 9 November 2026). Perkins 2024 is the low point: GPT-4 output was identified 23.9% of the time across seven tools, against 76.9% for Bard and 17.7% for Claude 2 (DOI 10.1186/s41239-024-00487-w, read 9 November 2026). On the 2025 and 2026 text the order changes: GPTZero missed 0.0025 and Pangram 0.0131 of 1,992 GPT-4.1 passages at threshold 0.5 in Jabarian and Imas 2025 (NBER w34223, read 9 November 2026), while Pangram placed 37 of 40 GPT-4o hybrid papers in range in Van Vlasselaer 2026, where GPTZero placed 0 of 40 (DOI 10.1007/s40979-026-00226-w, read 9 November 2026). The false negative rate ranking orders the cards on the miss rates these records produce.

Which detectors have never been tested on GPT-4 text?

Twenty-nine cards. Eight have study records whose generators are something else, from ChatGPT 3.5 in Kar 2024 to DeepSeek-V3 in Alshammari and Rao 2025 and images in Ha and Passananti 2024, and the table below names them. The other 21 cards have no study record at all: Grammarly, Phrasly, JustDone, Proofademic, Walter Writes, AIDetectPlus, Codequiry, WasItAI, Reality Defender, Grammarly Authorship, Turnitin Clarity, SynthID, Smodin, Surfer, Quetext, TruthScan, Deepware, Sensity, Codeleaks, Pindrop Pulse and Resemble Detect, by the study lists on their cards read 9 November 2026. Of the 13 cards that were tested, 11 name GPT-4, a later GPT model or ChatGPT in the generator field of their card, while GLTR and the GPT-2 Output Detector name only GPT-2 and were scored on GPT-4 era text anyway; the ChatGPT coverage question sets the vendor lists beside the tests.

Cards with study records but no GPT-4 text test

DetectorStudy recordsGenerators the records nameSource
QuillBotKar 2024, Alshammari and Rao 2025ChatGPT 3.5 (one article and three paraphrases); DeepSeek-V3 and DeepThinkDOI 10.1177/02537176241247934
Undetectable AIKar 2024ChatGPT 3.5DOI 10.1177/02537176241247934
CompilatioWeber-Wulff 2023ChatGPT, March 2023DOI 10.1007/s40979-023-00146-z
DetectGPTWeber-Wulff 2023, Sadasivan 2023, Krishna 2023, Pegoraro 2023ChatGPT; GPT-2 Medium; GPT-2 XL, OPT-13B and GPT-3.5 text-davinci-003; ChatGPTarXiv 2303.13408
HiveHa and Passananti 2024, RAID image 2025Images from five generators; four text-to-image modelsDOI 10.1145/3658644.3670306
AI or NotHa and Passananti 2024Images from five generators (tested as Optic)DOI 10.1145/3658644.3670306
IlluminartyHa and Passananti 2024Images from five generatorsDOI 10.1145/3658644.3670306
SightengineRAID image 2025Images from four text-to-image modelsarXiv 2506.03988

Records and generators as each record's sample table names them, read 9 November 2026.

A GPT-4 result dates the detector as much as the generator: the 2023 figures came from versions that Turnitin, GPTZero and Originality.ai have each replaced by their own dated release notes, and no GPT-4 record scores the versions of November 2026.

Questions about AI detectors tested on GPT-4

Has any AI detector been tested on GPT-4 text?

13 of 42 cards, in 7 study records read 9 November 2026: Copyleaks, Turnitin, Originality.ai, ZeroGPT, Scribbr, GPTZero, BrandWell, Sapling and Writer in Walters 2023 (42 ChatGPT-4 documents); Copyleaks, GPTZero and Writer in Elkhatat 2023 (15 paragraphs); five cards in Perkins 2024; six in RAID 2024; Pangram, GPTZero, Originality.ai and the GPT-2 Output Detector in Jabarian and Imas 2025 (1,992 GPT-4.1 passages); four in Van Vlasselaer 2026; and GPTZero and Pangram in DAMAGE 2025.

Which AI detector scored highest on GPT-4 text?

100% of 42 GPT-4 documents for Copyleaks, Turnitin and Originality.ai in Walters 2023 (DOI 10.1515/opis-2022-0158), and 14 of 15 GPT-4 paragraphs for Copyleaks in Elkhatat 2023 (DOI 10.1007/s40979-023-00140-5), both read 9 November 2026; on 1,992 GPT-4.1 passages in Jabarian and Imas 2025, GPTZero missed 0.0025 and Pangram 0.0131 at threshold 0.5.

Did GPTZero detect GPT-4?

57% of 42 GPT-4 documents in Walters 2023, 4 of 15 GPT-4 paragraphs in Elkhatat 2023, and 0 of 40 GPT-4o hybrid papers in Van Vlasselaer 2026, by the records read 9 November 2026; on 1,992 GPT-4.1 passages in Jabarian and Imas 2025 its false negative rate at threshold 0.5 was 0.0025, the lowest of the four tools in that table.

Has Pangram been tested on GPT-4?

3 records, all from 2025 and 2026: Jabarian and Imas 2025 (1,992 GPT-4.1 passages, false negative rate 0.0131 at threshold 0.5), Van Vlasselaer 2026 (37 of 40 GPT-4o hybrid and 37 of 40 humanised papers in range) and DAMAGE 2025 (100% at 5% FPR on 2,000 GPT-4o mirror essays, the vendor's own research model), read 9 November 2026.

Which studies tested detectors on GPT-5 or later models?

1 record: Epoch AI 2026 scored Pangram, GPTZero and Originality.ai on 297 passages each from GPT-5.5, Claude Opus 4.8 and Gemini 3.1 Pro, pooled, and recorded 0 false positives for Pangram and GPTZero on 495 human passages (epoch.ai, read 9 November 2026).

Sources

All read 9 November 2026 in the primary source; the source of every row is linked in the tables.

  • Walters 2023: https://doi.org/10.1515/opis-2022-0158
  • Elkhatat 2023: https://doi.org/10.1007/s40979-023-00140-5
  • Perkins 2024: https://doi.org/10.1186/s41239-024-00487-w
  • RAID 2024 (Dugan et al.): https://doi.org/10.18653/v1/2024.acl-long.674
  • Jabarian and Imas 2025, NBER w34223: https://www.nber.org/papers/w34223
  • Van Vlasselaer 2026: https://doi.org/10.1007/s40979-026-00226-w
  • DAMAGE 2025: https://aclanthology.org/2025.genaidetect-1.9/
  • NIST AI 700-1 (2025): https://doi.org/10.6028/NIST.AI.700-1
  • Epoch AI 2026 data insight: https://epoch.ai/data-insights/ai-detectors-false-negatives
  • Kar 2024: https://doi.org/10.1177/02537176241247934
  • Alshammari and Rao 2025: https://arxiv.org/abs/2507.17944
  • Weber-Wulff 2023: https://doi.org/10.1007/s40979-023-00146-z
  • Sadasivan 2023: https://arxiv.org/abs/2303.11156
  • Krishna 2023: https://arxiv.org/abs/2303.13408
  • Pegoraro 2023: https://arxiv.org/abs/2304.01487
  • Ha and Passananti 2024: https://doi.org/10.1145/3658644.3670306
  • RAID image 2025: https://arxiv.org/abs/2506.03988

Revision log: 2026-11-09: page created from the sample and results tables of 7 study records and the study lists of 42 cards at index version 2026.11.7.

Related pages: Which AI detectors have the most false positive studies? GPTZero with 11 records, the GPT-2 Output Detector with 8, and every human-text figure the index holds for 15 text cards, Which AI detectors run in Canvas without Turnitin? The seven cards that name a Canvas integration of their own, how each connects, and what the plan costs, AI detector false negative rates, ranked and Questions about AI detectors, answered from the index.