AI Writing Check (AIWritingCheck.org)
Vendor Quill.org (Empirical Resolution Inc.) and CommonLit Official site aiwritingcheck.org How this card is sourced
AI Writing Check was one of the seven detectors whose average false positive rate on 91 human-written TOEFL essays was 61.22% in Liang 2023, against 5.19% on 88 essays by US eighth-graders, tested on March 15, 2023 under the name "Quil.org (aiwritingcheck.org)" (arXiv 2304.02819v3, read 8 November 2026). The tool was a free service of two nonprofits, Quill.org, the trading name of Empirical Resolution Inc., and CommonLit, and the vendor's own page put a number on it before any study did: "We estimate, based on testing with 15k essays, that this tool is accurate 80-90% of the time" (archived home page, captured 17 July 2023, read 10 November 2026). The card holds a place in the detector index as a withdrawn tool: the live page reads "August 2023 Update - AI Writing Check is no longer available" and explains "we have taken down AI Writing Check because the new versions of Generative AI tools are too sophisticated for detection by AI" (aiwritingcheck.org, read 10 November 2026). The Wayback capture of 17 July 2023 shows the working tool and the capture of 12 September 2023 the notice. How this card is sourced applies the same fourteen fields to a withdrawn tool as to a live one.
What AI Writing Check detected
| Field | Value | Source |
|---|---|---|
| Content types detected | Text | web.archive.org/web/20230717120414/https:... |
| Generators covered | ChatGPT (to enable educators to check if a piece of writing submitted by a student was written by the AI tool ChatGPT; the notice adds that the hosted algorithm was created by OpenAI) | web.archive.org/web/20230717120414/https:... |
| Input limits | Paste-only web tool with no account (archived 17 July 2023): Enter text here, with counters reading 100 Minimum words required, Current words and 400 Max words; To check responses longer than 400 words, you must separate the text into individual sections. Verdicts were AI Prediction: Text Written by Human or Text Written by AI. This free tool has no guaranteed uptime or support. It may not be available when there is heavy demand [...] The system processes one text every two seconds. No file upload and no API. Withdrawn: the notice has stood since the capture of 12 September 2023. | web.archive.org/web/20230717120414/https:... |
| Free tier | Free with no account and no stated quota: A free service provided by the nonprofit organizations and This free, nonprofit service is powered by donations (archived 17 July 2023); 100 to 400 words per check. Taken down in August 2023, so no free tier is available at the read date | web.archive.org/web/20230717120414/https:... |
| Data retention | The tool linked the Quill.org Privacy Policy (Effective June 26th, 2025, read 10 November 2026): Our practice is to retain your personal data only for as long as necessary to provide our services to you, including maintaining your account on Quill.org. [...] Our retention periods will vary depending on the type of data involved. The policy governs Quill.org accounts and student data and states nothing about text pasted into AI Writing Check and no period; the archived tool page carried no retention statement of its own. | quill.org/privacy |
| Launch year | 2023 | aiwritingcheck.org |
| Ownership | AIWritingCheck.org is provided by the 501(c)3 nonprofit Empirical Resolution Inc. (Quill.org) and built with support from CommonLit (site footer, © 2025 Empirical Resolution Inc., read 10 November 2026); the page linked the Quill.org Terms and Privacy. The live page's notice: When we launched this tool in January 2023, the only Generative AI tool available was ChatGPT. Status: the live page (read 10 November 2026) reads August 2023 Update - AI Writing Check is no longer available [...] we have taken down AI Writing Check because the new versions of Generative AI tools are too sophisticated for detection by AI [...] We were hosting the algorthim created by OpenAI, and we are now taking this algorthim down as well. The Wayback capture of 17 July 2023 shows the working tool and the capture of 12 September 2023 the notice. Liang 2023 tested the tool as Quil.org (aiwritingcheck.org) on March 15, 2023. | aiwritingcheck.org |
| Independent studies | 1 record | Studies index |
The page named its target in its first sentence: "AI Writing Check is a free service developed by Quill.org and CommonLit.org to enable educators to check if a piece of writing submitted by a student was written by the AI tool ChatGPT" (archived home page, captured 17 July 2023, read 10 November 2026). ChatGPT is the only generator named, so the generator count is one. The withdrawal notice names the engine: "We were hosting the algorthim created by OpenAI, and we are now taking this algorthim down as well", after noting that "OpenAI has taken down their algorthim" (aiwritingcheck.org, read 10 November 2026). The notice's link on that sentence goes to a TechCrunch report of 25 July 2023 on OpenAI's classifier, so the hosted model was OpenAI's, the same lineage as the GPT-2 Output Detector, which Liang 2023 tested in the same run at its Hugging Face address.
The verdict was binary. The result panel read "AI Prediction: Text Written by Human" or "AI Prediction: Text Written by AI", each followed by "Three Important Things to Know", the first of which was "This tool is not perfectly accurate - it will misidentify some pieces of writing" (archived home page, 17 July 2023). The page called itself "a stopgap tool measure for educators to use this school year until more advanced AI detection tools are made widely available", and the notice dates the launch: "When we launched this tool in January 2023, the only Generative AI tool available was ChatGPT" (aiwritingcheck.org, read 10 November 2026). No language was stated. The nearest cards are the GPT-2 Output Detector, tested beside it in Liang 2023, and Check For AI, the other free nonprofit detector of 2023 that was sunset the same summer.
Limits and plans
Input was paste only with no account, and the box set two hard figures. Its counters read "100 Minimum words required", "Current words" and "400 Max words", and the page added: "To check responses longer than 400 words, you must separate the text into individual sections" (archived home page, captured 17 July 2023, read 10 November 2026). The card records 100 words as the minimum, 550 characters at the index's 5.5 characters a word, in the minimum input ranking, and 400 words, 2,200 characters, as the maximum in the input limits ranking. The queue was explained too: "This free tool has no guaranteed uptime or support. It may not be available when there is heavy demand" and "The system processes one text every two seconds, meaning that it can take minutes when there is heavy demand." No file upload, no API and no daily figure was published.
The tool sold nothing. "A free service provided by the nonprofit organizations" headed the page, and the footer read "This free, nonprofit service is powered by donations" (archived home page, 17 July 2023, read 10 November 2026), so the card carries no plan table and no free-words figure and sits in the second table of the free tiers ranking. The page linked the Quill.org Terms and Privacy rather than policies of its own. The Quill.org Privacy Policy, effective June 26th, 2025, states: "Our practice is to retain your personal data only for as long as necessary to provide our services to you, including maintaining your account on Quill.org [...] Our retention periods will vary depending on the type of data involved" (quill.org/privacy, read 10 November 2026). It governs Quill.org accounts and student data and says nothing about text pasted into AI Writing Check, so the retention rank field is empty and the clause is quoted in the unranked table of the data retention ranking.
What the vendor claims
Archived page (17 July 2023, unchanged from 25 January 2023): This algorithm is designed to detect AI-generated writing. We estimate, based on testing with 15k essays, that this tool is accurate 80-90% of the time. For this reason, we'd like to encourage teachers to exercise caution when using this tool to detect academic dishonesty. Result panel: This tool is accurate about 80% to 90% of the time, meaning that one or two of every ten pieces of writing that were flagged as AI written will actually be written by a human. No dataset beyond the 15k essays figure is published.
What independent studies found
- AIDI-S-0002Liang 20232023
Listed as Quil.org (aiwritingcheck.org), one of seven detectors accessed on March 15, 2023. Across the seven, the paper reports an average false positive rate of 61.22% on 91 human-written TOEFL essays and 5.19% on 88 US 8th-grade essays; 18 of the 91 TOEFL essays (19.78%) were flagged by all seven detectors. Per-detector rates appear only in a bar chart (Fig. 1a) and are not stated as numbers.
One record in the studies index tested the tool. Liang 2023 accessed seven detectors on March 15, 2023, listing the second as "Quil.org (aiwritingcheck.org)", and ran 91 human-written TOEFL essays and 88 US eighth-grade essays through all of them. Across the seven it reports an average false positive rate of 61.22% on the TOEFL essays and 5.19% on the US essays; 18 of the 91 TOEFL essays (19.78%) were flagged by all seven detectors at once and 89 of 91 (97.80%) by at least one; after a prompt asking ChatGPT to enhance the word choices, the TOEFL average fell to 11.77% (arXiv 2304.02819v3, read 8 November 2026). Per-detector rates appear only as a bar chart and are not printed as numbers, so the card carries the averages with their bases, as every card tested in Liang 2023 does.
The fields follow the index rules. The false positive value stays empty because no count is attributed to the tool, and the vendor's "one or two of every ten" is a description of its own estimate, not a measurement. The record counts as the card's one non-English record, because the 91 TOEFL essays were written in English by non-native writers, the class the languages evidence ranking tracks. No record attacked the tool, so the robustness field is empty, though Liang 2023's self-edit prompt cut detection on 31 college essays from 100% to 13% across the seven detectors as a group (arXiv 2304.02819v3, read 8 November 2026), the pattern the vendor's own page had predicted in January.
Where AI Writing Check appears in the index
Rankings
- AIDI-R-01AI detectors ranked by independent testing Two records added in the fifth wave on 9 November 2026, Pegoraro 2023 and Fleckenstein 2024, changed nine counts and none: Pegoraro 2023 tested ZeroGPT, GPTZero, Copyleaks, Originality.ai, Writer, Content at Scale (BrandWell), DetectGPT, the GPT-2 Output Detector and GLTR, lifting GPTZero to 12, the GPT-2 Output Detector to 10, Copyleaks to 7 and Originality.ai and ZeroGPT to 6; Fleckenstein 2024 tested 289 teachers and no software, so it counts for no card ([Fleckenstein 2024 record](/studies/fleckenstein-2024-teachers/)). Illuminarty, one of four cards added in the same wave, joined with its one image record from Ha and Passananti 2024, so 18 of 72 cards now qualify.
- AIDI-R-05AI detectors ranked by maximum input per check
- AIDI-R-13AI detectors ranked by minimum text length per check
- AIDI-R-17AI detectors ranked by the generator models the vendor names
- AIDI-R-18AI detectors ranked by study records on non-English and non-native text
- AIDI-R-20AI detectors ranked by launch year, with every change of hands and withdrawal the cards record
Fits these use cases, questions and comparisons
AI Writing Check ranks on one study record in independently tested detectors, at one record in languages evidence for the TOEFL class of Liang 2023, at 550 characters in the minimum input ranking and at 2,200 characters in the input limits ranking, each read in the data file on 10 November 2026. It appears on which AI detectors were shut down, where its August 2023 notice is quoted with the captures that bracket it. It does not appear in the false positive, free tier, language, retention or claim gap rankings, because the record prints no per-tool count and the vendor stated no quota, no language, no period and no single accuracy figure.
Every detector card on the register shows AI Writing Check with the same fields as the live tools, so a teacher who kept a 2023 "Text Written by AI" verdict can see what the one study measured across the seven tools it belonged to, and what the vendor said about its own error rate before taking the tool down.
Questions about AI Writing Check
Is AI Writing Check still available?
No. The live page reads "August 2023 Update - AI Writing Check is no longer available", the Wayback capture of 17 July 2023 shows the working tool and the capture of 12 September 2023 the notice, read 10 November 2026.
How accurate was AI Writing Check?
The vendor estimated "accurate 80-90% of the time" from testing on 15k essays, read in the archived page of 17 July 2023 on 10 November 2026; Liang 2023 prints no per-detector accuracy, only a 61.22% average false positive rate across seven detectors on 91 TOEFL essays, read 8 November 2026.
What did Liang 2023 find for AI Writing Check?
Liang 2023 lists it as "Quil.org (aiwritingcheck.org)" among seven detectors with an average false positive rate of 61.22% on 91 TOEFL essays and 5.19% on 88 US eighth-grade essays, with per-detector rates shown only in a chart, read 8 November 2026.
How much text did AI Writing Check accept?
Between 100 and 400 words per check: the counters read "100 Minimum words required" and "400 Max words", and longer responses had to be split into sections, per the archived page of 17 July 2023 read 10 November 2026.
Who made AI Writing Check?
Quill.org, the 501(c)3 nonprofit Empirical Resolution Inc., with support from CommonLit, per the site footer read 10 November 2026; the tool hosted an algorithm created by OpenAI and launched in January 2023, per the vendor's notice.
Sources and revisions
Sources
- aiwritingcheck.orgRead 10 November 2026
- web.archive.org/web/20230717120414/https:...Read 10 November 2026
- web.archive.org/web/20230125140052/https:...Read 10 November 2026
- web.archive.org/web/20230912032623/https:...Read 10 November 2026
- web.archive.org/cdx/search/cdxRead 10 November 2026
- quill.org/privacyRead 10 November 2026
- arxiv.org/pdf/2304.02819v3Read 8 November 2026
Revision log
- Card created2026-11-10: merge ruling (page-map 1r): the no-account flag is not set for a withdrawn tool (the writer treatment)



). Illuminarty, one of four cards added in the same wave, joined with its one image record from Ha and Passananti 2024, so 18 of 72 cards now qualify.: register plate](/img/independently-tested-480.webp)
