arXiv AI False Reference Sanction Explanation: Why papers and technical documents written with AI must be fixed at the source verification gate before submission

1. One-line problem definition

Key takeaway: The risk of AI writing is not that the sentences are awkward, but that plausible but non-existent reasons remain in the final document.

On May 18, 2026, AI Times reported that arXiv is introducing strong sanctions on papers that carelessly use large language models (LLM). The key is not to block the use of AI itself, but to take issue with submissions that have evidence that they were not verified by humans, such as false references, fake data, and chatbot meta phrases.

This problem is not just for researchers. Development blogs, technical proposals, government project documents, and product white papers also face the same trust risk if they use AI-recommended sources. The scope of this article is what verification procedures organizations drafting with AI should have in place before submission. It does not cover overall paper ethics or comparison of automated plagiarism determination tools.

2. First, conclusion

Key takeaway: This is not a conclusion to not use AI, but a conclusion that we need to separate the final gate that turns AI-generated sentences into human submissions.

Teams that draft documents using AI should adopt it right away. In particular, documents containing references, figures, tables, legal/medical/security claims, names of external organizations, and dates should not be left to the memory of the same person for the creation and verification stages.

Conversely, if it is a document that is not disclosed externally and is not used as a basis for decision-making, such as internal meeting memos, it may be an excessive procedure. However, for documents whose basis can be verified by a third party, such as public blogs, papers, proposals, and investment materials, a minimum source verification table is required.

3. Decomposition of core structure

Key takeaway: Creating secure AI documents is easy to understand by dividing it into four layers: generator, provenance ledger, verifier, and submission gate.

The first layer is the generator. Tools like ChatGPT, Claude, Gemini, and Perplexity create drafts, summaries, comparison tables, and bibliographies. The output of this layer is not yet a document, but materials.

The second layer is the provenance ledger. The ledger is a table of all external claims and links contained in the document. The minimum columns are claim, source title, URL, publication or confirmation date, and verification status.

The third layer is the verifier. The verifier clicks on the link suggested by AI and checks whether the paper title, author, year, and DOI are actually correct. If it is a development document, check that the official document version, release date, and API name are current.

The fourth layer is the submission gate. The submission gate is the final gate that can be made public only after passing conditions such as “100% verified references,” “Confirmed source of figures in table,” and “Complete AI meta phrase search.”

4. Description of design intent

Key takeaway: AI document verification is not a matter of trusting detectors, but making accountability traceable.

AI Detector is only an auxiliary tool. Determining whether a sentence appears to have been written by AI does not guarantee that the reference actually exists. This is why the arXiv case is important. The core of the sanction is not the AI ​​writing style, but clear traces that “the author did not review the results.”

So good design is not about hiding whether AI is used or not. Good design is about making it possible to trace back the facts that went into the document. If you leave a source ledger and submission checklist, even if a problem arises later, you can check who passed which claim and on what basis.

5. Evidence and Comparison

Key summary: The combination of “source ledger + sample revalidation + prohibited phrase search” is stronger in practice than “only running AI detector”.

Approach	Advantages	Limit	Recommendation status
Use AI detector only	Fast and easy to automate.	False references, incorrect DOIs, and actual numerical errors cannot be directly checked.	For assistance in checking draft quality
People read only the final version	You can see the context and logic.	In long documents, it is easy to miss each reference.	Short internal document
Source ledger-based verification	You can track claims and evidence line by line.	Increased writing time.	Papers, white papers, technical blogs, proposals
Auto search + manual click verification	Balances speed and reliability.	The final judgment must be made by a person.	Most public documents

According to the AI Times report, arXiv applies strong sanctions to papers with false references or traces of unverified AI. In a May 2026 report, The Next Web explained that fake references and chatbot-style residual text are typical signs of trouble. arXiv's official code of conduct also states that members of the research community must adhere to intellectual honesty and responsibility.

6. Actual operation flow / step-by-step execution method

Key takeaway: After creating a draft AI, authors must run a separate 20-minute validation process before publishing it.

1. At the drafting stage, the AI ​​is instructed to “separate reference candidates into a separate list, and do not include links in the text before confirmation.”
2. Only external claims are extracted from the document. Examples: “arXiv imposes a one-year submission ban”, “Fake references have increased”, “Certain organizations have announced policies”.
3. Create a source ledger. Columns claim, source_title, url, date, verified, note are sufficient.
4. Open each URL directly and check whether the title, date, author, and key sentences match the main text claims.
5. Article references are checked for presence in at least one of the following: DOI, arXiv ID, PubMed, DBLP, or Google Scholar.
6. Before final submission, search for the following search terms in the original file: as an AI language model, would you like, fill in, placeholder, insert here, TODO, example data.
7. Only verified sources are included in the text references section.

#Find common AI residual phrases in LaTeX/Markdown documents
rg -n -i "as an ai language model|would you like|fill in|placeholder|insert here|todo|example data" paper.tex notes.md

#Quickly view missing DOI candidates in your bibliography file
rg -n "doi\s*=|url\s*=|arxiv" references.bib

7. Mistake/Trap

Key takeaway: The most dangerous mistake is when AI-generated references are so plausible that humans don't suspect them.

Trap 1: If only the title and author look correct, let it pass

AI can create fake citations by mixing real author names with plausible paper titles. To prevent this, you must check the DOI or the original page. Recovery is simple. Delete unconfirmed citations and find new actual sources supporting the same claim.

Trap 2: Make tables and figures as “examples” and then leave them as is

Although AI-generated tables look good, they may not be actual data. To prevent this, add a source line to each table. To recover, recalculate all figures based on the raw data or remove unverifiable tables.

Trap 3: Only view the final PDF and do not search the original file

In PDF, you can miss comments, hidden text, and directives left in LaTeX comments. To prevent this, search for the original .tex, .bib, and .md files. Recovery involves re-examining the build output and the original before submission.

8. Strengths and Limitations

Key takeaway: Verification gates increase trust, but slow down writing some.

Strengths are clear. The quality of evidence in public documents increases, and even if team members change, which sources you have verified remain. In particular, trust is more important than search traffic for technology blogs and white papers, so this method is advantageous in the long run.

There is also a limit. Attaching a source to every sentence can slow down your writing and make it difficult for readers to read. So it is realistic to apply verification gates only to external facts, figures, policies, comparative claims, and risk warnings, and not to all sentences.

Sometimes other choices are better. For a quick idea memo or personal study note, a simple link to the source is sufficient. Conversely, fields where the cost of errors is high, such as law, medicine, finance, and security, require not only source verification but also expert review.

9. Points to study more deeply

Key takeaway: AI document verification requires a combination of citation management, research ethics, and automated search.

• Citation Management: Understand the differences between Zotero, BibTeX, DOI, and arXiv IDs.
• Research ethics: Make it a team rule that authors are responsible for the final document.
• Automated search: rg, CI, pre-commit hook to filter out banned phrases and unverified links.
• Source priority: official documents, original papers, institutional announcements, and reliable reports.
• Version management: Keep document drafts, verification tables, and final versions in the same repository for traceability.

10. Action Checklist + Author's Perspective

Key takeaway: If you release an AI document, the completion criteria should be “verified” rather than “created”.

• Have all external claims and figures in the text been transferred to the source ledger?
• Have you directly checked the title, author, year, DOI, or original URL of the reference?
• Have you checked whether the tables, figures, and figures come from actual data?
• Have you retrieved AI meta phrases and placeholders from the original file?
• Did you leave the publication date or confirmation date of the source?
• Are the final document and the source ledger kept in the same version?
• Have claims with high costs of error been reviewed by experts or staff?

Definition of Done: All external claims and references remaining in the public document have been verified to clickable original text or identifiers, and the AI remaining phrase search is complete if there are 0 results.

My point of view is clear. Teams that create AI drafts quickly but operate strict verification gates before submission will last longer than teams that ban AI writing tools. However, applying this procedure to all notes will only increase fatigue. It is correct to apply it starting from documents with openness and error costs.

Reference material

• AI Times, “If you leave traces of AI, you will be kicked out for one year”… Archive, introduction of ‘one strike’ for defective papers, 2026-05-18
• The Next Web, arXiv to ban researchers over AI slop in preprints, 2026-05
• arXiv Code of Conduct, Ethics and Responsibility
• arXiv Submit TeX/LaTeX Help