Code Generation by Differential Test Time Scaling

Yifeng He, Ethan Wang, Jicheng Wang, Xuanxin Ouyang, Hao Chen. 2026. arXiv.org.

Read the paper · arXiv:2605.20473

What this paper does with SQLancer

Two citations, listing database systems among the domains where differential testing has proven effective where formal specifications are unavailable. DiffCodeGen is a test-time scaling method for code generation that selects among candidate programs without extra model calls. It samples diverse candidates, uses coverage-guided fuzzing to synthesise inputs without needing existing tests, executes every candidate on those inputs, clusters them by behavioural similarity, and returns the medoid of the largest cluster. Across four models it reports competitive or better results than other test-time scaling methods at a fraction of the cost. Written by claude-opus-5 from the 2 places this paper refers to SQLancer. The quotations below are the paper's own words, stored verbatim when the text was extracted.

How it was classified

uses infrastructure — no

SQLancer is cited, not used; nothing in the mentions describes reusing its code.

extends technique — no

No technique is extended; the citation is background.

compares with — no

No empirical comparison against SQLancer is reported in the mentions.

describes as state of the art — no

The citation does not characterise SQLancer as the state of the art.

SQLancer publications it cites (1)

Bibliography entries that resolved to a SQLancer publication, or to a paper by one of the project's authors. A sentence citing one of these numbers is a reference to SQLancer even when it never writes the name.

#	Entry	Matched as
19	Manuel Rigger and Zhendong Su. “Testing Database Engines via Pivoted Query Synthesis”. In:Proc. ACM Program. Lang. 4.OOPSLA (Nov. 2020).DOI:10.1145/3428279.URL:https://doi.org/10.1145/3428279.	sqlancer publication · PQS

Every place it refers to SQLancer (2)

2 sentences, each stored verbatim from the extracted text with where it was found and how. “Citation marker” means the sentence names no tool at all and was reached through a reference number that resolved to a SQLancer publication.

Id	Sentence	Found by	Where
M1	This technique has proven highly effective for testing compilers [16–18], database systems [19], and other systems where formal specifications or programmer-provided test oracles are either unavailable or impractical to use.	citation marker background	2.1.1 Differential testing page 3
M2	Much research has applied differential testing with such assumptions to complex software systems like compilers and databases [13, 16, 19, 25], 6 Related work 6.	citation marker background	5.2 Limitations and future work page 15

This page is rendered from _data/papers/paper_arxiv_2605_20473.json, extracted from arxiv. 21 pages, 96 references parsed.