Metamorphic testing of Datalog engines

Muhammad Numair Mansur, M. Christakis, Valentin Wüstholz. 2021. ESEC/SIGSOFT FSE.

Read the paper · doi:10.1145/3468264.3468573

What this paper does with SQLancer

SQLancer is named directly as the relational precedent: the paper notes that Rigger and Su proposed a series of testing techniques implemented in a tool called SQLancer. That places this work in the same line -- metamorphic relations over a declarative query language -- while the relations themselves are Datalog-specific and are the paper's own. This paper applies metamorphic testing to Datalog engines, constructing rule transformations whose effect on the derived facts is predictable, so that a disagreement identifies a bug in the engine's evaluation. Datalog's declarative semantics make it amenable to the same style of reasoning that works for SQL. Written by claude-opus-5 from the 1 place this paper refers to SQLancer. The quotations below are the paper's own words, stored verbatim when the text was extracted.

How it was classified

uses infrastructure — no

SQLancer is cited as related work; no reuse of its code, generator or workload is described.

extends technique — no

No SQLancer technique is extended; the citation is background.

compares with — no

No empirical comparison against SQLancer or one of its oracles is reported.

describes as state of the art — no

The text does not describe SQLancer as the state of the art.

SQLancer publications it cites (3)

Bibliography entries that resolved to a SQLancer publication, or to a paper by one of the project's authors. A sentence citing one of these numbers is a reference to SQLancer even when it never writes the name.

#	Entry	Matched as
55	Manuel Rigger and Zhendong Su. 2020. Detecting Optimization Bugs in Database Engines via Non-Optimizing Reference Engine Construction. In ESEC/FSE. ACM, 1140–1152.	sqlancer publication · NOREC
56	Manuel Rigger and Zhendong Su. 2020. Finding Bugs in Database Systems via Query Partitioning. PACMPL 4 (2020), 211:1–211:30. Issue OOPSLA.	sqlancer publication · TLP
57	Manuel Rigger and Zhendong Su. 2020. Testing Database Engines via Pivoted Query Synthesis. In OSDI. USENIX, 667–682.	sqlancer publication · PQS

Every place it refers to SQLancer (1)

1 sentence, each stored verbatim from the extracted text with where it was found and how. “Citation marker” means the sentence names no tool at all and was reached through a reference number that resolved to a SQLancer publication.

Id	Sentence	Found by	Where
M1	Recently, Rigger and Su proposed a series of testing techniques [ 55– 57], which they implemented in a tool called SQLancer.	name definition	8 RELATED WORK page 11

This page is rendered from _data/papers/paper_doi_10_1145_3468264_3468573.json, extracted from supplied pdf. 12 pages, 80 references parsed.