rewirebio.iobenchmarks
Evidence claim

The GPN paper's model comparisons are printed only as figures

Extraction gap of GPN paper: unsupervised variant effect prediction in Arabidopsis thaliana

Every comparison of GPN against phyloP, phastCons, abs(phyloP), LD Score and their LD-weighted forms is printed as a bar chart with no values in the text layer: Figures 5D, 6D and 6E of the article and Figures S6, S8, S9, S10, S11 and S12 of the SI Appendix. The same is true of the contingency tables drawn in Figures 5C and 6C and of the confusion matrix in Figure 2B. The published article contains no table at all; the SI Appendix contains three, of which only Table S2 holds results. The comparator values are therefore a gap, not a finding.

Why this batch holds no comparator value from the paper, recorded as a scope limit on the benchmark rather than as an absence of evidence.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

12 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Claimed field
extraction_gap
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Claimed field
extraction_gap
Context-only references
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Source location
Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Source location
Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12
Context-only references
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Claimed value
Every comparison of GPN against phyloP, phastCons, abs(phyloP), LD Score and their LD-weighted forms is printed as a bar chart with no values in the text layer: Figures 5D, 6D and 6E of the article and Figures S6, S8, S9, S10, S11 and S12 of the SI Appendix. The same is true of the contingency tables drawn in Figures 5C and 6C and of the confusion matrix in Figure 2B. The published article contains no table at all; the SI Appendix contains three, of which only Table S2 holds results. The comparator values are therefore a gap, not a finding.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Claimed value
Every comparison of GPN against phyloP, phastCons, abs(phyloP), LD Score and their LD-weighted forms is printed as a bar chart with no values in the text layer: Figures 5D, 6D and 6E of the article and Figures S6, S8, S9, S10, S11 and S12 of the SI Appendix. The same is true of the contingency tables drawn in Figures 5C and 6C and of the confusion matrix in Figure 2B. The published article contains no table at all; the SI Appendix contains three, of which only Table S2 holds results. The comparator values are therefore a gap, not a finding.
Context-only references
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Description
Why this batch holds no comparator value from the paper, recorded as a scope limit on the benchmark rather than as an absence of evidence.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Description
Why this batch holds no comparator value from the paper, recorded as a scope limit on the benchmark rather than as an absence of evidence.
Context-only references
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Relationship: subject
gpn-paper-20261116-benchmark-athaliana-variant-effect
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:gpn-paper-20261116-benchmark-athaliana-variant-effect

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Relationship: subject
gpn-paper-20261116-benchmark-athaliana-variant-effect
Context-only references
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:gpn-paper-20261116-benchmark-athaliana-variant-effect

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: gpn-paper-20261116-claim-figure-only-comparisons

areas
dna-genomes
contexts
research
field
extraction_gap
review
artifact sha256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0; method: automated-source-review; source-hash-verification; method note: Independent review pass by a different agent from the extractor, with its own script (review/recheck_values.py), which does not import extract/parse_values.py and does not read extract/values.json. The published article XML and the bioRxiv details API response were re-downloaded and matched their pinned hashes; the SI Appendix PDF was re-downloaded as the member of a freshly built Europe PMC zip (a third distinct zip hash, c7a1b20e8796c4bd384ba6f0308134e32a66e40dc881b0c1e3d0201da26e8498) and the PDF member matched. Every archived gz in artifacts/ decompresses to the hash its source record pins, and the text layer in extract/ regenerates byte for byte from the archived PDF with pdftotext -layout, poppler 26.08.0. npm run batch -- check-values reproduced the extractor's figures: 6 in_cell, 17 locator_not_parsed, no overclaimed_in_row. Each claim was read against its own source_locator in the re-retrieved artifacts. Two locators did not cover the whole claim and were corrected in this pass: the comparator bound claim now also names Materials and Methods, 'Variant Effect Prediction', where phyloP x LD, abs(phyloP) x LD, phastCons x LD and the baseline LD Score are defined, and the motif claim now also names Materials and Methods, 'Motif Analysis', where the 1,000 bp promoter window and the repeat and coding exon filter are printed. The central finding was confirmed independently: the whole JATS document holds zero table-wrap and zero table elements, and the SI Appendix figure pages print no comparator value in their text layer, only axis ticks, GPN score bin edges, threshold quantiles, method legends and the per-class variant counts of the Figure S9 subplot titles.; note: Confirmed independently. The whole JATS document, parsed with xml.etree, holds zero table-wrap and zero table elements, and the SI Appendix figure pages print no comparator value in their text layer. The only values there are axis ticks, the GPN score bin edges of the Figure S7 legend, threshold quantiles, the method legends of Figures S11 and S12 and the per-class rare and common counts in the Figure S9 subplot titles. No comparator value the extractor missed was found.; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/fullTextXML; reviewed at: 2026-11-16T01:30:00Z; reviewer: claude; reviewer note: Claude review agent, independent of the extractor; no human review claimed. Transcription was checked against the pinned artifacts; nothing was reproduced and no value was recomputed.
source locator
Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12
value
Every comparison of GPN against phyloP, phastCons, abs(phyloP), LD Score and their LD-weighted forms is printed as a bar chart with no values in the text layer: Figures 5D, 6D and 6E of the article and Figures S6, S8, S9, S10, S11 and S12 of the SI Appendix. The same is true of the contingency tables drawn in Figures 5C and 6C and of the confusion matrix in Figure 2B. The published article contains no table at all; the SI Appendix contains three, of which only Table S2 holds results. The comparator values are therefore a gap, not a finding.
Related records

Suggest a correction