rewirebio.iobenchmarks
Evidence claim

Where bioRxiv v3 and the published article print different numbers

Version difference of Median held-out perplexity by position class in Chr5:3,500,000-4,500,000

The positional perplexity sentence differs. bioRxiv v3 reports medians over the whole test chromosome for four classes: splice acceptors 1.03, splice donors 1.02, start codons 1.10, stop codons 2.81, against intergenic and intronic 3.14, all Mann-Whitney p-values < 10^-239. The published article reports medians over a 1 Mb region of the test chromosome containing 264 genes and 471 transcripts, and adds the three coding frames: splice donors 1.02, splice acceptors 1.03, start codons 1.08, CDS2 2.24, CDS1 2.44, CDS3 2.79, stop codons 2.8, against intergenic and intronic 3.24, all Mann-Whitney P-values < 10^-17. This is a different measurement region, not a corrected value. Every other printed value this batch records appears verbatim in both versions, asserted by extract/parse_values.py.

The one measurement whose printed values changed between the final preprint and the published article, recorded so the stored values are not read as a correction of the preprint.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

12 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Claimed field
version_difference
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (bioRxiv v3)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bioRxiv v3, posted 2023-08-04; publisher JATS source XML
Retrieved: 2026-11-16T00:37:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 4faeb24f27e8db7fd57f65f10e2885e9bea82f539b6acf37b356d2bd5864ef15

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Claimed field
version_difference
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Source location
bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (bioRxiv v3)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bioRxiv v3, posted 2023-08-04; publisher JATS source XML
Retrieved: 2026-11-16T00:37:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 4faeb24f27e8db7fd57f65f10e2885e9bea82f539b6acf37b356d2bd5864ef15

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Source location
bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Claimed value
The positional perplexity sentence differs. bioRxiv v3 reports medians over the whole test chromosome for four classes: splice acceptors 1.03, splice donors 1.02, start codons 1.10, stop codons 2.81, against intergenic and intronic 3.14, all Mann-Whitney p-values < 10^-239. The published article reports medians over a 1 Mb region of the test chromosome containing 264 genes and 471 transcripts, and adds the three coding frames: splice donors 1.02, splice acceptors 1.03, start codons 1.08, CDS2 2.24, CDS1 2.44, CDS3 2.79, stop codons 2.8, against intergenic and intronic 3.24, all Mann-Whitney P-values < 10^-17. This is a different measurement region, not a corrected value. Every other printed value this batch records appears verbatim in both versions, asserted by extract/parse_values.py.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (bioRxiv v3)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bioRxiv v3, posted 2023-08-04; publisher JATS source XML
Retrieved: 2026-11-16T00:37:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 4faeb24f27e8db7fd57f65f10e2885e9bea82f539b6acf37b356d2bd5864ef15

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Claimed value
The positional perplexity sentence differs. bioRxiv v3 reports medians over the whole test chromosome for four classes: splice acceptors 1.03, splice donors 1.02, start codons 1.10, stop codons 2.81, against intergenic and intronic 3.14, all Mann-Whitney p-values < 10^-239. The published article reports medians over a 1 Mb region of the test chromosome containing 264 genes and 471 transcripts, and adds the three coding frames: splice donors 1.02, splice acceptors 1.03, start codons 1.08, CDS2 2.24, CDS1 2.44, CDS3 2.79, stop codons 2.8, against intergenic and intronic 3.24, all Mann-Whitney P-values < 10^-17. This is a different measurement region, not a corrected value. Every other printed value this batch records appears verbatim in both versions, asserted by extract/parse_values.py.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Description
The one measurement whose printed values changed between the final preprint and the published article, recorded so the stored values are not read as a correction of the preprint.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (bioRxiv v3)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bioRxiv v3, posted 2023-08-04; publisher JATS source XML
Retrieved: 2026-11-16T00:37:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 4faeb24f27e8db7fd57f65f10e2885e9bea82f539b6acf37b356d2bd5864ef15

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Description
The one measurement whose printed values changed between the final preprint and the published article, recorded so the stored values are not read as a correction of the preprint.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Relationship: subject
gpn-paper-20261116-protocol-positional-perplexity-chr5-1mb
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (bioRxiv v3)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bioRxiv v3, posted 2023-08-04; publisher JATS source XML
Retrieved: 2026-11-16T00:37:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:gpn-paper-20261116-protocol-positional-perplexity-chr5-1mb

Source artifact SHA-256: 4faeb24f27e8db7fd57f65f10e2885e9bea82f539b6acf37b356d2bd5864ef15

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Relationship: subject
gpn-paper-20261116-protocol-positional-perplexity-chr5-1mb
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:gpn-paper-20261116-protocol-positional-perplexity-chr5-1mb

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: gpn-paper-20261116-claim-preprint-value-difference

areas
dna-genomes
contexts
research
field
version_difference
review
artifact sha256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0; method: independent-cell-check; automated-source-review; source-hash-verification; method note: Independent review pass by a different agent from the extractor, with its own script (review/recheck_values.py), which does not import extract/parse_values.py and does not read extract/values.json. The published article XML and the bioRxiv details API response were re-downloaded and matched their pinned hashes; the SI Appendix PDF was re-downloaded as the member of a freshly built Europe PMC zip (a third distinct zip hash, c7a1b20e8796c4bd384ba6f0308134e32a66e40dc881b0c1e3d0201da26e8498) and the PDF member matched. Every archived gz in artifacts/ decompresses to the hash its source record pins, and the text layer in extract/ regenerates byte for byte from the archived PDF with pdftotext -layout, poppler 26.08.0. npm run batch -- check-values reproduced the extractor's figures: 6 in_cell, 17 locator_not_parsed, no overclaimed_in_row. Each claim was read against its own source_locator in the re-retrieved artifacts. Two locators did not cover the whole claim and were corrected in this pass: the comparator bound claim now also names Materials and Methods, 'Variant Effect Prediction', where phyloP x LD, abs(phyloP) x LD, phastCons x LD and the baseline LD Score are defined, and the motif claim now also names Materials and Methods, 'Motif Analysis', where the 1,000 bp promoter window and the repeat and coding exon filter are printed. The central finding was confirmed independently: the whole JATS document holds zero table-wrap and zero table elements, and the SI Appendix figure pages print no comparator value in their text layer, only axis ticks, GPN score bin edges, threshold quantiles, method legends and the per-class variant counts of the Figure S9 subplot titles.; note: Checked against both pinned artifacts. The review confirmed with its own script that 'median = 1.10', 'median = 2.81', 'median = 3.14' and 'p -values < 10 -239' occur in the bioRxiv v3 body and not in the published body, that '264 genes', '471 transcripts', 'CDS1', 'CDS2' and 'CDS3' occur in the published body and not in v3, and that the twelve other printed strings this batch records occur verbatim in v3 as well. A measurement over a different region, so a version difference and not a correction.; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/fullTextXML; reviewed at: 2026-11-16T01:30:00Z; reviewer: claude; reviewer note: Claude review agent, independent of the extractor; no human review claimed. Transcription was checked against the pinned artifacts; nothing was reproduced and no value was recomputed.
source locator
bioRxiv v3 Results, sentence beginning "Across the test chromosome, model perplexities in splice acceptors"; published article Results, sentence beginning "Across a 1-Mb region in the test chromosome"
value
The positional perplexity sentence differs. bioRxiv v3 reports medians over the whole test chromosome for four classes: splice acceptors 1.03, splice donors 1.02, start codons 1.10, stop codons 2.81, against intergenic and intronic 3.14, all Mann-Whitney p-values < 10^-239. The published article reports medians over a 1 Mb region of the test chromosome containing 264 genes and 471 transcripts, and adds the three coding frames: splice donors 1.02, splice acceptors 1.03, start codons 1.08, CDS2 2.24, CDS1 2.44, CDS3 2.79, stop codons 2.8, against intergenic and intronic 3.24, all Mann-Whitney P-values < 10^-17. This is a different measurement region, not a corrected value. Every other printed value this batch records appears verbatim in both versions, asserted by extract/parse_values.py.
Related records

Suggest a correction