rewirebio.iobenchmarks
Evidence claim

The GPN paper evaluates Arabidopsis thaliana only

Evaluation scope of GPN

Every evaluation in this paper is in Arabidopsis thaliana: held-out sequence modelling, gene region classification from embeddings, in silico mutagenesis, 1001 Genomes rare against common enrichment and AraGWAS hit enrichment. The paper reports no human variant effect results, and no human model is trained or scored in it. Its stated motivation is that a model trained on DNA sequence alone can be applied to understudied non-model organisms.

What the GPN paper covers, recorded because the model family also carries results on human variants from other groups' benchmarks.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

6 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Claimed field
evaluation_scope
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Source location
Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Claimed value
Every evaluation in this paper is in Arabidopsis thaliana: held-out sequence modelling, gene region classification from embeddings, in silico mutagenesis, 1001 Genomes rare against common enrichment and AraGWAS hit enrichment. The paper reports no human variant effect results, and no human model is trained or scored in it. Its stated motivation is that a model trained on DNA sequence alone can be applied to understudied non-model organisms.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Description
What the GPN paper covers, recorded because the model family also carries results on human variants from other groups' benchmarks.
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Relationship: subject
regulatory-variant-20261009-model-gpn
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:regulatory-variant-20261009-model-gpn

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Name
The GPN paper evaluates Arabidopsis thaliana only
Context-only references
DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023)

Original source ↗

Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"

Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914
Retrieved: 2026-11-16T00:29:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: name

Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0

Hash scope: Hash scope not separately documented; inspect source record

Format: JATS XML

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: gpn-paper-20261116-claim-species-scope

areas
dna-genomes
contexts
research
field
evaluation_scope
review
artifact sha256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0; method: automated-source-review; source-hash-verification; method note: Independent review pass by a different agent from the extractor, with its own script (review/recheck_values.py), which does not import extract/parse_values.py and does not read extract/values.json. The published article XML and the bioRxiv details API response were re-downloaded and matched their pinned hashes; the SI Appendix PDF was re-downloaded as the member of a freshly built Europe PMC zip (a third distinct zip hash, c7a1b20e8796c4bd384ba6f0308134e32a66e40dc881b0c1e3d0201da26e8498) and the PDF member matched. Every archived gz in artifacts/ decompresses to the hash its source record pins, and the text layer in extract/ regenerates byte for byte from the archived PDF with pdftotext -layout, poppler 26.08.0. npm run batch -- check-values reproduced the extractor's figures: 6 in_cell, 17 locator_not_parsed, no overclaimed_in_row. Each claim was read against its own source_locator in the re-retrieved artifacts. Two locators did not cover the whole claim and were corrected in this pass: the comparator bound claim now also names Materials and Methods, 'Variant Effect Prediction', where phyloP x LD, abs(phyloP) x LD, phastCons x LD and the baseline LD Score are defined, and the motif claim now also names Materials and Methods, 'Motif Analysis', where the 1,000 bp promoter window and the repeat and coding exon filter are printed. The central finding was confirmed independently: the whole JATS document holds zero table-wrap and zero table elements, and the SI Appendix figure pages print no comparator value in their text layer, only axis ticks, GPN score bin edges, threshold quantiles, method legends and the per-class variant counts of the Figure S9 subplot titles.; note: Confirmed by reading the whole article body: every evaluation is in Arabidopsis thaliana and no human variant is scored anywhere in it. Worth keeping, because the stored GPN family record carries human results from other groups.; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/fullTextXML; reviewed at: 2026-11-16T01:30:00Z; reviewer: claude; reviewer note: Claude review agent, independent of the extractor; no human review claimed. Transcription was checked against the pinned artifacts; nothing was reproduced and no value was recomputed.
source locator
Abstract; Results; Discussion, paragraph beginning "Here, we present an unsupervised genome-wide variant effect predictor"
value
Every evaluation in this paper is in Arabidopsis thaliana: held-out sequence modelling, gene region classification from embeddings, in silico mutagenesis, 1001 Genomes rare against common enrichment and AraGWAS hit enrichment. The paper reports no human variant effect results, and no human model is trained or scored in it. Its stated motivation is that a model trained on DNA sequence alone can be applied to understudied non-model organisms.
Related records

Suggest a correction