rewirebio.iobenchmarks
Source

SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22 · Peer-reviewed

DOI: 10.1073/pnas.2311219120Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
GPN trained on eight Brassicales genomes, repeat loss weight 0 (PNAS 2023)Perplexity (masked nucleotide prediction, chromosome-wide on the held-out test chromosome)3.03 unitlessArabidopsis thaliana chromosome 5, held out for testingTest perplexity, chromosome-wide, GPN with repeat weight 0 (PNAS 2023 Table S2)
GPN trained on eight Brassicales genomes, repeat loss weight 0.1 (PNAS 2023)Perplexity (masked nucleotide prediction, chromosome-wide on the held-out test chromosome)2.90 unitlessArabidopsis thaliana chromosome 5, held out for testingTest perplexity, chromosome-wide, GPN with repeat weight 0.1 (PNAS 2023 Table S2)
GPN trained on eight Brassicales genomes, repeat loss weight 1 (PNAS 2023)Perplexity (masked nucleotide prediction, chromosome-wide on the held-out test chromosome)2.88 unitlessArabidopsis thaliana chromosome 5, held out for testingTest perplexity, chromosome-wide, GPN with repeat weight 1 (PNAS 2023 Table S2)
GPN trained on eight Brassicales genomes, repeat loss weight 0 (PNAS 2023)Perplexity (masked nucleotide prediction, over non-repeat regions on the held-out test chromosome)2.92 unitlessNon-repeat regions of Arabidopsis thaliana chromosome 5Test perplexity, non-repeat, GPN with repeat weight 0 (PNAS 2023 Table S2)
GPN trained on eight Brassicales genomes, repeat loss weight 0.1 (PNAS 2023)Perplexity (masked nucleotide prediction, over non-repeat regions on the held-out test chromosome)2.92 unitlessNon-repeat regions of Arabidopsis thaliana chromosome 5Test perplexity, non-repeat, GPN with repeat weight 0.1 (PNAS 2023 Table S2)
GPN trained on eight Brassicales genomes, repeat loss weight 1 (PNAS 2023)Perplexity (masked nucleotide prediction, over non-repeat regions on the held-out test chromosome)2.99 unitlessNon-repeat regions of Arabidopsis thaliana chromosome 5Test perplexity, non-repeat, GPN with repeat weight 1 (PNAS 2023 Table S2)

Claims

Statements this source supports, each with where in the source it was checked.

  • GPN architecture as published in the PNAS paper: Architecture Masked language model over single-nucleotide tokens, not k-mers or byte-pair encoding. A 512 bp window is one-hot encoded and processed by 25 convolutional blocks, each a dilated convolution followed by a feed-forward layer with residual connections and layer normalisation, at a fixed embedding dimension of 512 and kernel size 9, with the dilation increased exponentially and then cycled. A final layer outputs four nucleotide probabilities at each masked position. Implemented with the Hugging Face library. (Figure 1 caption; Materials and Methods, 'Pretraining'; SI Appendix Table S3)
  • GPN pretraining corpus and held-out chromosomes: Training data Eight RefSeq-annotated Brassicales reference genomes, one per genus, filtered from NCBI Genome: Arabidopsis thaliana, Brassica rapa, Camelina sativa, Capsella rubella, Carica papaya, Eutrema salsugineum, Raphanus sativus and Tarenaya hassleriana. Arabidopsis thaliana chromosomes 4 and 5 were held out for validation and testing. Windows of 512 bp at a step of 256 bp were sampled with the reverse complement, drawn from exons with a small intronic flank, promoters 1,000 bp upstream of transcription start sites and an equivalent amount of random windows, with each genome subset to the number of windows from Arabidopsis. (SI Appendix Table S1; Materials and Methods, 'Pretraining')
  • Promoter motifs recovered by TF-MoDISco on GPN predictions: Motif analysis Approximately a hundred and sixty motifs were identified in regions 1,000 bp either side of transcription start sites, after filtering repeats and coding exons. Four are shown in Figure 3B, the first two with a significant match in PlantTFDB at a Tomtom q-value below 0.05. (Results, 'DNA Motifs Revealed by High-Confidence Model Predictions'; Figure 3 B caption; SI Appendix Figure S5; Materials and Methods, 'Motif Analysis', sentence beginning "An adaptation of TF-MoDISco was run", for the 1,000 bp promoter window and the repeat and coding exon filter)
  • The GPN paper's model comparisons are printed only as figures: Extraction gap Every comparison of GPN against phyloP, phastCons, abs(phyloP), LD Score and their LD-weighted forms is printed as a bar chart with no values in the text layer: Figures 5D, 6D and 6E of the article and Figures S6, S8, S9, S10, S11 and S12 of the SI Appendix. The same is true of the contingency tables drawn in Figures 5C and 6C and of the confusion matrix in Figure 2B. The published article contains no table at all; the SI Appendix contains three, of which only Table S2 holds results. The comparator values are therefore a gap, not a finding. (Figures 5 C, 5 D, 6 C, 6 D, 6 E and 2 B of the article; SI Appendix Figures S6, S8, S9, S10, S11 and S12)

Models, benchmarks and other records

Benchmarks (1)

Protocols (2)

Datasets (1)

Dataset subsets (2)

Evaluations (6)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

32 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Artifact format
PDF
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_format

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Artifact member
pnas.2311219120.sapp.pdf
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_member

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Artifact retrieval endpoint
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/supplementaryFiles
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_retrieval_endpoint

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Artifact SHA-256
e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Doi
10.1073/pnas.2311219120
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Extraction method
pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.extraction_method

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Licence
CC BY-NC-ND 4.0
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.licence

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Limitations
2 values
  • Figures S1 to S12 carry no values in their text layer beyond axis ticks and the per-class variant counts printed in the Figure S9 subplot titles, so the odds ratios they show are not extractable.
  • Licensed CC BY-NC-ND 4.0. The PDF is archived here verbatim; the text layer in extract/ is a mechanical derivative kept so the parse can be rerun.
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Media type
application/pdf
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

Original url
https://www.pnas.org/doi/suppl/10.1073/pnas.2311219120/suppl_file/pnas.2311219120.sapp.pdf
Source metadata
SI Appendix for PNAS 2023 GPN paper (Tables S1 to S3, Figures S1 to S12)

Original source ↗

No field-specific location recorded

Version: pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Retrieved: 2026-11-16T00:30:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.original_url

Source artifact SHA-256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16

Hash scope: pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.

Format: PDF

Archive member: pnas.2311219120.sapp.pdf

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

The published supporting information, which holds the genome assembly list, the test perplexity table, the training hyperparameters and twelve supplementary figures.

1 source record and release history

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: gpn-paper-20261116-source-pnas-2023-si-appendix

areas
dna-genomes
contexts
research
artifact format
PDF
artifact member
pnas.2311219120.sapp.pdf
artifact retrieval endpoint
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/supplementaryFiles
artifact sha256
e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16
doi
10.1073/pnas.2311219120
extraction method
pdftotext -layout (poppler 26.08.0) on the pinned PDF; the text layer is kept at extract/si-appendix.layout.txt, sha256 6ee1d0c99cc16aa2f5781755204665f0ee08a8f966a9a52c4e1e804ba3bf335a.
licence
CC BY-NC-ND 4.0
limitations
Figures S1 to S12 carry no values in their text layer beyond axis ticks and the per-class variant counts printed in the Figure S9 subplot titles, so the odds ratios they show are not extractable.; Licensed CC BY-NC-ND 4.0. The PDF is archived here verbatim; the text layer in extract/ is a mechanical derivative kept so the parse can be rerun.
media type
application/pdf
original url
https://www.pnas.org/doi/suppl/10.1073/pnas.2311219120/suppl_file/pnas.2311219120.sapp.pdf
publication status
peer_reviewed
retrieval note
The Europe PMC supplementaryFiles endpoint serves a zip built per request, so the zip hash is not stable: two downloads on 2026-11-16 gave c20ffb3f6f12bfd7b1dd96b7735dd52eb2c2f3c0298a745a03241ee0a09085cf and 4b92429593be1cbd31983738ab46d6276151bd19858ef7b7151073395c0c8984. The pinned hash is that of the PDF member, which was identical in both. Direct requests to pnas.org and to the PMC /bin/ path returned HTTP 403 and 404.
retrieved at
2026-11-16T00:30:00Z
review
artifact sha256: e9ea2399b54c66f17b6088f205e17242521bd31fcb6b608841cdaf69cf363b16; date: 2026-11-16; method: source-hash-verification; pdf-text-parse; automated-source-review; method note: Extraction: the published article prints no tables in its main text, so Table S2 was parsed from the pdftotext -layout text layer of the pinned SI Appendix PDF (extract/si-appendix.layout.txt) by extract/parse_values.py with all three row labels and the header asserted, and every other value was taken from the article body by matching its whole printed sentence in the pinned Europe PMC JATS XML, so a changed sentence fails the parse.; note: The PDF member hash was confirmed identical across two downloads of the generated zip on 2026-11-16, and the text layer was regenerated from the pinned PDF with pdftotext -layout (poppler 26.08.0).; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/supplementaryFiles; reviewer: claude; reviewer note: Claude (Opus 5) extraction agent. Extraction only: no independent review is claimed, and a different agent reviews this batch.
url
https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10622914/supplementaryFiles
version
pnas.2311219120.sapp.pdf as served for PMC10622914, 18 pages, created 2023-09-22
Related records

Suggest a correction