benchmarked_models: TraitGym
Benchmarked models of TraitGym
Table 2 lists the benchmarked systems with their dependencies, parameter count, context size and number of extracted features: Enformer (246M parameters, context 196K, 5,138 extracted features); Sei (890M parameters, context 4K, 41 extracted features); Borzoi (186M parameters, context 524K, 7,617 extracted features); GPN-MSA (86M parameters, context 128, 770 extracted features); NT (2.5B parameters, context 6K, 2,562 extracted features); HyenaDNA (14M parameters, context 160K, 258 extracted features); Caduceus (8M parameters, context 131K, 514 extracted features); SpeciesLM (97M parameters, context 2K, 770 extracted features); AIDO.DNA (7B parameters, context 4K, 4,354 extracted features); Evo2 (40B parameters, context 8,192, 8,194 extracted features); GPN-Promoter (152M parameters, context 512, 1,026 extracted features); CADD (N/A parameters, context N/A, 114 extracted features); phastCons (N/A parameters, context N/A, N/A extracted features); phyloP (N/A parameters, context N/A, N/A extracted features). Evo2 was trained with a 1 M context size but uses a shorter context for variant effect prediction. The downloaded Hugging Face Hub checkpoints are GPN-MSA songlab/gpn-msa-sapiens; NT InstaDeepAI/nucleotide-transformer-2.5b-multi-species; HyenaDNA LongSafari/hyenadna-medium-160k-seqlen-hf; Caduceus kuleshov-group/caduceus-ps_seqlen-131k_d_model-256_n_layer-16; SpeciesLM johahi/specieslm-metazoa-upstream-k6; AIDO.DNA genbio-ai/AIDO.DNA-7B. Evo2 checkpoints Evo2_1b_base, Evo2_7b and Evo2_40b came from the official repository, Enformer and Borzoi from gReLU's Model Zoo, Sei scores from the Sei web server, and CADD v1.7 scores and annotations from the Washington GRCh38 whole_genome_SNVs_inclAnno file. phyloP-100v, phyloP-241m and phastCons-43p were taken from the UCSC hg38 phyloP100way, cactus241way phyloP and Zoonomia primate phastCons tracks.
Descriptive fact transcribed from the pinned source.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
6 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Claimed field benchmarked_models Context-only references | Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Version: bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the PDF bytes of one download. bioRxiv stamps each download, so this hash pins this retrieval and not the document: a second download in the same session gave 5f424797ed5c92a3852a52e8ecf29f0c3a3416740a47fe9f9fefe9fd9fb0c876. The stable check is the pdftotext -layout text layer, whose SHA-256 is 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097 and was byte-identical across both downloads; every value in this batch was read from that text layer. |
| Source location Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Context-only references | Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Version: bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the PDF bytes of one download. bioRxiv stamps each download, so this hash pins this retrieval and not the document: a second download in the same session gave 5f424797ed5c92a3852a52e8ecf29f0c3a3416740a47fe9f9fefe9fd9fb0c876. The stable check is the pdftotext -layout text layer, whose SHA-256 is 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097 and was byte-identical across both downloads; every value in this batch was read from that text layer. |
| Claimed value Table 2 lists the benchmarked systems with their dependencies, parameter count, context size and number of extracted features: Enformer (246M parameters, context 196K, 5,138 extracted features); Sei (890M parameters, context 4K, 41 extracted features); Borzoi (186M parameters, context 524K, 7,617 extracted features); GPN-MSA (86M parameters, context 128, 770 extracted features); NT (2.5B parameters, context 6K, 2,562 extracted features); HyenaDNA (14M parameters, context 160K, 258 extracted features); Caduceus (8M parameters, context 131K, 514 extracted features); SpeciesLM (97M parameters, context 2K, 770 extracted features); AIDO.DNA (7B parameters, context 4K, 4,354 extracted features); Evo2 (40B parameters, context 8,192, 8,194 extracted features); GPN-Promoter (152M parameters, context 512, 1,026 extracted features); CADD (N/A parameters, context N/A, 114 extracted features); phastCons (N/A parameters, context N/A, N/A extracted features); phyloP (N/A parameters, context N/A, N/A extracted features). Evo2 was trained with a 1 M context size but uses a shorter context for variant effect prediction. The downloaded Hugging Face Hub checkpoints are GPN-MSA songlab/gpn-msa-sapiens; NT InstaDeepAI/nucleotide-transformer-2.5b-multi-species; HyenaDNA LongSafari/hyenadna-medium-160k-seqlen-hf; Caduceus kuleshov-group/caduceus-ps_seqlen-131k_d_model-256_n_layer-16; SpeciesLM johahi/specieslm-metazoa-upstream-k6; AIDO.DNA genbio-ai/AIDO.DNA-7B. Evo2 checkpoints Evo2_1b_base, Evo2_7b and Evo2_40b came from the official repository, Enformer and Borzoi from gReLU's Model Zoo, Sei scores from the Sei web server, and CADD v1.7 scores and annotations from the Washington GRCh38 whole_genome_SNVs_inclAnno file. phyloP-100v, phyloP-241m and phastCons-43p were taken from the UCSC hg38 phyloP100way, cactus241way phyloP and Zoonomia primate phastCons tracks. Context-only references | Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Version: bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the PDF bytes of one download. bioRxiv stamps each download, so this hash pins this retrieval and not the document: a second download in the same session gave 5f424797ed5c92a3852a52e8ecf29f0c3a3416740a47fe9f9fefe9fd9fb0c876. The stable check is the pdftotext -layout text layer, whose SHA-256 is 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097 and was byte-identical across both downloads; every value in this batch was read from that text layer. |
| Description Descriptive fact transcribed from the pinned source. Context-only references | Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Version: bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the PDF bytes of one download. bioRxiv stamps each download, so this hash pins this retrieval and not the document: a second download in the same session gave 5f424797ed5c92a3852a52e8ecf29f0c3a3416740a47fe9f9fefe9fd9fb0c876. The stable check is the pdftotext -layout text layer, whose SHA-256 is 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097 and was byte-identical across both downloads; every value in this batch was read from that text layer. |
| Relationship: subject lit-genomics-20261011-traitgym-benchmark-traitgym Context-only references | Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Version: bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the PDF bytes of one download. bioRxiv stamps each download, so this hash pins this retrieval and not the document: a second download in the same session gave 5f424797ed5c92a3852a52e8ecf29f0c3a3416740a47fe9f9fefe9fd9fb0c876. The stable check is the pdftotext -layout text layer, whose SHA-256 is 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097 and was byte-identical across both downloads; every value in this batch was read from that text layer. |
| Name benchmarked_models: TraitGym Context-only references | Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23) Version: bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: SHA-256 of the PDF bytes of one download. bioRxiv stamps each download, so this hash pins this retrieval and not the document: a second download in the same session gave 5f424797ed5c92a3852a52e8ecf29f0c3a3416740a47fe9f9fefe9fd9fb0c876. The stable check is the pdftotext -layout text layer, whose SHA-256 is 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097 and was byte-identical across both downloads; every value in this batch was read from that text layer. |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
1 source record and release history
- Benegas, Eraslan and Song 2025, TraitGym benchmark preprint (bioRxiv v2) · Original source · bioRxiv version 2, posted 2025-03-04 (37 pages, main text and Supplementary Material)
Technical metadata and extraction receipts
Stable ID: traitgym-20261116-claim-benchmarked-models
- field
- benchmarked_models
- review
- artifact sha256: 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097; method: source-hash-verification; pdf-text-parse; transcription; scope-review; method note: The pinned artifact was re-downloaded from the v2 full-PDF URL for this pass. Its PDF bytes hash to 961933ed2396ecb0a75737cc27f0655db07ca62be49654f9139ae95815d050f9, not to the 80426c499e0b498e07c07ea598a2f68049adea7569b30fda58cdc0ebafa6c7aa on the source record, and cannot: bioRxiv restamps the container on every request. The reviewer's download differs from the extractor's two in 41 and 44 bytes, every one of them a download-time stamp (the XMP ModifyDate and MetadataDate, the document ModDate and the trailer ID), with the same 37 pages, the same CreationDate of 2025-03-04 and the same pdftotext -layout text layer. That text layer hashes to 23ae4d67751f1092e5cc2da66b52091fa9bbc3ec59310f06bc65be28f93c5097, which is the hash the source record's hash_scope names as the stable check and the hash recorded here; every value in this batch was read from it.; note: Each quoted sentence and number was read against the paper at the locator recorded.; retrieval url: https://www.biorxiv.org/content/10.1101/2025.02.11.637758v2.full.pdf; reviewed at: 2026-11-16T02:10:00Z; reviewer: claude; reviewer note: Claude review agent (independent of the extractor); no human review claimed. Every value was read against the pinned artifact; nothing was reproduced and no model was run.
- source locator
- Table 2 (page 6), Table S5 (page 23) and Appendix B.1 (pages 22 to 23)
- value
- Table 2 lists the benchmarked systems with their dependencies, parameter count, context size and number of extracted features: Enformer (246M parameters, context 196K, 5,138 extracted features); Sei (890M parameters, context 4K, 41 extracted features); Borzoi (186M parameters, context 524K, 7,617 extracted features); GPN-MSA (86M parameters, context 128, 770 extracted features); NT (2.5B parameters, context 6K, 2,562 extracted features); HyenaDNA (14M parameters, context 160K, 258 extracted features); Caduceus (8M parameters, context 131K, 514 extracted features); SpeciesLM (97M parameters, context 2K, 770 extracted features); AIDO.DNA (7B parameters, context 4K, 4,354 extracted features); Evo2 (40B parameters, context 8,192, 8,194 extracted features); GPN-Promoter (152M parameters, context 512, 1,026 extracted features); CADD (N/A parameters, context N/A, 114 extracted features); phastCons (N/A parameters, context N/A, N/A extracted features); phyloP (N/A parameters, context N/A, N/A extracted features). Evo2 was trained with a 1 M context size but uses a shorter context for variant effect prediction. The downloaded Hugging Face Hub checkpoints are GPN-MSA songlab/gpn-msa-sapiens; NT InstaDeepAI/nucleotide-transformer-2.5b-multi-species; HyenaDNA LongSafari/hyenadna-medium-160k-seqlen-hf; Caduceus kuleshov-group/caduceus-ps_seqlen-131k_d_model-256_n_layer-16; SpeciesLM johahi/specieslm-metazoa-upstream-k6; AIDO.DNA genbio-ai/AIDO.DNA-7B. Evo2 checkpoints Evo2_1b_base, Evo2_7b and Evo2_40b came from the official repository, Enformer and Borzoi from gReLU's Model Zoo, Sei scores from the Sei web server, and CADD v1.7 scores and annotations from the Washington GRCh38 whole_genome_SNVs_inclAnno file. phyloP-100v, phyloP-241m and phastCons-43p were taken from the UCSC hg38 phyloP100way, cactus241way phyloP and Zoonomia primate phastCons tracks.
Related records
- subject: TraitGym