Evidence claim

Relevance of TraitGym Complex traits, linear-probing, AUPRC by chromosome weighted average to "Select regulatory variants and genes for functional follow-up"

Use case: Select regulatory variants and genes for functional follow-up
Assessed by: TraitGym Complex traits, linear-probing, AUPRC by chromosome weighted average
Relevance: Proxy evidence
Endpoint: AUPRC (per-chromosome weighted average, with bootstrap SE) of linear-probing scores from gLMs, sequence-to-function models, CADD and conservation for Complex traits causal versus matched noncoding variants

TraitGym Complex traits linear-probing AUPRC as evidence for choosing causal noncoding variants to follow up.

18 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statement	Original source and location	Review and provenance
Citation locations 1 values source id lit-genomics-20261011-traitgym-source-hf-metrics locator complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.citation_locators` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Comparison group traitgym-official Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.comparison_group` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Comparison title TraitGym official metrics Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.comparison_title` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Constraints 3 values Inspect every linked evaluation's source locator before citing a result. Do not combine this mapping's evaluations with any other protocol's results. Compare only within the same dataset and mode; the baseline AUPRC is 0.1. Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.constraints` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Endpoint AUPRC (per-chromosome weighted average, with bootstrap SE) of linear-probing scores from gLMs, sequence-to-function models, CADD and conservation for Complex traits causal versus matched noncoding variants Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.endpoint` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Claimed field links:assessed_by:lit-genomics-20261011-traitgym-protocol-complex-traits-matched-9-linear-probing Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.field` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Headline metric auprc Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.headline_metric` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Limitations 5 values Benchmark authors developed GPN-MSA and GPN-Promoter (author_reported). Complex-trait positives come from UK Biobank fine-mapping (high posterior inclusion probability, mostly European ancestry). Labels are not experimental allele effects. Official metrics files on a mutable Hugging Face dataset, pinned by revision. Linear-probing scores are fitted on TraitGym labels with leave-one-chromosome-out training, so they are not comparable with zero-shot scores. Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.limitations` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Pinned records 39 values record id lit-genomics-20261011-traitgym-eval-aido-dna-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 513cc3301a85b7c49c12e6b3b4dd35cedc972fba93ec4dc24dea2a2b7872c21e record id lit-genomics-20261011-traitgym-eval-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 80ee3b729bbc2319fc2d67f7c6aa9214671ff342ea7f2b764423abbf294fde88 record id lit-genomics-20261011-traitgym-eval-cadd-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 35af8d6ab8da51fb6a906807a11ba34a05c2bc8783a8425c22723b42da872d57 record id lit-genomics-20261011-traitgym-eval-cadd-plus-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 62bd2c3c992ca8951ef3737e308d7c503a2bce4cdc57521cc3fee7f504fdeb0d record id lit-genomics-20261011-traitgym-eval-cadd-plus-gpn-msa-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 bfdddbad9aca94a535651e2ebbdd6d469726c306cdd33e22278fc841d6c4d548 record id lit-genomics-20261011-traitgym-eval-cadd-plus-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 aa11585e2e67005d53fd0d1e6d3334b9d9fdc33b2487ef7ee334b20790cb07c7 record id lit-genomics-20261011-traitgym-eval-caduceus-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 5de88e8293588cbb06ee2ef2650ab858116f9e82121c1ef6bfd710afdf689904 record id lit-genomics-20261011-traitgym-eval-enformer-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 274f810cc9c77ffc4174de6a9c23cf23b5f714523443ce5838e881fbe9632ffd record id lit-genomics-20261011-traitgym-eval-evo2-1b-base-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 c8ad03410bc21df1ccf33a411c03a340803c98e9adbf6558afe529ce16269214 record id lit-genomics-20261011-traitgym-eval-evo2-40b-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 032a58b05da8cd017ba29663e9550e24172b39dd5ea4a1e09002336618672817 record id lit-genomics-20261011-traitgym-eval-evo2-7b-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 fc620d12c33ede94c403bed357d99424a162b9485129b9b81c4f8a283cd46d65 record id lit-genomics-20261011-traitgym-eval-gpn-final-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 ef8fb64c89c1e53ed915156454a94a9277062945c1a0107c5abd17cdb224e460 record id lit-genomics-20261011-traitgym-eval-gpn-msa-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 447f6b54cfc9d0e5ccb7c8cacaa741db25d10d609ea4ae5b4f524a59a30b1405 record id lit-genomics-20261011-traitgym-eval-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 563cc6d5c259608ae6d7c5388505ed0c7cbacb383ad5fa39721c5f9197a0c735 record id lit-genomics-20261011-traitgym-eval-hyenadna-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 263b4c5953dcf196a09816b4f039e1afdbeddb2aaefd3a88dcad12102e81da1c record id lit-genomics-20261011-traitgym-eval-nucleotidetransformer-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 86add224531d9dcce89346fd6f3c0221ff9ed514e4da80e71cbcc1810a597c87 record id lit-genomics-20261011-traitgym-eval-sei-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 05ce7c3b639a0e44bcea484179fd8c86ad7a9da91fef11206a978159cdd4f3cf record id lit-genomics-20261011-traitgym-eval-specieslm-logisticregression-chrom-complex-traits-matched-9 fields status links attributes.origin attributes.comparison sha256 553adc8ca0fa2db035782588f3faa789e0495656e3a2917126da0be56b4d1838 record id lit-genomics-20261011-traitgym-protocol-complex-traits-matched-9-linear-probing fields status name description facets source_ids links attributes sha256 7e07a4d5dce0e5d1b5e1dab872e4e5009696e0fd484816e4d511747dc67e9b11 record id lit-genomics-20261011-traitgym-result-aido-dna-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 ca145cd396bdcc1f5addd98a8906ce417e73999b6a166319c11798c6ad4dbb49 record id lit-genomics-20261011-traitgym-result-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 402106cfc070699ab023b829d85be24d0cd4d315a5f240c408b5547227942fb0 record id lit-genomics-20261011-traitgym-result-cadd-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 9682e0ade3fe3b48febf946bf456ee27ede34ca134b5d3aef4e198fb0d1a8c32 record id lit-genomics-20261011-traitgym-result-cadd-plus-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 a2398ec1ed90284b66d1b040e771c94e76c0c14101ac30c4a76111f1925ca072 record id lit-genomics-20261011-traitgym-result-cadd-plus-gpn-msa-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 a090ee8152de02f8e271fee0d6b5cac36a4b6b1fc8f00f8e2136f54549565f10 record id lit-genomics-20261011-traitgym-result-cadd-plus-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 4f8e989671a2dccead02f6f2e8aae5baf499665491a14d57d75e40e02a9eea5e record id lit-genomics-20261011-traitgym-result-caduceus-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 5f7d8056cc6db1047f24ee7f7170625e6504a3c8d835f7bd8c4ef77e8a669581 record id lit-genomics-20261011-traitgym-result-enformer-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 08dc013403dc42e493a9ba4905304ad83caf223e92fce2f06ab3c90a4adf697b record id lit-genomics-20261011-traitgym-result-evo2-1b-base-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 fa572b80c9294dc995c631ef10edf0cf33c1af15280e97a6590be9041a283dd3 record id lit-genomics-20261011-traitgym-result-evo2-40b-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 24bd216bff607405c3e56d91ca5ac15436e57114a03e470bc5da18ec28ae2284 record id lit-genomics-20261011-traitgym-result-evo2-7b-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 d69d9ad192c34bcdc36ea824bc82e3b953b5b620f6050e00aeaabad253620bf0 record id lit-genomics-20261011-traitgym-result-gpn-final-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 5c820028406f262aacb7c4fdb72aaa00ce66ee1980509903476173e965426c2f record id lit-genomics-20261011-traitgym-result-gpn-msa-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 a650431602d38f44a40945bcc90b993bea6f973d9cd81147afb199d1e4231441 record id lit-genomics-20261011-traitgym-result-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 509e01f4f6f894a703b47b6fa4668096da2f6a2f4a67c64b5304c9f3dbc83314 record id lit-genomics-20261011-traitgym-result-hyenadna-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 68306672ecf044d499c02cc63640e82f10dfc2d8cd3e2bfd9b1fef5c1c6819fb record id lit-genomics-20261011-traitgym-result-nucleotidetransformer-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 0c37226f0fcc88d52047a27a8764806440ba78742176ca953e47cddb702eda81 record id lit-genomics-20261011-traitgym-result-sei-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 8be73b7c8ae1947b93e0dcc18071c1bbbfe86d3c0e6a71e666c83514fe798dcb record id lit-genomics-20261011-traitgym-result-specieslm-logisticregression-chrom-complex-traits-matched-9 fields status attributes.metric attributes.metric_qualifier attributes.printed_value attributes.numeric_value sha256 f8ccf247db19195083983276921d8a93def84745689f93bbdfc5fa5406d95577 record id lit-genomics-20261011-traitgym-source-hf-metrics fields status attributes.artifact_sha256 sha256 865b9568f1a674d20cfecf890361ad3606fcb35a0932b64fbe70ff045e727a59 record id use-case-regulatory-variant-gene-follow-up fields status name description facets attributes.question attributes.decision attributes.inputs attributes.output attributes.exclusions attributes.setting attributes.clinical_scope attributes.intended_users sha256 0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870 Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.pins` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact
Rationale Proxy, not direct: the inputs match fine-mapped or curated candidate variants at a locus, but the output only ranks variants; it gives no element-gene link and no effect direction, which the use case needs to design perturbations. Context-only references	TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) Original source ↗ lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/ Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/ Retrieved: 2026-10-11T01:40:33Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.rationale` Source artifact SHA-256: `44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e` Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz) Inspected artifact

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release history

TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) · Original source · Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: use-case-mapping-lit-genomics-20261011-traitgym-complex-traits-matched-9-linear-probing

field: links:assessed_by:lit-genomics-20261011-traitgym-protocol-complex-traits-matched-9-linear-probing
value: lit-genomics-20261011-traitgym-protocol-complex-traits-matched-9-linear-probing
relevance: proxy
endpoint: AUPRC (per-chromosome weighted average, with bootstrap SE) of linear-probing scores from gLMs, sequence-to-function models, CADD and conservation for Complex traits causal versus matched noncoding variants
rationale: Proxy, not direct: the inputs match fine-mapped or curated candidate variants at a locus, but the output only ranks variants; it gives no element-gene link and no effect direction, which the use case needs to design perturbations.
constraints: Inspect every linked evaluation's source locator before citing a result.; Do not combine this mapping's evaluations with any other protocol's results.; Compare only within the same dataset and mode; the baseline AUPRC is 0.1.
limitations: Benchmark authors developed GPN-MSA and GPN-Promoter (author_reported).; Complex-trait positives come from UK Biobank fine-mapping (high posterior inclusion probability, mostly European ancestry).; Labels are not experimental allele effects.; Official metrics files on a mutable Hugging Face dataset, pinned by revision.; Linear-probing scores are fitted on TraitGym labels with leave-one-chromosome-out training, so they are not comparable with zero-shot scores.
citation locators: source id: lit-genomics-20261011-traitgym-source-hf-metrics; locator: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/
source locator: lit-genomics-20261011-traitgym-source-hf-metrics: complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/
headline metric: auprc
reason: Add a relevance judgement for a genomic foundation model benchmark protocol from the 2026-10-11 genomics suite pass, reviewed in docs/reviews/2026-10-11-genomics-gfm-suites.md.
comparison group: traitgym-official
comparison title: TraitGym official metrics
stratum label: Complex traits, linear-probing
stratum order: 4
reviewed evaluations: lit-genomics-20261011-traitgym-eval-aido-dna-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-borzoi-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-cadd-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-cadd-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-cadd-plus-gpn-msa-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-cadd-plus-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-caduceus-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-enformer-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-evo2-1b-base-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-evo2-40b-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-evo2-7b-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-gpn-final-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-gpn-msa-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-hyenadna-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-nucleotidetransformer-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-sei-logisticregression-chrom-complex-traits-matched-9; lit-genomics-20261011-traitgym-eval-specieslm-logisticregression-chrom-complex-traits-matched-9
review: method: ai-assisted-source-review; scope-review; method note: Reviewer checked the endpoint against the use case's inputs and output, the proxy rating and the limitations; every evaluation on the protocol had its values checked in the batch review. Corrections listed in review.md were applied by the extractor.; reviewer: claude; reviewer note: Claude review agent reviewer-gen-3, independent of the extractor lit-genomics; no human review claimed; reviewed at: 2026-10-11T14:40:00Z; note: Automated review; not human scientific review.
pins: record id: lit-genomics-20261011-traitgym-eval-aido-dna-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 513cc3301a85b7c49c12e6b3b4dd35cedc972fba93ec4dc24dea2a2b7872c21e; record id: lit-genomics-20261011-traitgym-eval-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 80ee3b729bbc2319fc2d67f7c6aa9214671ff342ea7f2b764423abbf294fde88; record id: lit-genomics-20261011-traitgym-eval-cadd-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 35af8d6ab8da51fb6a906807a11ba34a05c2bc8783a8425c22723b42da872d57; record id: lit-genomics-20261011-traitgym-eval-cadd-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 62bd2c3c992ca8951ef3737e308d7c503a2bce4cdc57521cc3fee7f504fdeb0d; record id: lit-genomics-20261011-traitgym-eval-cadd-plus-gpn-msa-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: bfdddbad9aca94a535651e2ebbdd6d469726c306cdd33e22278fc841d6c4d548; record id: lit-genomics-20261011-traitgym-eval-cadd-plus-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: aa11585e2e67005d53fd0d1e6d3334b9d9fdc33b2487ef7ee334b20790cb07c7; record id: lit-genomics-20261011-traitgym-eval-caduceus-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 5de88e8293588cbb06ee2ef2650ab858116f9e82121c1ef6bfd710afdf689904; record id: lit-genomics-20261011-traitgym-eval-enformer-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 274f810cc9c77ffc4174de6a9c23cf23b5f714523443ce5838e881fbe9632ffd; record id: lit-genomics-20261011-traitgym-eval-evo2-1b-base-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: c8ad03410bc21df1ccf33a411c03a340803c98e9adbf6558afe529ce16269214; record id: lit-genomics-20261011-traitgym-eval-evo2-40b-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 032a58b05da8cd017ba29663e9550e24172b39dd5ea4a1e09002336618672817; record id: lit-genomics-20261011-traitgym-eval-evo2-7b-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: fc620d12c33ede94c403bed357d99424a162b9485129b9b81c4f8a283cd46d65; record id: lit-genomics-20261011-traitgym-eval-gpn-final-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: ef8fb64c89c1e53ed915156454a94a9277062945c1a0107c5abd17cdb224e460; record id: lit-genomics-20261011-traitgym-eval-gpn-msa-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 447f6b54cfc9d0e5ccb7c8cacaa741db25d10d609ea4ae5b4f524a59a30b1405; record id: lit-genomics-20261011-traitgym-eval-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 563cc6d5c259608ae6d7c5388505ed0c7cbacb383ad5fa39721c5f9197a0c735; record id: lit-genomics-20261011-traitgym-eval-hyenadna-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 263b4c5953dcf196a09816b4f039e1afdbeddb2aaefd3a88dcad12102e81da1c; record id: lit-genomics-20261011-traitgym-eval-nucleotidetransformer-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 86add224531d9dcce89346fd6f3c0221ff9ed514e4da80e71cbcc1810a597c87; record id: lit-genomics-20261011-traitgym-eval-sei-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 05ce7c3b639a0e44bcea484179fd8c86ad7a9da91fef11206a978159cdd4f3cf; record id: lit-genomics-20261011-traitgym-eval-specieslm-logisticregression-chrom-complex-traits-matched-9; fields: status; links; attributes.origin; attributes.comparison; sha256: 553adc8ca0fa2db035782588f3faa789e0495656e3a2917126da0be56b4d1838; record id: lit-genomics-20261011-traitgym-protocol-complex-traits-matched-9-linear-probing; fields: status; name; description; facets; source_ids; links; attributes; sha256: 7e07a4d5dce0e5d1b5e1dab872e4e5009696e0fd484816e4d511747dc67e9b11; record id: lit-genomics-20261011-traitgym-result-aido-dna-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: ca145cd396bdcc1f5addd98a8906ce417e73999b6a166319c11798c6ad4dbb49; record id: lit-genomics-20261011-traitgym-result-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 402106cfc070699ab023b829d85be24d0cd4d315a5f240c408b5547227942fb0; record id: lit-genomics-20261011-traitgym-result-cadd-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 9682e0ade3fe3b48febf946bf456ee27ede34ca134b5d3aef4e198fb0d1a8c32; record id: lit-genomics-20261011-traitgym-result-cadd-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a2398ec1ed90284b66d1b040e771c94e76c0c14101ac30c4a76111f1925ca072; record id: lit-genomics-20261011-traitgym-result-cadd-plus-gpn-msa-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a090ee8152de02f8e271fee0d6b5cac36a4b6b1fc8f00f8e2136f54549565f10; record id: lit-genomics-20261011-traitgym-result-cadd-plus-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 4f8e989671a2dccead02f6f2e8aae5baf499665491a14d57d75e40e02a9eea5e; record id: lit-genomics-20261011-traitgym-result-caduceus-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5f7d8056cc6db1047f24ee7f7170625e6504a3c8d835f7bd8c4ef77e8a669581; record id: lit-genomics-20261011-traitgym-result-enformer-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 08dc013403dc42e493a9ba4905304ad83caf223e92fce2f06ab3c90a4adf697b; record id: lit-genomics-20261011-traitgym-result-evo2-1b-base-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: fa572b80c9294dc995c631ef10edf0cf33c1af15280e97a6590be9041a283dd3; record id: lit-genomics-20261011-traitgym-result-evo2-40b-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 24bd216bff607405c3e56d91ca5ac15436e57114a03e470bc5da18ec28ae2284; record id: lit-genomics-20261011-traitgym-result-evo2-7b-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: d69d9ad192c34bcdc36ea824bc82e3b953b5b620f6050e00aeaabad253620bf0; record id: lit-genomics-20261011-traitgym-result-gpn-final-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 5c820028406f262aacb7c4fdb72aaa00ce66ee1980509903476173e965426c2f; record id: lit-genomics-20261011-traitgym-result-gpn-msa-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: a650431602d38f44a40945bcc90b993bea6f973d9cd81147afb199d1e4231441; record id: lit-genomics-20261011-traitgym-result-gpn-msa-plus-borzoi-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 509e01f4f6f894a703b47b6fa4668096da2f6a2f4a67c64b5304c9f3dbc83314; record id: lit-genomics-20261011-traitgym-result-hyenadna-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 68306672ecf044d499c02cc63640e82f10dfc2d8cd3e2bfd9b1fef5c1c6819fb; record id: lit-genomics-20261011-traitgym-result-nucleotidetransformer-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0c37226f0fcc88d52047a27a8764806440ba78742176ca953e47cddb702eda81; record id: lit-genomics-20261011-traitgym-result-sei-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 8be73b7c8ae1947b93e0dcc18071c1bbbfe86d3c0e6a71e666c83514fe798dcb; record id: lit-genomics-20261011-traitgym-result-specieslm-logisticregression-chrom-complex-traits-matched-9; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: f8ccf247db19195083983276921d8a93def84745689f93bbdfc5fa5406d95577; record id: lit-genomics-20261011-traitgym-source-hf-metrics; fields: status; attributes.artifact_sha256; sha256: 865b9568f1a674d20cfecf890361ad3606fcb35a0932b64fbe70ff045e727a59; record id: use-case-regulatory-variant-gene-follow-up; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: 0071547e01ccaec30238aea9e4882dd92e6f51be9c967c7fb88bc61d2788b870

Related records

subject: Select regulatory variants and genes for functional follow-up

Suggest a correction