rewirebio.iobenchmarks
Configuration

GPN-MSA_absLLR.plus.score (TraitGym)

GPN-MSA scored as 'absolute log-likelihood ratio' in TraitGym.

2 evaluations · 2 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

2 evaluations · 2 results. Different protocols are not a single leaderboard.

Sorted by AUPRC (weighted average over chromosomes of per-chromosome AUPRC; subset 'all') (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

All 2 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: GPN-MSA_absLLR.plus.score (TraitGym)Protocol: TraitGym Complex traits, zero-shot, AUPRC by chromosome weighted average
Dataset: TraitGym Complex traits, matched 9 controls
0.224 AUPRC (weighted average over chromosomes of per-chromosome AUPRC; subset 'all')
unitless · higher

Uncertainty: SE 0.009396245805515136

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPN-MSA_absLLR.plus.score on TraitGym complex_traits_matched_9

lit-genomics-20261011-traitgym-protocol-complex-traits-matched-9-zero-shot

Aggregation: Not reported

TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) · complex_traits_matched_9/AUPRC_by_chrom_weighted_average/all/GPN-MSA_absLLR.plus.score.csv, column 'score' (standard error in column 'se')
Configuration: GPN-MSA_absLLR.plus.score (TraitGym)Protocol: TraitGym Mendelian traits, zero-shot, AUPRC by chromosome weighted average
Dataset: TraitGym Mendelian traits, matched 9 controls
0.654 AUPRC (weighted average over chromosomes of per-chromosome AUPRC; subset 'all')
unitless · higher

Uncertainty: SE 0.044972926205583436

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPN-MSA_absLLR.plus.score on TraitGym mendelian_traits_matched_9

lit-genomics-20261011-traitgym-protocol-mendelian-traits-matched-9-zero-shot

Aggregation: Not reported

TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym) · mendelian_traits_matched_9/AUPRC_by_chrom_weighted_average/all/GPN-MSA_absLLR.plus.score.csv, column 'score' (standard error in column 'se')

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access

Related profile: GPN-MSA. This page retains the exact record and its evaluation context.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Relationship: configuration of
gfm-guides-20261014-gpnmsa-model-gpn-msa
Individual claims
GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2)

Original source ↗

Configuration name as printed in its source (GPN-MSA_absLLR.plus.score); GPN-MSA identity from gfm-guides-20261014-gpnmsa-source-biorxiv-v2 (Abstract) and gfm-guides-20261014-gpnmsa-source-gpn-msa-doc

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bioRxiv v2, posted 2024-04-06
Retrieved: 2026-10-14T12:02:16Z

source checked

["scope-review"] · 2026-10-14

Audit details

Accepted in the independent review of 2026-10-14. See docs/reviews/2026-10-14-gfm-guide-evidence-review.md.

Field: links:configuration_of:gfm-guides-20261014-gpnmsa-model-gpn-msa

Claim: identity-20261014-6584f6c003fb1d36a6ff

Source artifact SHA-256: 10411077df1ae59614f9a9a9f85384103d54127ba67a9b3c469a4a2d6c33cee4

Hash scope: SHA-256 of the PDF bytes as downloaded 2026-10-14T12:02:16Z. bioRxiv rewrites the XMP dates and document IDs, the Info ModDate and the trailer /ID on download, so a re-download does not reproduce the hash; the review found a fresh copy of the same length differing only in those 51 bytes, with an identical pdftotext -layout text layer.

Inspected artifact

Relationship: configuration of
gfm-guides-20261014-gpnmsa-model-gpn-msa
Individual claims
TraitGym official metrics: AUPRC by chromosome, weighted average (Hugging Face dataset songlab/TraitGym)

Original source ↗

Configuration name as printed in its source (GPN-MSA_absLLR.plus.score); GPN-MSA identity from gfm-guides-20261014-gpnmsa-source-biorxiv-v2 (Abstract) and gfm-guides-20261014-gpnmsa-source-gpn-msa-doc

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Hugging Face dataset revision 1fde19555fe8c0a55b1382bdf4c6f7082209f566 (last modified 2025-03-25); 156 metric CSVs under {dataset}/AUPRC_by_chrom_weighted_average/all/
Retrieved: 2026-10-11T01:40:33Z

source checked

["scope-review"] · 2026-10-14

Audit details

Accepted in the independent review of 2026-10-14. See docs/reviews/2026-10-14-gfm-guide-evidence-review.md.

Field: links:configuration_of:gfm-guides-20261014-gpnmsa-model-gpn-msa

Claim: identity-20261014-6584f6c003fb1d36a6ff

Source artifact SHA-256: 44dfedc00ac5c7918b188af2a5a200f08da3b641f73d7d5327e26f94a7d0372e

Hash scope: SHA-256 of a JSON bundle listing every retrieved CSV with its path, its own SHA-256 and its bytes (artifacts/traitgym-metrics-bundle.json.gz)

Inspected artifact

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-genomics-20261011-traitgym-config-gpn-msa-absllr-plus-score

areas
dna-genomes
contexts
research
method types
foundation_model
reported name
GPN-MSA_absLLR.plus.score
foundation model eligible
true
parameters
songlab/gpn-msa-sapiens; absolute log-likelihood ratio
access reuse
Public weights or score files (paper Appendix B.1)
source locator
File name 'GPN-MSA_absLLR.plus.score.csv'; config/models.csv; paper Table S5
version
songlab/gpn-msa-sapiens
Related records

Suggest a correction