Result

0.803 AUROC

structure-informed pLM · AUROC · variant-effects benchmark

Tested configuration: structure-informed pLM
Task: protein variant-effect classification
Dataset: variant-effects benchmark
Procedure: combined amino-acid, secondary structure, solvent accessibility and contact-map scoring
Evaluation: structure-informed pLM: protein variant-effect classification
Coverage: scored: unreported; eligible: unreported
Uncertainty: Not reported
Evidence: Author-reported evaluation · source checkedStructure-Informed Protein Language Models are Robust Predictors for Variant Effects · PMC12068927 HTML, Table4, AA+SS+RSA+CM row, AUROC column

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Reproduction

Split: paper evaluation
Adaptation: Not reported
Scoring implementation: Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Access requirements and official instructions: protein variant-effect classification

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statement	Original source and location	Review and provenance
attributes.printed_value .803 Individual claims	Structure-Informed Protein Language Models are Robust Predictors for Variant Effects Original source ↗ PMC12068927 HTML, Table4, AA+SS+RSA+CM row, AUROC column Version: Human Genetics 2025 journal article (online 2024) Retrieved: 2026-09-16T10:45:41.099916+00:00	source checked independent ai table review · 2026-09-16T10:45:41.099916+00:00 author reported Audit details Full-text HTML succeeds although EuropePMC XMLreturned404. Row is mutation-site variables AA+SS+RSA+CM, not neighbouring environment variant. AUROC .803 is numerically equivalent to preserved legacy0.803. Source check, not experimental reproduction; do not claim original source printed leading zero. Field: `attributes.printed_value` Claim: claim-b2-structure-informed-plm-2025 Source artifact SHA-256: `76082e1cd992d2c09c38f86d05aba575cc76c5022b53a297123b713bb1ce9267` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact Extraction artifact SHA-256: `76082e1cd992d2c09c38f86d05aba575cc76c5022b53a297123b713bb1ce9267` Extraction artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

1 source records and release history

Structure-Informed Protein Language Models are Robust Predictors for Variant Effects · Original source · Human Genetics 2025 journal article (online 2024)

Download this release

Technical metadata and extraction receipts

Stable ID: b2-structure-informed-plm-2025

areas: proteins-complexes
tasks: protein variant-effect classification
printed value: .803
numeric value: 0.803
metric: AUROC
metric direction: unknown
unit: fraction
uncertainty: Not reported
source locator: PMC12068927 HTML, Table4, AA+SS+RSA+CM row, AUROC column
review: method: independent_ai_table_review; reviewer: Codex omics research agent; independent source review, not human review; reviewed at: 2026-09-16T10:45:41.099916+00:00; notes: Full-text HTML succeeds although EuropePMC XMLreturned404. Row is mutation-site variables AA+SS+RSA+CM, not neighbouring environment variant. AUROC .803 is numerically equivalent to preserved legacy0.803. Source check, not experimental reproduction; do not claim original source printed leading zero.; evidence: Table4 headers: Type, Variable(s), Spearman rho, AUROC, AUPRC. Parsed HTML row: AA+SS+RSA+CM | .552 | .803 | .792. Primary web rendering independently confirms columns.; artifact sha256: 76082e1cd992d2c09c38f86d05aba575cc76c5022b53a297123b713bb1ce9267; retrieval url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12068927/
legacy id: b2-structure-informed-plm-2025
legacy row: id: b2-structure-informed-plm-2025; paper id: structure-informed-plm-2025; domain id: proteins-complexes; task: protein variant-effect classification; model: structure-informed pLM; model version: not stated in table; dataset: variant-effects benchmark; dataset version: Not reported; split: paper evaluation; metric: AUROC; value: 0.803; unit: fraction; uncertainty: Not reported; protocol: combined amino-acid, secondary structure, solvent accessibility and contact-map scoring; source locator: Table 4, AA+SS+RSA+CM row, AUROC column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12068927/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:33:26Z
missing metadata: dataset version: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract

Related records

evaluation: structure-informed pLM: protein variant-effect classification
subject: Reported AUROC for structure-informed pLM

Suggest a correction