rewirebio.iobenchmarks
Result

0.701 pearson-correlation

tang2025-k562-lentimpra-embedding-cnn-sei-pearson pearson-correlation

Tested configuration
CNN-SEI, LentiMPRA-embedding (Tang et al. 2025)
Protocol
CAGI5 saturation MPRA variant effect correlation, K562 (Tang et al. 2025 Table 1)
Dataset
CAGI5 saturation mutagenesis MPRA, four CREs (as used by Tang et al. 2025)
Procedure
regulatory-variant-20261009-protocol-tang2025-cagi5-k562
Evaluation
CNN-SEI (LentiMPRA-embedding) on CAGI5 K562
Coverage
Not reported scored / Not reported eligible
Uncertainty
Not reported by the source
Evidence
Author-reported evaluation · source checkedEvaluating the representational power of pre-trained DNA language models for regulatory genomics · Table 1 row 'LentiMPRA-embedding' / 'CNN-SEI', column 'K562'

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
Zero-shot test
Adaptation
CNN trained by the authors on lentiMPRA activity using frozen embeddings of the named model
Scoring implementation
Pearson correlation per experiment

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-10-10-6e93f504adfc
Property and statementOriginal source and locationReview and provenance
Reported result
0.701
Individual claims
Evaluating the representational power of pre-trained DNA language models for regulatory genomics

Original source ↗

Table 1 row 'LentiMPRA-embedding' / 'CNN-SEI', column 'K562'

Version: Genome Biology 26:203, published 2025-07-14; PMC12261763 full-text XML
Retrieved: 2026-10-09T21:04:28Z

source checked

["source-hash-verification","deterministic-table-parse","independent-cell-check"] · 2026-10-09

author reported

Audit details

Deterministic parse of the pinned article XML table (extract/extract_regulatory_variant.py) with caption, column headers and row labels asserted. Pending independent review. Independent review 2026-10-09: value, interval or standard error, and identity match the source.

Field: attributes.printed_value

Source artifact SHA-256: f6925cc2d93d0694ccc689970207c2df9b7b0d2562d276ede99f0c78d413b08b

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Extraction artifact SHA-256: f6925cc2d93d0694ccc689970207c2df9b7b0d2562d276ede99f0c78d413b08b

Extraction artifact

Sources and history

Release 2026-10-10-6e93f504adfc · Record review: source checked

1 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: regulatory-variant-20261009-result-tang2025-k562-lentimpra-embedding-cnn-sei-pearson

metric
pearson-correlation
metric direction
higher
unit
unitless
printed value
0.701
numeric value
0.701
source locator
Table 1 row 'LentiMPRA-embedding' / 'CNN-SEI', column 'K562'
review
method: source-hash-verification; deterministic-table-parse; independent-cell-check; method note: Re-downloaded the article XML and matched its SHA-256. Read Table 1 with the reviewer's own table-wrap reader, resolving the row-spanning Training task cells; checked printed and numeric value, column, task and model labels and linked configuration and protocol.; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; date: 2026-10-09; artifact sha256: f6925cc2d93d0694ccc689970207c2df9b7b0d2562d276ede99f0c78d413b08b; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12261763/fullTextXML; note: Deterministic parse of the pinned article XML table (extract/extract_regulatory_variant.py) with caption, column headers and row labels asserted. Pending independent review. Independent review 2026-10-09: value, interval or standard error, and identity match the source.
missing metadata
uncertainty: reason: unreported
metric qualifier
predicted versus MPRA-measured saturation mutagenesis variant effect; one CRE
Related records

Suggest a correction