rewire.itbenchmarks
Task

mRNA half-life prediction

mRNA half-life prediction is evaluated with cross-validation on a compiled human annotation dataset.

SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51

1 evaluation · 1 result

Overview

Datasets

Human transcript half-life measurements compiled from multiple publications and samples.

Metrics

Spearman correlation, summarized across folds.

Allowed inputs

mRNA sequence representations.

SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
Evaluation procedure diagram
How it worksComputational evaluation flow
Computational evaluation flow1. Input: mRNA sequence representations.. Then: 2. Evaluation: Ten-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks.. Then: 3. Readout: Spearman correlation, summarized across folds.Computational evaluation flow1. Input: mRNA sequence representations.. Then: 2. Evaluation: Ten-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks.. Then: 3. Readout: Spearman correlation, summarized across folds.Computational evaluation flow1. Input: mRNA sequence representations.. Then: 2. Evaluation: Ten-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks.. Then: 3. Readout: Spearman correlation, summarized across folds.

Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.

SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Source reviewed · Automated source review, 2026-09-16. All specifications and missing details

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: mRNA-LMTask: mRNA half-life prediction
Dataset: mRNA half-life
0.696 Spearman rho
unitless · unknown

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

mRNA-LM: mRNA half-life prediction

average test performance across cross-validation splits

Aggregation: Not reported

mRNA-LM: full-length integrated SLM for mRNA analysis · Table 1, mRNA-LM row, mRNA half-life Spearman column

Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

Human transcript half-life measurements compiled from multiple publications and samples. Ten-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks. Spearman correlation, summarized across folds. RNA-FM and Saluki; the cited Saluki comparison is a literature-reported ablation without a splice-site feature. The half-life experiment inherits the original Saluki dataset’s predefined ten-fold split. The supplement does not specify an additional homology filter or a pretraining-versus-test sequence audit for mRNA-LM. Its random five-fold rule applies to the other datasets, not half-life.

Sources (2)mRNA-LM: full-length integrated SLM for mRNA analysis; mrna-lm-2025__gkaf044_Supplemental_File.pdf · Methods: Datasets; Results: comparison; cached text lines 38–40, 51; Supplement: Section 1 Sequence extraction and data processing

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Strengths and limitations

Strengths supported by sources

No source-reviewed explanatory claims are recorded here yet.

Profile review details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Stable record: reported-task-5693847493f19f

Specifications

Inputs, training, access and other details

Explanatory profile: source reviewed · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
PropertyDescription and evidence
DatasetsHuman transcript half-life measurements compiled from multiple publications and samples.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
SplitsTen-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
MetricsSpearman correlation, summarized across folds.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
BaselinesRNA-FM and Saluki; the cited Saluki comparison is a literature-reported ablation without a splice-site feature.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
Leakage controlsThe half-life experiment inherits the original Saluki dataset’s predefined ten-fold split. The supplement does not specify an additional homology filter or a pretraining-versus-test sequence audit for mRNA-LM. Its random five-fold rule applies to the other datasets, not half-life.
Sources (2)mRNA-LM: full-length integrated SLM for mRNA analysis; mrna-lm-2025__gkaf044_Supplemental_File.pdf · Supplement: Section 1 Sequence extraction and data processing
UncertaintyFold-wise distributions are shown in supplementary box plots.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
Entity typePaper-specific computational evaluation protocol.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
OrganismsHuman.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
AssaysPublished transcript half-life measurements.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
Allowed inputsmRNA sequence representations.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51
AdaptationSupervised half-life prediction with ten-fold cross-validation.
SourcesmRNA-LM: full-length integrated SLM for mRNA analysis · Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Dated primary-source discovery and protocol/table screening. Source checking does not mean experimental reproduction. Only separately extracted and independently reviewed numeric batches are publishable.

Paper or primary resourceVersionReference
mRNA-LM: full-length integrated SLM for mRNA analysisjournal full text in PMCRead source
Historical gaps recorded on 2026-09-17

The catalogue now holds 1 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

  • complete numerical transcription and independent cell review: Full primary artifact and table inventory preserved; no new numeric row is published from this audit alone.
  • exact checkpoint hashes and per-method scored denominators: Table labels alone do not establish these fields; do not infer checkpoint or scored count from model name or dataset size.
Search and extraction details

primary comparison tables located

Searches

  • mRNA-LM: full-length integrated SLM for mRNA analysis 10.1093/nar/gkaf044

Evidence locations

  • Table 1.; XML table tbl1

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

20 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • Input: mRNA sequence representations.
  • Evaluation: Ten-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks.
  • Readout: Spearman correlation, summarized across folds.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Computational evaluation flow
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.diagram.title

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Datasets
Human transcript half-life measurements compiled from multiple publications and samples.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Splits
Ten-fold cross-validation for half-life, distinct from the five-fold settings used for other paper tasks.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Adaptation
Supervised half-life prediction with ten-fold cross-validation.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Metrics
Spearman correlation, summarized across folds.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Baselines
RNA-FM and Saluki; the cited Saluki comparison is a literature-reported ablation without a splice-site feature.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Methods: Datasets; Results: comparison; cached text lines 38–40, 51

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Leakage controls
The half-life experiment inherits the original Saluki dataset’s predefined ten-fold split. The supplement does not specify an additional homology filter or a pretraining-versus-test sequence audit for mRNA-LM. Its random five-fold rule applies to the other datasets, not half-life.
Individual claims
mrna-lm-2025__gkaf044_Supplemental_File.pdf

Original source ↗

Supplement: Section 1 Sequence extraction and data processing

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Retrieved 2026-09-16; sha256:bf1e156bb09c90a9e18101a45332e5a7a8f3b7fd363f6ffbb7760020b4c8f40f
Retrieved: 2026-09-16T21:08:59.937487+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: bf1e156bb09c90a9e18101a45332e5a7a8f3b7fd363f6ffbb7760020b4c8f40f

Hash scope: Hash scope not separately documented; inspect source record

Archive member: gkaf044_Supplemental_File.pdf

Inspected artifact

Leakage controls
The half-life experiment inherits the original Saluki dataset’s predefined ten-fold split. The supplement does not specify an additional homology filter or a pretraining-versus-test sequence audit for mRNA-LM. Its random five-fold rule applies to the other datasets, not half-life.
Individual claims
mRNA-LM: full-length integrated SLM for mRNA analysis

Original source ↗

Supplement: Section 1 Sequence extraction and data processing

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558214+00:00

source checked

automated source review · 2026-09-16

Audit details

Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: 3a23de3c672ec162d13561c483f180a73b550d717256deffdc9099accec205fd

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: needs review

3 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: reported-task-5693847493f19f

areas
rna-transcriptomes
tasks
mRNA half-life prediction
entity level
task
version
Not reported
task
mRNA half-life prediction
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
benchmark research
review date: 2026-09-17; status: primary_comparison_tables_located; primary sources: evidence-expansion-mrna-lm-2025-3a23de3c; inspected locators: Table 1.; XML table tbl1; searched queries: mRNA-LM: full-length integrated SLM for mRNA analysis 10.1093/nar/gkaf044; gaps: complete numerical transcription and independent cell review: Full primary artifact and table inventory preserved; no new numeric row is published from this audit alone.; exact checkpoint hashes and per-method scored denominators: Table labels alone do not establish these fields; do not infer checkpoint or scored count from model name or dataset size.; claim scope: Dated primary-source discovery and protocol/table screening. Source checking does not mean experimental reproduction. Only separately extracted and independently reviewed numeric batches are publishable.
historical missing metadata
protocol version: not_reported_in_legacy_extract
metadata review scope
historical_missing_metadata preserves the original discovery state. Current descriptive evidence and missingness are recorded in profile.facts; numerical-result review is separate.
legacy kinds
benchmark
entity classification
review date: 2026-09-17; rationale: This source-scoped record identifies the biological prediction task and holds its paper context. Preserve the existing task identity; exact split, model adaptation and scoring remain in linked evaluations or separate protocol records.; source ids: mrna-lm-2025; source locator: Methods: Datasets; Results: comparison; cached text lines 38–40, 51; ambiguities: A paper- or suite-specific task may constrain some inputs or metrics; that alone does not make it interchangeable with a complete versioned protocol. No protocol equivalence is inferred.; Some legacy profile Entity type facts use the generic phrase computational evaluation protocol. That boilerplate is not sufficient to establish a single fixed protocol identity or to merge this task with another protocol record.
Related records

Suggest a correction