rewirebio.iobenchmarks
Configuration

mRNABERT

mRNABERT models complete mRNA sequences using dual tokenisation and protein-linked contrastive learning.

SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Abstract (paragraph 1); Results/Overview of mRNABERT and benchmarks (paragraph 3)

1 evaluation · 1 result

How it worksEvaluated procedure (conceptual)
Evaluated procedure (conceptual)1. mRNA sequences. Then: 2. mRNABERT. Then: 3. mRNA representations and task-specific design/property predictionsEvaluated procedure (conceptual)1. mRNA sequences. Then: 2. mRNABERT. Then: 3. mRNA representations and task-specific design/property predictionsEvaluated procedure (conceptual)1. mRNA sequences. Then: 2. mRNABERT. Then: 3. mRNA representations and task-specific design/property predictions

Conceptual input–method–output guide. Check the procedure text and linked evaluation for fitted components, additional inputs and exact settings.

SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Abstract (paragraph 1); Methods/Model training (paragraph 3)

Overview

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Model Capabilities & Hardware Requirements

Deployment facts recorded for mRNABERT. Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowThis catalogue row is explicitly the 3,066-nt input…
AccessOfficial study implementation and usage documentation…
Code licenceApache 2.0 (study repository code at the cited revision…

Evaluated Checkpoint: 3066-nt input

Evaluations and results

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: mRNABERTTask: translation-efficiency prediction
Dataset: human ultra-long mRNAs
0.669 R²
unitless · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

mRNABERT: translation-efficiency prediction

human translation-efficiency regression at 3066-nt input

Aggregation: Not reported

mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Table 2, mRNABERT (3066) row, Human R-squared column

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Use this configuration

How it works, versions and access

How it works

How the evaluated method works

The framework combines an mRNA language model with a cross-modality contrastive objective that incorporates information from corresponding protein sequences.

SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Abstract (paragraph 1); Methods/Model training (paragraph 3)
What was evaluated

The linked evaluation record identifies mRNABERT: translation-efficiency prediction. Its dataset, split, adaptation and evidence origin remain attached to the reported results.

SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · The named evaluation’s methods and comparison table; exact preserved evaluation IDs: evaluation-b2-mrnabert-2025
Strengths, limitations and unresolved questions

Strengths and limitations

Profile review details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Stable record: reported-model-13bd2a6c2d8178

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Inputs, outputs and configuration
PropertyDescription and evidence
Model typeStudy-specific predictive method; this record is the paper-specific evaluated configuration.
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Abstract (paragraph 1); Methods/Model training (paragraph 3)
Architecture / procedureThe framework combines an mRNA language model with a cross-modality contrastive objective that incorporates information from corresponding protein sequences.
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Abstract (paragraph 1); Methods/Model training (paragraph 3)
Biological inputsmRNA sequences; protein correspondence supplies additional information during training
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Results/Applying mRNABERT to protein engineering tasks (paragraph 5); Results/Evaluating mRNABERT on CDS prediction tasks (paragraph 1)
OutputsmRNA representations and task-specific design/property predictions
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Results/Predicting splice sites and alternative polyadenylation (paragraph 5); Discussion (paragraph 4)
ParametersTwelve transformer layers with hidden width 768 are specified. The inspected architecture section does not give a complete parameter total. · Not reported in inspected sources
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Methods/Model architecture (paragraph 1); Methods/Model evaluation (paragraph 2)
Known versions / configuration3066-nt input
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Results/Evaluating the applicability using full-length mRNA sequences (paragraph 5); Table Tab2 (paragraph 1)
Training data / fittingApproximately 36 million mature mRNAs were collected from NCBI nt, MG-RAST, GWH and MGnify, then filtered to approximately 18 million unique sequences for the curated corpus.
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Methods/Training datasets/Database construction and data collection (paragraph 2); Methods/Training datasets/Pre-processing the data (paragraph 2)
Context limitsThis catalogue row is explicitly the 3,066-nt input configuration.
SourcesmRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset · Results/Overview of mRNABERT and benchmarks (paragraph 2); Results/Capturing multi-dimensional biological information of mRNA (paragraph 3)
AccessOfficial study implementation and usage documentation: https://github.com/yyly6/mRNABERT/blob/893ccc920bb9be02a4677d14d96b03126da17689/README.md. This pinned documentation revision is not automatically the evaluated weight revision.
Sourcesyyly6/mRNABERT README.md · README.md; installation, model download and usage instructions
Code licenceApache 2.0 (study repository code at the cited revision; this does not establish every dependency or historical checkpoint licence).
Sourcesyyly6/mRNABERT LICENSE · LICENSE; complete licence text
Weights licenceThe inspected model-access documentation does not explicitly identify terms for this exact evaluated checkpoint or fitted head; repository code terms are shown separately. · Not reported in inspected sources
Sourcesyyly6/mRNABERT README.md · README.md; checkpoint/access documentation and licence scope

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual input–method–output guide. Check the procedure text and linked evaluation for fitted components, additional inputs and exact settings.
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Abstract (paragraph 1); Methods/Model training (paragraph 3)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • mRNA sequences
  • mRNABERT
  • mRNA representations and task-specific design/property predictions
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Abstract (paragraph 1); Methods/Model training (paragraph 3)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Evaluated procedure (conceptual)
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Abstract (paragraph 1); Methods/Model training (paragraph 3)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.diagram.title

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Model type
Study-specific predictive method; this record is the paper-specific evaluated configuration.
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Abstract (paragraph 1); Methods/Model training (paragraph 3)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Architecture / procedure
The framework combines an mRNA language model with a cross-modality contrastive objective that incorporates information from corresponding protein sequences.
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Abstract (paragraph 1); Methods/Model training (paragraph 3)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Weights licence
The inspected model-access documentation does not explicitly identify terms for this exact evaluated checkpoint or fitted head; repository code terms are shown separately.
Individual claims
yyly6/mRNABERT README.md

Original source ↗

README.md; checkpoint/access documentation and licence scope

Version: 893ccc920bb9be02a4677d14d96b03126da17689
Retrieved: 2026-09-16T19:54:19.395631+00:00

unreported

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: bd50f1d7a71b1fd265b8b4c5590358d9bdabc4b6d897cd3b2ec6ba7ad5f7d2ff

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Biological inputs
mRNA sequences; protein correspondence supplies additional information during training
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Results/Applying mRNABERT to protein engineering tasks (paragraph 5); Results/Evaluating mRNABERT on CDS prediction tasks (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Outputs
mRNA representations and task-specific design/property predictions
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Results/Predicting splice sites and alternative polyadenylation (paragraph 5); Discussion (paragraph 4)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Parameters
Twelve transformer layers with hidden width 768 are specified. The inspected architecture section does not give a complete parameter total.
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Methods/Model architecture (paragraph 1); Methods/Model evaluation (paragraph 2)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

unreported

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Known versions / configuration
3066-nt input
Individual claims
mRNABERT: advancing mRNA sequence design with a universal language model and comprehensive dataset

Original source ↗

Results/Evaluating the applicability using full-length mRNA sequences (paragraph 5); Table Tab2 (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558216+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: ff08ba895b7080446c08a930548b48a0041ae990c222ebb07e6ba7dcaf48ad44

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: needs review

3 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID reported-model-13bd2a6c2d8178.

Related records

How to cite

mRNABERT. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/reported-model-13bd2a6c2d8178/

Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction