rewirebio.iobenchmarks
Configuration

ERNIE-RNA

ERNIE-RNA is an RNA transformer that introduces base-pairing information into its attention mechanism.

SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Results/ERNIE-RNA learns functional and structural information through pre-training (paragraph 1); Methods/Model architecture (paragraph 1)

1 evaluation · 1 result

How it worksEvaluated procedure (conceptual)
Evaluated procedure (conceptual)1. RNA nucleotide sequences. Then: 2. ERNIE-RNA. Then: 3. RNA representations, attention-derived pairing information and downstream task predictionsEvaluated procedure (conceptual)1. RNA nucleotide sequences. Then: 2. ERNIE-RNA. Then: 3. RNA representations, attention-derived pairing information and downstream task predictionsEvaluated procedure (conceptual)1. RNA nucleotide sequences. Then: 2. ERNIE-RNA. Then: 3. RNA representations, attention-derived pairing information and downstream task predictions

Conceptual input–method–output guide. Check the procedure text and linked evaluation for fitted components, additional inputs and exact settings.

SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)

Overview

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Model Capabilities & Hardware Requirements

Deployment facts recorded for ERNIE-RNA. Fields the record does not carry are marked not recorded.

ParametersApproximately 86 million parameters
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowPretraining sequences are filtered to no more than 1,022…
AccessOfficial study implementation and usage documentation…
Code licenceMIT (study repository code at the cited revision; this does…

Evaluated Checkpoint: 86M

Evaluations and results

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ERNIE-RNATask: RNA secondary-structure prediction
Dataset: bpRNA-new
0.575 F1
fraction · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ERNIE-RNA: RNA secondary-structure prediction

zero-shot attention-derived base-pair prediction

Aggregation: Not reported

ERNIE-RNA: an RNA language model with structure-enhanced representations · Table 2, ERNIE-RNA zero-shot row, bpRNA-new F1-Score (binary) column

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Use this configuration

How it works, versions and access

How it works

How the evaluated method works

A modified BERT uses 12 transformer blocks, 12 attention heads and 768-dimensional token vectors. Base-pairing priors guide attention; downstream tasks use attention-derived structure estimates or adapted prediction heads.

SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)
What was evaluated

The linked evaluation record identifies ERNIE-RNA: RNA secondary-structure prediction. Its dataset, split, adaptation and evidence origin remain attached to the reported results.

SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · The named evaluation’s methods and comparison table; exact preserved evaluation IDs: evaluation-b2-ernie-rna-2025
Strengths, limitations and unresolved questions

Strengths and limitations

Limitations and conditions

  • The pretraining corpus is rich in rRNA and tRNA, and the paper explicitly examines composition bias; zero-shot and fine-tuned results represent different settings.
    SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Downstream tasks/RNA secondary structure prediction (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 3)
Profile review details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Stable record: reported-model-d023fbe78bc4df

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Inputs, outputs and configuration
PropertyDescription and evidence
Model typeTransformer representation pipeline; this record is the paper-specific evaluated configuration.
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)
Architecture / procedureA modified BERT uses 12 transformer blocks, 12 attention heads and 768-dimensional token vectors. Base-pairing priors guide attention; downstream tasks use attention-derived structure estimates or adapted prediction heads.
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)
Biological inputsRNA nucleotide sequences
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Training details (paragraph 1); Methods/RNA 3D closeness prediction (paragraph 1)
OutputsRNA representations, attention-derived pairing information and downstream task predictions
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Introduction (paragraph 6); Abstract (paragraph 1)
ParametersApproximately 86 million parameters
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/Model architecture (paragraph 1); Results/ERNIE-RNA learns functional and structural information through pre-training (paragraph 3)
Known versions / configuration86M
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Table Tab2 (paragraph 1); Table Tab1 (paragraph 1)
Training data / fitting20.4 million RNAcentral sequences after filtering and redundancy removal from an initial 34-million-sequence collection.
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Results/The architecture and pre-training of ERNIE-RNA (paragraph 2); Methods/Training dataset (paragraph 1)
Context limitsPretraining sequences are filtered to no more than 1,022 nucleotides, leaving room for special tokens.
SourcesERNIE-RNA: an RNA language model with structure-enhanced representations · Methods/RNA 3D closeness prediction (paragraph 2); Results/RNA contact map prediction (paragraph 1)
AccessOfficial study implementation and usage documentation: https://github.com/Bruce-ywj/ERNIE-RNA/blob/43bc06de1088ed03ffd7de918ad4b2c2a3346a43/README.md. This pinned documentation revision is not automatically the evaluated weight revision.
SourcesBruce-ywj/ERNIE-RNA README.md · README.md; installation, model download and usage instructions
Code licenceMIT (study repository code at the cited revision; this does not establish every dependency or historical checkpoint licence).
SourcesBruce-ywj/ERNIE-RNA LICENSE · LICENSE; complete licence text
Weights licenceThe inspected model-access documentation does not explicitly identify terms for this exact evaluated checkpoint or fitted head; repository code terms are shown separately. · Not reported in inspected sources
SourcesBruce-ywj/ERNIE-RNA README.md · README.md; checkpoint/access documentation and licence scope

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual input–method–output guide. Check the procedure text and linked evaluation for fitted components, additional inputs and exact settings.
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • RNA nucleotide sequences
  • ERNIE-RNA
  • RNA representations, attention-derived pairing information and downstream task predictions
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Evaluated procedure (conceptual)
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.diagram.title

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Model type
Transformer representation pipeline; this record is the paper-specific evaluated configuration.
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Architecture / procedure
A modified BERT uses 12 transformer blocks, 12 attention heads and 768-dimensional token vectors. Base-pairing priors guide attention; downstream tasks use attention-derived structure estimates or adapted prediction heads.
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Model architecture (paragraph 1); Results/The architecture and pre-training of ERNIE-RNA (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Weights licence
The inspected model-access documentation does not explicitly identify terms for this exact evaluated checkpoint or fitted head; repository code terms are shown separately.
Individual claims
Bruce-ywj/ERNIE-RNA README.md

Original source ↗

README.md; checkpoint/access documentation and licence scope

Version: 43bc06de1088ed03ffd7de918ad4b2c2a3346a43
Retrieved: 2026-09-16T19:54:15.083678+00:00

unreported

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: d2b2ca2f33c4d4d1dac63659cff494631732b7ec87ac07ad99a0826e55bfa603

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Biological inputs
RNA nucleotide sequences
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Training details (paragraph 1); Methods/RNA 3D closeness prediction (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Outputs
RNA representations, attention-derived pairing information and downstream task predictions
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Introduction (paragraph 6); Abstract (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Parameters
Approximately 86 million parameters
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Methods/Model architecture (paragraph 1); Results/ERNIE-RNA learns functional and structural information through pre-training (paragraph 3)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Known versions / configuration
86M
Individual claims
ERNIE-RNA: an RNA language model with structure-enhanced representations

Original source ↗

Table Tab2 (paragraph 1); Table Tab1 (paragraph 1)

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558206+00:00

source checked

automated source review · 2026-09-16

Audit details

Primary full text and the available official implementation/model documentation were inspected. Explanatory claims are source-backed; unresolved exact-configuration metadata is labelled explicitly. This is automated review, not a human review or independent benchmark reproduction.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: 0bd1d4b3cbf5d59d452cec4864614947861efcee050ba07e7de395cd90630047

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: needs review

3 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID reported-model-d023fbe78bc4df.

Related records

How to cite

ERNIE-RNA. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/reported-model-d023fbe78bc4df/

Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction