rewirebio.iobenchmarks
Source

BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

arXiv preprint · v2, 12 December 2024

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
BEACON-BR²70.59(0.91) unitlessAPARENT (BEACON split)BEACON-B on BEACON APA: Alternative polyadenylation isoform prediction
BEACON-BPrecision at l60.81(1.70) percentRNAcontact (BEACON split)BEACON-B on BEACON CMP: Contact map prediction
BEACON-BSpearman4.42(0.33) unitlessDeepCRISPR (BEACON split)BEACON-B on BEACON CRI-Off: CRISPR off-target effect prediction
BEACON-BSpearman26.01(1.81) unitlessDeepCRISPR (BEACON split)BEACON-B on BEACON CRI-On: CRISPR on-target efficiency prediction
BEACON-BR²56.28(0.41) unitlessRNAcontact (BEACON split)BEACON-B on BEACON DMP: Distance map prediction
BEACON-BAUROC94.74(0.20) unitlessMultiRM (BEACON split)BEACON-B on BEACON Modif: RNA modification site prediction
BEACON-BR²72.29(0.28) unitlessOptimus (BEACON split)BEACON-B on BEACON MRL: Mean ribosome loading prediction
BEACON-BAccuracy94.63(0.16) percentNoorul's ncRNA set (BEACON split)BEACON-B on BEACON ncRNA: Non-coding RNA family classification
BEACON-BR²54.67(0.36) unitlessAngenent-Mari's switch set (BEACON split)BEACON-B on BEACON PRS: Programmable RNA switch prediction
BEACON-BSplice top k accuracy37.43(1.43) percentSpliceAI (BEACON split)BEACON-B on BEACON SPL: Splice site prediction
BEACON-BR²38.78(0.18) unitlessStructureImpute (BEACON split)BEACON-B on BEACON SSI: Structure score imputation
BEACON-BF1 (base pairs; binary F1 over all position pairs pooled across the test set; threshold 0.5)64.18(0.44) percentbpRNA-1m (BEACON split)BEACON-B on BEACON SSP: Secondary structure prediction
BEACON-BMean columnwise RMSE0.320(0.001) unit-unreportedOpenVaccine (BEACON split)BEACON-B on BEACON VDP: Vaccine degradation prediction
BEACON-B512R²72.00(0.17) unitlessAPARENT (BEACON split)BEACON-B512 on BEACON APA: Alternative polyadenylation isoform prediction
BEACON-B512Precision at l61.20(2.11) percentRNAcontact (BEACON split)BEACON-B512 on BEACON CMP: Contact map prediction
BEACON-B512Spearman3.82(1.04) unitlessDeepCRISPR (BEACON split)BEACON-B512 on BEACON CRI-Off: CRISPR off-target effect prediction
BEACON-B512Spearman28.17(1.81) unitlessDeepCRISPR (BEACON split)BEACON-B512 on BEACON CRI-On: CRISPR on-target efficiency prediction
BEACON-B512R²56.82(0.63) unitlessRNAcontact (BEACON split)BEACON-B512 on BEACON DMP: Distance map prediction
BEACON-B512AUROC94.92(0.07) unitlessMultiRM (BEACON split)BEACON-B512 on BEACON Modif: RNA modification site prediction
BEACON-B512R²72.35(0.28) unitlessOptimus (BEACON split)BEACON-B512 on BEACON MRL: Mean ribosome loading prediction
BEACON-B512Accuracy94.99(0.21) percentNoorul's ncRNA set (BEACON split)BEACON-B512 on BEACON ncRNA: Non-coding RNA family classification
BEACON-B512R²55.20(0.26) unitlessAngenent-Mari's switch set (BEACON split)BEACON-B512 on BEACON PRS: Programmable RNA switch prediction
BEACON-B512Splice top k accuracy37.24(1.09) percentSpliceAI (BEACON split)BEACON-B512 on BEACON SPL: Splice site prediction
BEACON-B512R²39.13(0.08) unitlessStructureImpute (BEACON split)BEACON-B512 on BEACON SSI: Structure score imputation
BEACON-B512F1 (base pairs; binary F1 over all position pairs pooled across the test set; threshold 0.5)58.75(3.72) percentbpRNA-1m (BEACON split)BEACON-B512 on BEACON SSP: Secondary structure prediction
BEACON-B512Mean columnwise RMSE0.320(0.001) unit-unreportedOpenVaccine (BEACON split)BEACON-B512 on BEACON VDP: Vaccine degradation prediction
CNNR²50.93(0.17) unitlessAPARENT (BEACON split)CNN on BEACON APA: Alternative polyadenylation isoform prediction
CNNPrecision at l43.89(5.53) percentRNAcontact (BEACON split)CNN on BEACON CMP: Contact map prediction
CNNSpearman11.40(0.10) unitlessDeepCRISPR (BEACON split)CNN on BEACON CRI-Off: CRISPR off-target effect prediction
CNNSpearman29.69(2.52) unitlessDeepCRISPR (BEACON split)CNN on BEACON CRI-On: CRISPR on-target efficiency prediction
CNNR²27.76(5.00) unitlessRNAcontact (BEACON split)CNN on BEACON DMP: Distance map prediction
CNNAUROC70.87(0.40) unitlessMultiRM (BEACON split)CNN on BEACON Modif: RNA modification site prediction
CNNR²74.13(0.58) unitlessOptimus (BEACON split)CNN on BEACON MRL: Mean ribosome loading prediction
CNNAccuracy88.62(0.71) percentNoorul's ncRNA set (BEACON split)CNN on BEACON ncRNA: Non-coding RNA family classification
CNNR²45.40(0.66) unitlessAngenent-Mari's switch set (BEACON split)CNN on BEACON PRS: Programmable RNA switch prediction
CNNSplice top k accuracy8.43(0.38) percentSpliceAI (BEACON split)CNN on BEACON SPL: Splice site prediction
CNNR²34.36(0.12) unitlessStructureImpute (BEACON split)CNN on BEACON SSI: Structure score imputation
CNNF1 (base pairs; binary F1 over all position pairs pooled across the test set; threshold 0.5)49.95(0.82) percentbpRNA-1m (BEACON split)CNN on BEACON SSP: Secondary structure prediction
CNNMean columnwise RMSE0.361(0.003) unit-unreportedOpenVaccine (BEACON split)CNN on BEACON VDP: Vaccine degradation prediction
LSTMR²67.03(0.86) unitlessAPARENT (BEACON split)LSTM on BEACON APA: Alternative polyadenylation isoform prediction
LSTMPrecision at l40.41(1.67) percentRNAcontact (BEACON split)LSTM on BEACON CMP: Contact map prediction
LSTMSpearman8.60(0.13) unitlessDeepCRISPR (BEACON split)LSTM on BEACON CRI-Off: CRISPR off-target effect prediction
LSTMSpearman26.83(1.32) unitlessDeepCRISPR (BEACON split)LSTM on BEACON CRI-On: CRISPR on-target efficiency prediction
LSTMR²44.77(0.47) unitlessRNAcontact (BEACON split)LSTM on BEACON DMP: Distance map prediction
LSTMAUROC94.83(0.31) unitlessMultiRM (BEACON split)LSTM on BEACON Modif: RNA modification site prediction
LSTMR²83.94(0.08) unitlessOptimus (BEACON split)LSTM on BEACON MRL: Mean ribosome loading prediction
LSTMAccuracy88.78(0.10) percentNoorul's ncRNA set (BEACON split)LSTM on BEACON ncRNA: Non-coding RNA family classification
LSTMR²55.45(0.71) unitlessAngenent-Mari's switch set (BEACON split)LSTM on BEACON PRS: Programmable RNA switch prediction
LSTMSplice top k accuracy36.66(1.83) percentSpliceAI (BEACON split)LSTM on BEACON SPL: Splice site prediction
LSTMR²35.44(1.13) unitlessStructureImpute (BEACON split)LSTM on BEACON SSI: Structure score imputation

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Methods (3)

Configurations (14)

Tasks (13)

Dataset subsets (11)

Evaluations (221)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

13 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://arxiv.org/pdf/2406.10391
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-18
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://arxiv.org/abs/2406.10391
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Venue
arXiv preprint
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: attributes.venue

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
v2, 12 December 2024
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Pinned primary artifact. Review is limited to the cited tables and rows.
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Facets: areas
1 values
  • rna-transcriptomes
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: facets.areas

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record ID
source-beacon-arxiv-2406-10391
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: id

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record type
source
Source metadata
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models (arXiv:2406.10391v2)

Original source ↗

No field-specific location recorded

Version: v2, 12 December 2024
Retrieved: 2026-09-18

catalogued

No individual claim review recorded

Audit details

Field: kind

Source artifact SHA-256: 1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Pinned primary artifact. Review is limited to the cited tables and rows.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: source-beacon-arxiv-2406-10391

areas
rna-transcriptomes
url
https://arxiv.org/abs/2406.10391
artifact url
https://arxiv.org/pdf/2406.10391
artifact sha256
1370d75fe591bb8f994bc67f100a1a3fd557a62b9edb962b21f2fb038e9dea16
retrieved at
2026-09-18
venue
arXiv preprint
version
v2, 12 December 2024
Related records

    Suggest a correction