One minus overlap ratio (FFT embedding; mean over random samplings of sequence pairs) of ERNIE-RNA (zero-shot, Wang et al. 2026) on RfamSample (561 Rfam families) (Wang et al. 2026)
0.858±0.001 One minus overlap ratio (FFT embedding; mean over random samplings of sequence pairs)
Methods
- Tested configuration
- ERNIE-RNA (zero-shot, Wang et al. 2026)
- Protocol
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), FFT embedding, 1 − OR (mean over repeated random samplings of sequence pairs)
- Dataset
- RfamSample (561 Rfam families) (Wang et al. 2026)
- Procedure
- Wang et al. 2026 zero-shot family classification, RfamSample (561 Rfam families), FFT embedding, 1 − OR (mean over repeated random samplings of sequence pairs)
- Evaluation
- ERNIE-RNA zero-shot family classification on RfamSample (561 Rfam families) (FFT embedding, 1 − OR, sampled-mean)
- Coverage
- Not reported scored / Not reported eligible
- Uncertainty
- SD 0.001
- Evidence
- Independent external evaluation · source checkedZero-shot benchmarking of RNA language models: Supplementary Information; Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning · Supplementary Table 6, row 'ERNIE-RNA', column '1 − OR'
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.
Reproduction
- Split
- Whole dataset (zero-shot)
- Adaptation
- Zero-shot: cosine similarity of FFT-reduced last-hidden-state embeddings
- Scoring implementation
- 1 − OR
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
2 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result 0.858±0.001 Individual claims | Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning Supplementary Table 6, row 'ERNIE-RNA', column '1 − OR' Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Briefings in Bioinformatics 2026, bbag098 (issue date 2026-03-01); PMC12963973 full-text XML | source checked ["source-hash-verification","deterministic-table-parse","independent-cell-check"] · 2026-10-12 independent paper Audit detailsExtraction: Parsed the table cells (w:tc runs) of word/document.xml in the pinned supplementary .docx with extract/extract_rnalm_zeroshot.py; row label and column header taken from the same table. Supplementary Table 6 body row 39. Independent review 2026-10-12: value, locator, metric, unit, direction and linked configuration and protocol checked. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: |
| Reported result 0.858±0.001 Individual claims | Zero-shot benchmarking of RNA language models: Supplementary Information Supplementary Table 6, row 'ERNIE-RNA', column '1 − OR' Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973 | source checked ["source-hash-verification","deterministic-table-parse","independent-cell-check"] · 2026-10-12 independent paper Audit detailsExtraction: Parsed the table cells (w:tc runs) of word/document.xml in the pinned supplementary .docx with extract/extract_rnalm_zeroshot.py; row label and column header taken from the same table. Supplementary Table 6 body row 39. Independent review 2026-10-12: value, locator, metric, unit, direction and linked configuration and protocol checked. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
2 source records and release history
- Zero-shot benchmarking of RNA language models: Supplementary Information · Original source · bbag098_supplymentary_information_20260209.docx from the Europe PMC supplementary files archive for PMC12963973
- Zero-shot benchmarking of RNA language models in structural, functional, and evolutionary learning · Original source · Briefings in Bioinformatics 2026, bbag098 (issue date 2026-03-01); PMC12963973 full-text XML
Technical metadata and extraction receipts
Stable ID: lit-rna-20261011-rnalm-zeroshot-result-ernie-rna-default-t6-1-or-sampled-mean
- metric
- one-minus-overlap-ratio
- metric direction
- higher
- unit
- unitless
- printed value
- 0.858±0.001
- source locator
- Supplementary Table 6, row 'ERNIE-RNA', column '1 − OR'
- review
- method: source-hash-verification; deterministic-table-parse; independent-cell-check; method note: Re-fetched the Europe PMC supplementary archive; the .docx inside matched its SHA-256. An independent w:tc parse of Supplementary Tables 4-11 matched all 1190 printed values, numeric values, standard deviations and locators; 48 cells were also checked by hand against a textutil rendering.; reviewer: claude; reviewer note: Claude review agent reviewer-ro-1, independent of the extractor lit-rna-otheromics; no human review claimed; date: 2026-10-12; artifact sha256: c8fc78c3d8538c9431fc0448a4068a7643dfb7d74558877fd40b36feba71e214; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12963973/supplementaryFiles; note: Extraction: Parsed the table cells (w:tc runs) of word/document.xml in the pinned supplementary .docx with extract/extract_rnalm_zeroshot.py; row label and column header taken from the same table. Supplementary Table 6 body row 39. Independent review 2026-10-12: value, locator, metric, unit, direction and linked configuration and protocol checked.
- numeric value
- 0.858
- metric qualifier
- FFT embedding; mean over random samplings of sequence pairs
- uncertainty
- type: standard_deviation; value: 0.001; center: 0.858; printed: 0.858±0.001; scope: across random samplings of sequence pairs