rewirebio.iobenchmarks
Result

Casp sum z score of UltraFold on CASP15 natural RNA target R1107 (RhoFold+ 2024 CASP15 natural RNA comparison split)

2.33 Casp sum z score

Methods

Tested configuration
UltraFold
Protocol
RhoFold+ 2024 CASP15 natural RNA comparison R1107-sum_z_gdt_ts_tm_score: R1107: Sum of Z-scores for GDT-TS and TM-score
Dataset subset
CASP15 natural RNA target R1107 (RhoFold+ 2024 CASP15 natural RNA comparison split)
Procedure
Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation.
Evaluation
UltraFold on RhoFold+ 2024 CASP15 natural RNA comparison R1107-sum_z_gdt_ts_tm_score: R1107: Sum of Z-scores for GDT-TS and TM-score
Coverage
1/1 CASP15 natural RNA target scored (Per-cell target count; source retains up to five candidate structures, not five independent evaluation targets.)
Uncertainty
Not yet extracted
Evidence
Result quoted from another source · source checkedRhoFold+ Nature Methods 2024: Source Data Figure 2h · fig2hi!H6; method fig2hi!A6; target fig2hi!H1; Fig. 2h caption; XML Par13–15 and Par51

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
Not reported
Adaptation
Not reported
Scoring implementation
Sum of Z-scores for GDT-TS and TM-score

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Reported result
2.33
Individual claims
RhoFold+ Nature Methods 2024: Source Data Figure 2h

Original source ↗

fig2hi!H6; method fig2hi!A6; target fig2hi!H1; Fig. 2h caption; XML Par13–15 and Par51

Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23
Retrieved: 2026-09-23T11:23:43.985240+00:00

source checked

["deterministic-table-parse","scope-review","source-hash-verification"] · 2026-09-23

paper compilation

Audit details

Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.

Field: attributes.printed_value

Source artifact SHA-256: 9d87837d6e72c8dafd265b9427c1cddd0223b3073eea26bcb4c6a90085a1bb04

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Extraction artifact SHA-256: 9d87837d6e72c8dafd265b9427c1cddd0223b3073eea26bcb4c6a90085a1bb04

Extraction artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rhofold-2024-casp15-natural-result-ultrafold-r1107-sum-z-gdt-ts-tm-score-sum-z-gdt-ts-tm-score

areas
rna-transcriptomes
tasks
R1107: Sum of Z-scores for GDT-TS and TM-score
metric
casp-sum-z-score
metric direction
higher
unit
unitless
printed value
2.33
numeric value
2.33
source locator
fig2hi!H6; method fig2hi!A6; target fig2hi!H1; Fig. 2h caption; XML Par13–15 and Par51
missing metadata
denominator: reason: unextracted; seeds: reason: unreported; uncertainty: reason: unextracted
review
method: deterministic-table-parse; scope-review; source-hash-verification; reviewer: codex; date: 2026-09-23; artifact sha256: 9d87837d6e72c8dafd265b9427c1cddd0223b3073eea26bcb4c6a90085a1bb04; retrieval url: https://media.springernature.com/original/springer-static/esm/art%3A10.1038%2Fs41592-024-02487-0/MediaObjects/41592_2024_2487_MOESM4_ESM.xlsx; method note: complete OOXML sheet; exact raw cell tokens; shared-string decoding; worksheet relationships; primary caption and methods verified; source hash verified; no graph digitization or numerical recomputation; reviewer note: role: automated source review; note: Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.
aggregation
Source-reported selected candidate for one target; no cross-target aggregation.
coverage
unit: CASP15 natural RNA target; scored: 1; eligible: 1; note: Per-cell target count; source retains up to five candidate structures, not five independent evaluation targets.
Related records

Suggest a correction