RhoFold+ 2024 CASP15 natural RNA comparison evaluation of Alchemy_RNA (RhoFold) on R1107: RMSD, scored with RMSD.
These checks assess whether the evidence supports a reproducible investigation. A source-checked score alone does not meet these requirements.
Release 2026-09-29-06401fd5b220 · Evidence verified: Not verified
Exact outcomes, predictions, identifiers and evaluator are connected.
Missing or unresolved evidence
Verified: Not verified
Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.
Missing or unresolved evidence
Verified: Not verified
A pinned recipe describes the inputs, environment and resource requirements.
Missing or unresolved evidence
Verified: Not verified
Separate data and exposure records support an independent test.
Missing or unresolved evidence
Verified: Not verified
Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.
No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.
1 evaluation · 1 result. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Alchemy_RNA (RhoFold) | Protocol: RhoFold+ 2024 CASP15 natural RNA comparison R1107-rmsd: R1107: RMSD Dataset subset: CASP15 natural RNA target R1107 (RhoFold+ 2024 CASP15 natural RNA comparison split) | 5.92 Å rmsd angstrom · lower Uncertainty: Not reported Coverage: unit: CASP15 natural RNA target; scored: 1; eligible: 1; note: Per-cell target count; source retains up to five candidate structures, not five independent evaluation targets. | Result quoted from another source · Source checkedMethods, coverage and sourceAlchemy_RNA (RhoFold) on RhoFold+ 2024 CASP15 natural RNA comparison R1107-rmsd: R1107: RMSD Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation. Aggregation: Source-reported selected candidate for one target; no cross-target aggregation. RhoFold+ Nature Methods 2024: Source Data Figure 2h · fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 |
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation.
Metadata review: source checked. Unreported conditions prevent automatic comparisons.
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.adaptation Source-labelled five-candidate CASP15 configuration; fine-tuning and exact checkpoints not established. No additional adaptation inferred. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.candidate_budget 5 Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.candidate_selection Highest-performing candidate as described in Par13; metric-specific candidate identity unreported. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.comparison.metric_implementation RMSD Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.comparison.protocol_id rhofold-2024-casp15-natural-task-r1107-rmsd Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.count_unit RNA target Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.evaluation_group_id rhofold-2024-casp15-natural-method-alchemy-rna-rhofold-rhofold-2024-casp15-natural-dataset-casp15-natural-rna-target-r1107-evaluation-setup Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.evidence_overlap Twelve per-target/metric observations per complete method belong to one six-target comparison setup. RMSD and cumulative Z-score reuse candidate predictions; CASP15 submissions quoted here are not new independent evidence. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.origin paper_compilation Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.protocol Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!B7; method fig2hi!A7; target fig2hi!B1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: source checked
Stable ID: rhofold-2024-casp15-natural-evaluation-alchemy-rna-rhofold-r1107-rmsd