Result

2.08 mean-absolute-error

pancotti2022-rosetta-s669 mean-absolute-error (S669, 669 direct variants)

Tested configuration: Rosetta (Pancotti et al. 2022)
Protocol: S669 direct and reverse ddG prediction (Pancotti et al. 2022 Table 1)
Dataset: S669: 669 single-point variants from ThermoMutDB in proteins under 25% identity to S2648 and VariBench, with reverse variants
Procedure: protein-stability-20261009-protocol-pancotti2022-s669
Evaluation: Rosetta on S669 (Pancotti et al. 2022)
Coverage: Not reported scored / Not reported eligible
Uncertainty: Not reported by the source
Evidence: Independent external evaluation · source checkedPredicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset · Table 1, row 'Rosetta', column 'Direct MAE'

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split: External test set
Adaptation: Not reported
Scoring implementation: Pearson r, RMSE and MAE between predicted and experimental ddG

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-10-10-6e93f504adfc
Property and statement	Original source and location	Review and provenance
Reported result 2.08 Individual claims	Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset Original source ↗ Table 1, row 'Rosetta', column 'Direct MAE' Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML Retrieved: 2026-10-09T21:00:42Z	source checked ["source-hash-verification","deterministic-table-parse","independent-cell-check"] · 2026-10-09 independent paper Audit details Extracted by deterministic parse of the table in the pinned JATS XML (extract/extract_protein_stability.py), with the caption, header rows and row labels asserted. printed_value is the cell text as printed, without footnote markers, which are kept in printed_source_cell. Independent review 2026-10-09: value and identity match the source. Field: `attributes.printed_value` Source artifact SHA-256: `132038084a57c060add54f152f68a69ccaf198337f86a5ec03d39496945c0024` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact Extraction artifact SHA-256: `132038084a57c060add54f152f68a69ccaf198337f86a5ec03d39496945c0024` Extraction artifact

All evidence (JSONL) (gzip)How to read the evidence

Sources and history

Release 2026-10-10-6e93f504adfc · Record review: source checked

1 source records and release history

Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset · Original source · Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: protein-stability-20261009-result-pancotti2022-rosetta-s669-direct-mae

metric: mean-absolute-error
metric direction: lower
unit: kilocalorie-per-mole
metric qualifier: S669, 669 direct variants
printed value: 2.08
numeric value: 2.08
source locator: Table 1, row 'Rosetta', column 'Direct MAE'
missing metadata: uncertainty: reason: unreported
review: method: source-hash-verification; deterministic-table-parse; independent-cell-check; method note: Re-downloaded the article XML and matched its SHA-256. Read the table with a separate parser (header rows, row labels, cell text with footnote markers); the extractor's script was not run. Checked printed and numeric value, footnote marker and warning, metric, qualifier, unit, direction and the linked configuration and protocol.; reviewer: claude; reviewer note: Separate Claude review agent, independent of the extractor; no human review claimed; date: 2026-10-09; artifact sha256: 132038084a57c060add54f152f68a69ccaf198337f86a5ec03d39496945c0024; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC8921618/fullTextXML; note: Extracted by deterministic parse of the table in the pinned JATS XML (extract/extract_protein_stability.py), with the caption, header rows and row labels asserted. printed_value is the cell text as printed, without footnote markers, which are kept in printed_source_cell. Independent review 2026-10-09: value and identity match the source.

Related records

evaluation: Rosetta on S669 (Pancotti et al. 2022)

Suggest a correction