Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset
Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML · Peer-reviewed
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- ACDC-NN: description: Description Neural-network predictor of the stability change on point mutation whose architecture is antisymmetric by construction, taking the amino acids neighbouring the mutation and multiple sequence alignments as input. (2 Materials and methods/2.2 Evaluated methods)
- Baseline: Assess methods for protein stability experiments: Baseline FoldX and Rosetta (protein-stability-20261009-source-pancotti2022: Methods (FoldX empirical force field, Rosetta energy difference); protein-stability-20261009-source-dieckhaus2024: Introduction (empirical energy functions historically) and Discussion (FoldX and Rosetta))
- DDGun: description: Description Untrained predictor that combines evolutionary information with statistical potentials in an antisymmetric linear score; the 3D version adds a structural statistical potential weighted by the accessibility of the mutated residue. (2 Materials and methods/2.2 Evaluated methods)
- DUET: description: Description Meta-predictor that combines the mCSM and SDM scores with a support vector machine. (2 Materials and methods/2.2 Evaluated methods)
- DynaMut: description: Description Consensus machine-learning predictor that combines the effects of a mutation on stability and on dynamics as computed by DUET, Bio3D and ENCoM. (2 Materials and methods/2.2 Evaluated methods)
- Evidence summary: protein variant stability prediction: Summary Three published comparisons add evidence beyond the AMFR assay. Each uses its own dataset, split and metric, so values cannot be pooled. Pancotti et al. 2022 ran 21 predictors on S669, 669 experimental ddG variants in proteins dissimilar to the main training sets, plus their reverse variants; several of the tools, including ACDC-NN, DDGun, INPS and I-Mutant, were developed by the paper's own authors. The highest Pearson correlation on direct variants was 0.5 (MAESTRO), but MAESTRO fell to 0.2 on reverse variants with a bias of -0.57, while tools built to be antisymmetric, such as INPS-Seq, kept 0.43 in both directions with a bias of 0. On all 1,338 variants the highest correlations were 0.62 (PremPS) and 0.61 (ACDC-NN and INPS-Seq). Dieckhaus et al. 2024, the ThermoMPNN developers, held out proteins clustered at 25% identity in the mega-scale proteolysis set: ThermoMPNN reached Pearson 0.75 and RMSE 0.71 kcal/mol, retrained RaSP 0.71 and Rosetta 0.53 with RMSE 5.18. On a homologue-free FireProtDB split ThermoMPNN reached 0.65 against 0.59 for retrained PROSTATA and 0.47 for retrained RaSP. Chu et al. 2024, the ESM therm developers, show the limit of transfer: on held-out mega-scale domains of 40 to 72 residues RaSP and ELASPIC-2 reached Spearman 0.64 and Rosetta 0.61, but on six single proteins of 177 to 501 residues their fine-tuned model scored between -0.11 and 0.06, while ELASPIC-2 scored 0.47 to 0.58 on five of them and Rosetta 0.33 to 0.49. Before choosing a method, a user still needs to validate transfer to proteins larger than the small domains these models were trained on, and to check antisymmetry on reverse variants, which only one of these comparisons tests across many tools. None of the comparisons covers the AMFR construct, and none establishes whole-protein function, fitness or pathogenicity. (protein-stability-20261009-source-pancotti2022: Section 2, Table 1; protein-stability-20261009-source-dieckhaus2024: Table 2; protein-stability-20261009-source-chu2024: Tables 1 and 2)
- FoldX: description: Description Empirical force-field method that predicts the effect of a point mutation from a linear combination of free-energy terms, including an entropy contribution, Van der Waals forces, hydrogen bonds and electrostatic interactions. (2 Materials and methods/2.2 Evaluated methods)
- I-Mutant: description: Description Support vector method with a radial-basis-function kernel over 42 features, including temperature, pH, an encoding of the mutation, and an encoding of the spatial residue environment where a structure is available or of the nearest sequence neighbours otherwise. (2 Materials and methods/2.2 Evaluated methods)
- INPS: description: Description Support vector method with a radial-basis-function kernel over BLOSUM62 substitution scores, the alignment-score difference between native and variant sequence, hydrophobicity and evolutionary information; the 3D version adds relative solvent accessibility and a structural statistical potential. (2 Materials and methods/2.2 Evaluated methods)
- MAESTRO: description: Description Multi-agent predictor based on statistical scoring functions, combining an ensemble of neural networks, support vector regressors and multiple linear regressors into a consensus model. (2 Materials and methods/2.2 Evaluated methods)
- mCSM: description: Description Predicts the effect of a point mutation on stability from graph-based structural signatures that encode the distance patterns between atoms in the residue environment. (2 Materials and methods/2.2 Evaluated methods)
- MUpro: description: Description Sequence-based support vector machine that encodes the residues in a window centred on the mutated position. (2 Materials and methods/2.2 Evaluated methods)
- PoPMuSiC: description: Description Energy-function method that combines 13 statistical potentials with volume-dependent terms for the wild-type and mutant amino acids, weighted by the solvent accessibility of the mutated residue. (2 Materials and methods/2.2 Evaluated methods)
- PremPS: description: Description Random-forest regression predictor that uses evolutionary and structure-based features, trained on a dataset with equal numbers of stabilising and destabilising mutations. (2 Materials and methods/2.2 Evaluated methods)
- Relevance of S669 direct and reverse ddG prediction (Pancotti et al. 2022) to "Assess methods for protein stability experiments": Assessed by S669 direct and reverse ddG prediction (Pancotti et al. 2022 Table 1) (protein-stability-20261009-source-pancotti2022: Table 1; Sections 2.1-2.3)
- Rosetta: description: Description Computes the stability change as the difference in Rosetta energy between the simulated wild-type and mutant structures. (2 Materials and methods/2.2 Evaluated methods)
- SAAFEC-SEQ: description: Description Gradient-boosting decision-tree predictor that uses physico-chemical properties, sequence features and evolutionary information. (2 Materials and methods/2.2 Evaluated methods)
- SDM: description: Description Statistical potential energy function that scores a mutation from environment-specific amino-acid substitution frequencies within homologous families, as a proxy for the free-energy difference between wild type and mutant. (2 Materials and methods/2.2 Evaluated methods)
- ThermoNet: description: Description Deep 3D convolutional network that predicts the stability change from multi-channel voxel grids of biophysical properties derived from atom coordinates. (2 Materials and methods/2.2 Evaluated methods)
Models, benchmarks and other records
Methods (16)
Configurations (21)
- ACDC-NN (Pancotti et al. 2022)
- ACDC-NN-Seq (Pancotti et al. 2022)
- DDGun (Pancotti et al. 2022)
- DDGun3D (Pancotti et al. 2022)
- DUET (Pancotti et al. 2022)
- Dynamut (Pancotti et al. 2022)
- Dynamut2 (Pancotti et al. 2022)
- FoldX (Pancotti et al. 2022)
- I-Mutant3.0 (Pancotti et al. 2022)
- I-Mutant3.0-Seq (Pancotti et al. 2022)
- INPS-Seq (Pancotti et al. 2022)
- INPS3D (Pancotti et al. 2022)
- MAESTRO (Pancotti et al. 2022)
- mCSM (Pancotti et al. 2022)
- MUpro (Pancotti et al. 2022)
- PoPMuSiC (Pancotti et al. 2022)
- PremPS (Pancotti et al. 2022)
- Rosetta (Pancotti et al. 2022)
- SAAFEC-SEQ (Pancotti et al. 2022)
- SDM (Pancotti et al. 2022)
- ThermoNet (Pancotti et al. 2022)
Protocols (1)
Datasets (1)
Evaluations (21)
- ACDC-NN on S669 (Pancotti et al. 2022)
- ACDC-NN-Seq on S669 (Pancotti et al. 2022)
- DDGun on S669 (Pancotti et al. 2022)
- DDGun3D on S669 (Pancotti et al. 2022)
- DUET on S669 (Pancotti et al. 2022)
- Dynamut on S669 (Pancotti et al. 2022)
- Dynamut2 on S669 (Pancotti et al. 2022)
- FoldX on S669 (Pancotti et al. 2022)
- I-Mutant3.0 on S669 (Pancotti et al. 2022)
- I-Mutant3.0-Seq on S669 (Pancotti et al. 2022)
- INPS-Seq on S669 (Pancotti et al. 2022)
- INPS3D on S669 (Pancotti et al. 2022)
- MAESTRO on S669 (Pancotti et al. 2022)
- mCSM on S669 (Pancotti et al. 2022)
- MUpro on S669 (Pancotti et al. 2022)
- PoPMuSiC on S669 (Pancotti et al. 2022)
- PremPS on S669 (Pancotti et al. 2022)
- Rosetta on S669 (Pancotti et al. 2022)
- SAAFEC-SEQ on S669 (Pancotti et al. 2022)
- SDM on S669 (Pancotti et al. 2022)
- ThermoNet on S669 (Pancotti et al. 2022)
Use cases (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
17 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 132038084a57c060add54f152f68a69ccaf198337f86a5ec03d39496945c0024 Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://www.ebi.ac.uk/europepmc/webservices/rest/PMC8921618/fullTextXML Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1093/bib/bbab555 Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-NC-4.0 Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/xml Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status peer_reviewed Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-09T21:00:42Z Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Url https://doi.org/10.1093/bib/bbab555 Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Primary source retrieved and hashed for the protein stability use-case pass. Source metadata | Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset No field-specific location recorded Version: Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
Primary source retrieved and hashed for the protein stability use-case pass.
Technical metadata and extraction receipts
Stable ID: protein-stability-20261009-source-pancotti2022
- areas
- proteins-complexes
- contexts
- research
- url
- https://doi.org/10.1093/bib/bbab555
- artifact url
- https://www.ebi.ac.uk/europepmc/webservices/rest/PMC8921618/fullTextXML
- version
- Briefings in Bioinformatics 23(2):bbab555, published 2022-01-11; PMC8921618 full-text XML
- retrieved at
- 2026-10-09T21:00:42Z
- artifact sha256
- 132038084a57c060add54f152f68a69ccaf198337f86a5ec03d39496945c0024
- doi
- 10.1093/bib/bbab555
- publication status
- peer_reviewed
- licence
- CC-BY-NC-4.0
- media type
- application/xml