Model type
Structure-conditioned message-passing sequence design model
ProteinMPNN designs amino-acid sequences for a supplied protein backbone.
Conceptual summary of the documented data flow; optional inputs and configured downstream stages must be reported for a reproducible evaluation.
Structure-conditioned message-passing sequence design model
Protein backbone coordinates, with optional fixed residues, chain choices, tied positions and amino-acid constraints.
Designed sequences, sequence scores and conditional amino-acid probabilities.
Official project documentation and implementation: https://github.com/dauparas/ProteinMPNN
limited source coverage · Automated source review, 2026-09-16. All specifications and missing details
1 evaluation · 5 results. Different protocols are not a single leaderboard.
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: ProteinMPNN | Task: ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.639 auc fraction · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceProteinMPNN on ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ProteinMPNN), column(Zero-shot substitutions, AUC) |
| Configuration: ProteinMPNN | Task: ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.196 mcc correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceProteinMPNN on ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ProteinMPNN), column(Zero-shot substitutions, MCC) |
| Configuration: ProteinMPNN | Task: ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.713 ndcg fraction · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceProteinMPNN on ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ProteinMPNN), column(Zero-shot substitutions, NDCG@10%) |
| Configuration: ProteinMPNN | Task: ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.186 recall fraction · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceProteinMPNN on ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ProteinMPNN), column(Zero-shot substitutions, top 10% recall) |
| Configuration: ProteinMPNN | Task: ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) | 0.258 spearman correlation · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceProteinMPNN on ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Aggregation: Not reported ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(ProteinMPNN), column(Zero-shot substitutions, Spearman) |
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
Related profile: ProteinMPNN. This page retains the exact record and its evaluation context.
Fitness prediction model evaluated by the ProteinGym authors under their harness.
ProteinMPNN converts a supplied backbone into a graph whose edges encode interatomic distances. Message-passing layers update node and edge features, and an autoregressive decoder samples amino acids while conditioning on the backbone and previously assigned residues. Fixed residues, tied positions and chain choices change the design task and must accompany its result.
v_48_002, v_48_010, v_48_020 and v_48_030; distinct soluble and C-alpha-only weights. Structure-size and memory dependent. README --max_length is an implementation guard, not a validated scientific context limit.
Inspected pinned official documentation, relevant implementation files and named primary-paper sections. Claims are limited to those artifacts. Remaining field extraction and identity conflicts are explicit; no new performance claims, model runs or human review are implied.
Stable record: discovery-model-proteinmpnnExplanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Structure-conditioned message-passing sequence design modelSources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Architecture | Message-passing encoder-decoder with structural interatomic-distance features and edge updates; sequences are sampled with the configured autoregressive decoding procedure.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Inputs | Protein backbone coordinates, with optional fixed residues, chain choices, tied positions and amino-acid constraints.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Outputs | Designed sequences, sequence scores and conditional amino-acid probabilities.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Parameters | The inspected model implementation is configured through encoder/decoder depth and feature width. The paper and training README do not state an exact total for every released checkpoint. · Not reported in inspected sourcesSources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Known versions | v_48_002, v_48_010, v_48_020 and v_48_030; distinct soluble and C-alpha-only weights.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Training data | Released multi-chain training set of PDB biological units, with chain metadata and validation/test cluster manifests. The documented set is dated 2 August 2021.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Training cutoff | The released PDB training-set snapshot is dated 2021-08-02; preserve its chain-level deposition metadata and cluster split for a run.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Context limits | Structure-size and memory dependent. README --max_length is an implementation guard, not a validated scientific context limit.Sources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Weights licence | Separate checkpoint-distribution terms are not stated in the inspected release documentation and licence material. The source-code licence alone is not recorded as an explicit weight grant. · Not reported in inspected sourcesSources (6)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive; dauparas/ProteinMPNN: LICENSE · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data; LICENSE: licence text |
| Access | Official project documentation and implementation: https://github.com/dauparas/ProteinMPNNSources (5)dauparas/ProteinMPNN: README.md; dauparas/ProteinMPNN: training/README.md; dauparas/ProteinMPNN: protein_mpnn_utils.py; proteinmpnn: Journal full-text XML; proteinmpnn-supp: Publisher supplementary archive · ProteinMPNN paper: main-text model development; training/README.md: multi-chain training set, list.csv and cluster manifests; protein_mpnn_utils.py: ProteinMPNN; Supplementary Materials: Methods for training multi-chain models / Training data |
| Code licence | MITSourcesdauparas/ProteinMPNN: LICENSE · LICENSE: licence text |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Relationship: family discovery-model-proteinmpnn Individual claims | ProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design Section 4.1 Zero-shot benchmarks; Table 2 named model row Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | source checked automated source review · 2026-09-23 Audit detailsSource review establishes this relationship only. Exact evaluated configurations and original numerical review status remain unchanged. The primary table and baseline descriptions identify the evaluated family. ESM-1v remains an ensemble; ESM-2 remains 15B; inverse-folding conditions remain distinct. Field: Claim: model-evaluation-identity-a15c945f534a82d3675f Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: source checked
Stable ID: proteingym-method-proteinmpnn