ProteinGym clinical supervised substitutions AUC summary at commit 144fe22
144fe22b07dfaeec2b366f2346203a9838a55b4c · Project source
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Relevance of vep-lit-20261014-protocol-proteingym-clinical-supervised-substitutions-auc-144fe22 to use-case-brca1-brca2-germline-interpretation: Assessed by ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22) (vep-lit-20261014-source-proteingym-clinical-supervised-substitutions-auc-summary-144fe22: Summary_performance_clinical_substitutions_AUC.csv (supervised))
- Relevance of vep-lit-20261014-protocol-proteingym-clinical-supervised-substitutions-auc-144fe22 to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22) (vep-lit-20261014-source-proteingym-clinical-supervised-substitutions-auc-summary-144fe22: Summary_performance_clinical_substitutions_AUC.csv (supervised); README line 106; profile-protocol-proteingym-paper-xml-a58110e0: ProteinGym NeurIPS 2023 paper (PMC10723403): 'Clinical datasets', Appendix A.3.2, Appendix 'Limitations' ('Bias', 'Circularity'))
- Relevance of vep-lit-20261014-protocol-proteingym-clinical-supervised-substitutions-auc-144fe22 to use-case-rare-disease-candidate-ranking: Assessed by ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22) (vep-lit-20261014-source-proteingym-clinical-supervised-substitutions-auc-summary-144fe22: Summary_performance_clinical_substitutions_AUC.csv (supervised); README line 106)
Models, benchmarks and other records
Configurations (27)
- BayesDel (addAF) [ProteinGym 144fe22 clinical summary]
- BayesDel (noAF) [ProteinGym 144fe22 clinical summary]
- CADD [ProteinGym 144fe22 clinical summary]
- ClinPred [ProteinGym 144fe22 clinical summary]
- DANN [ProteinGym 144fe22 clinical summary]
- DEOGEN2 [ProteinGym 144fe22 clinical summary]
- EVE [ProteinGym 144fe22 clinical summary]
- FATHMM [ProteinGym 144fe22 clinical summary]
- gMVP [ProteinGym 144fe22 clinical summary]
- Hidden Markov Model [ProteinGym 144fe22 clinical summary]
- LIST-S2 [ProteinGym 144fe22 clinical summary]
- LRT [ProteinGym 144fe22 clinical summary]
- MetaRNN [ProteinGym 144fe22 clinical summary]
- MPC [ProteinGym 144fe22 clinical summary]
- MutationAssessor [ProteinGym 144fe22 clinical summary]
- MutationTaster [ProteinGym 144fe22 clinical summary]
- MutPred [ProteinGym 144fe22 clinical summary]
- PolyPhen2 (HDIV) [ProteinGym 144fe22 clinical summary]
- PolyPhen2 (HVAR) [ProteinGym 144fe22 clinical summary]
- PrimateAI [ProteinGym 144fe22 clinical summary]
- Provean [ProteinGym 144fe22 clinical summary]
- REVEL [ProteinGym 144fe22 clinical summary]
- SIFT [ProteinGym 144fe22 clinical summary]
- SIFT4G [ProteinGym 144fe22 clinical summary]
- VARITY (ER) [ProteinGym 144fe22 clinical summary]
Protocols (1)
Evaluations (17)
- BayesDel (addAF): ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- BayesDel (noAF): ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- CADD: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- ClinPred: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- DANN: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- DEOGEN2: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- FATHMM: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- gMVP: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- MetaRNN: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- MPC: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- MutationTaster: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- PolyPhen2 (HDIV): ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- PolyPhen2 (HVAR): ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- REVEL: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- VARITY (ER): ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- VARITY (R): ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
- VEST4: ProteinGym clinical substitutions, supervised predictors, average AUC (commit 144fe22)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
26 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.artifact_sha256 f2e38aeac2624d87e7a35a5b16bd580de62c24db36973848e1d94ac3ce510359 Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/clinical_supervised/substitutions/AUC/Summary_performance_clinical_substitutions_AUC.csv Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence MIT (repository LICENSE); underlying assay and clinical data carry their own terms Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations2 values
| ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type text/csv Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status official_project_source Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-14T13:39:33Z Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.review.artifact_sha256 f2e38aeac2624d87e7a35a5b16bd580de62c24db36973848e1d94ac3ce510359 Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review: method note Re-downloaded from the recorded URL on 2026-10-14 and matched the SHA-256; URL, version, licence and limitations checked. Source metadata | ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Review method2 values
| ProteinGym clinical supervised substitutions AUC summary at commit 144fe22 No field-specific location recorded Version: 144fe22b07dfaeec2b366f2346203a9838a55b4c | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Official ProteinGym summary file: average AUC on the clinical substitution benchmark for 17 supervised clinical predictors.
Technical metadata and extraction receipts
Stable ID: vep-lit-20261014-source-proteingym-clinical-supervised-substitutions-auc-summary-144fe22
- areas
- proteins-complexes
- contexts
- clinical_research
- url
- https://github.com/OATML-Markslab/ProteinGym/blob/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/clinical_supervised/substitutions/AUC/Summary_performance_clinical_substitutions_AUC.csv
- artifact url
- https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/clinical_supervised/substitutions/AUC/Summary_performance_clinical_substitutions_AUC.csv
- version
- 144fe22b07dfaeec2b366f2346203a9838a55b4c
- retrieved at
- 2026-10-14T13:39:33Z
- artifact sha256
- f2e38aeac2624d87e7a35a5b16bd580de62c24db36973848e1d94ac3ce510359
- publication status
- official_project_source
- licence
- MIT (repository LICENSE); underlying assay and clinical data carry their own terms
- media type
- text/csv
- source locator
- benchmarks/clinical_supervised/substitutions/AUC/Summary_performance_clinical_substitutions_AUC.csv
- limitations
- Mutable repository: the file is pinned to commit 144fe22b07dfaeec2b366f2346203a9838a55b4c, which was the head of main at retrieval (committed 2026-03-25).; The repository does not record which script run, data release or model-score snapshot produced this file; the README says these summary files are what the website hosts.
- review
- reviewer: claude; reviewer note: Claude review agent; no human review claimed. Independent Claude (Opus 5.5) review agent, separate from the extraction agent that built this batch. Automated review only. Transcription, not reproduction.; reviewed at: 2026-10-14T15:30:00Z; artifact sha256: f2e38aeac2624d87e7a35a5b16bd580de62c24db36973848e1d94ac3ce510359; retrieval url: https://raw.githubusercontent.com/OATML-Markslab/ProteinGym/144fe22b07dfaeec2b366f2346203a9838a55b4c/benchmarks/clinical_supervised/substitutions/AUC/Summary_performance_clinical_substitutions_AUC.csv; method: source-hash-verification; ai-assisted-source-review; method note: Re-downloaded from the recorded URL on 2026-10-14 and matched the SHA-256; URL, version, licence and limitations checked.; note: Hash matches.