Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML)
PMC12016141 (published 2025-04-22; Genome Biol 26:104) · Peer-reviewed
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Relevance of vep-lit-20261014-protocol-livesey2025-clinical-auroc to use-case-brca1-brca2-germline-interpretation: Assessed by Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S8; Methods)
- Relevance of vep-lit-20261014-protocol-livesey2025-clinical-auroc to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S8; Methods 'ClinVar and gnomAD data', 'AUROC and AUPRC')
- Relevance of vep-lit-20261014-protocol-livesey2025-clinical-auroc to use-case-rare-disease-candidate-ranking: Assessed by Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S8; Methods 'ClinVar and gnomAD data', 'AUROC and AUPRC')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-all to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S3; Methods 'Spearman's correlation and rank score')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-all to use-case-protein-variant-effect-prediction: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S3; Methods 'Spearman's correlation and rank score'; vep-lit-20261014-source-livesey2025-article: Methods 'DMS datasets')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-all to use-case-rare-disease-candidate-ranking: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S3; Methods 'Spearman's correlation and rank score')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-direct to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S5; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-direct to use-case-protein-variant-effect-prediction: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S5; Results; vep-lit-20261014-source-livesey2025-article: Methods 'DMS datasets')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-direct to use-case-rare-disease-candidate-ranking: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S5; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-indirect to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S5; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-indirect to use-case-protein-variant-effect-prediction: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S5; Results; vep-lit-20261014-source-livesey2025-article: Methods 'DMS datasets')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-indirect to use-case-rare-disease-candidate-ranking: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S5; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-snv to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S6; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-snv to use-case-protein-variant-effect-prediction: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S6; Results; vep-lit-20261014-source-livesey2025-article: Methods 'DMS datasets')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-snv to use-case-rare-disease-candidate-ranking: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S6; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-snv-filled to use-case-missense-pp3-bp4-calibrated-evidence: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S7; Results)
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-snv-filled to use-case-protein-variant-effect-prediction: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S7; Results; vep-lit-20261014-source-livesey2025-article: Methods 'DMS datasets')
- Relevance of vep-lit-20261014-protocol-livesey2025-dms-snv-filled to use-case-rare-disease-candidate-ranking: Assessed by Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled (vep-lit-20261014-source-livesey2025-supplementary-2: Supplementary Material 2 Table S7; Results)
- tables_not_extracted: vep-lit-20261014-source-livesey2025-supplementary-2: Tables not extracted Not extracted as results: the pairwise win-rate matrix bodies of Tables S3 (97 x 97) and S8 (85 x 85), kept only through each VEP's rank_score, proteins and top_5_winrate columns; Table S4 (bootstrap counts behind the Figure 2 error bars); the absolute_difference column of Table S5 (a difference of two extracted values); Tables S1 and S2, used for dataset and configuration descriptions; Figures 1-4 and Supplementary Figs. S1-S6 (no printed values; the AUPRC ranking of Fig. S5 is figure-only); the figshare deposits of per-variant predictions and scripts. (Supplementary Material 2 Legends and Tables S1-S8; Figures 1-4; Data availability)
Models, benchmarks and other records
Methods (26)
Configurations (97)
- 3Cnet (Livesey and Marsh 2025)
- AlphaMissense (Livesey and Marsh 2025)
- AlphScore (Livesey and Marsh 2025)
- BayesDel (Livesey and Marsh 2025)
- BayesDel_noAF (Livesey and Marsh 2025)
- BLOSUM62 (Livesey and Marsh 2025)
- CADD_1.6 (Livesey and Marsh 2025)
- CADD_1.7 (Livesey and Marsh 2025)
- CAPICE (Livesey and Marsh 2025)
- CARP (Livesey and Marsh 2025)
- ClinPred (Livesey and Marsh 2025)
- CONDEL (Livesey and Marsh 2025)
- CPT-1 (Livesey and Marsh 2025)
- DANN (Livesey and Marsh 2025)
- DeepSAV (Livesey and Marsh 2025)
- DeepSequence (Livesey and Marsh 2025)
- DeMaSk (Livesey and Marsh 2025)
- DEOGEN2 (Livesey and Marsh 2025)
- Eigen (Livesey and Marsh 2025)
- Envision (Livesey and Marsh 2025)
- ESCOTT (Livesey and Marsh 2025)
- ESM-1b (Livesey and Marsh 2025)
- ESM-1v (Livesey and Marsh 2025)
- ESM2 (Livesey and Marsh 2025)
- EVE (Livesey and Marsh 2025)
Benchmarks (1)
Protocols (6)
- Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense
- Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets
- Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only
- Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only
- Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only
- Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled
Datasets (2)
Evaluations (570)
- 3Cnet: Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense
- 3Cnet: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets
- 3Cnet: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only
- 3Cnet: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only
- 3Cnet: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only
- 3Cnet: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled
- AlphaMissense: Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense
- AlphaMissense: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets
- AlphaMissense: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only
- AlphaMissense: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only
- AlphaMissense: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only
- AlphaMissense: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled
- AlphScore: Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense
- AlphScore: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets
- AlphScore: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only
- AlphScore: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only
- AlphScore: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only
- AlphScore: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled
- BayesDel_noAF: Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense
- BayesDel_noAF: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, all 36 DMS sets
- BayesDel_noAF: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, direct assays only
- BayesDel_noAF: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, indirect assays only
- BayesDel_noAF: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions only
- BayesDel_noAF: Livesey and Marsh 2025 DMS benchmark: pairwise |Spearman| win rate, SNV-accessible substitutions with gaps filled
- BayesDel: Livesey and Marsh 2025 clinical benchmark: pairwise AUROC win rate, ClinVar pathogenic versus gnomAD missense
Sources (1)
Use cases (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
26 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.artifact_sha256 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2 Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1186/s13059-025-03575-w Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC BY 4.0 Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Limitations2 values
| Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Media type application/xml Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status peer_reviewed Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-14T13:36:01Z Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.review.artifact_sha256 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2 Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review: method note Re-downloaded from the recorded URL on 2026-10-14 and matched the SHA-256; URL, version, licence and limitations checked. Source metadata | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Review method2 values
| Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) No field-specific location recorded Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
Benchmark of 97 missense variant effect predictors against 36 human deep mutational scanning datasets, and of 83 predictors on ClinVar pathogenic versus gnomAD missense variants.
Technical metadata and extraction receipts
Stable ID: vep-lit-20261014-source-livesey2025-article
- areas
- dna-genomes; proteins-complexes
- contexts
- research; clinical_research
- url
- https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12016141/fullTextXML
- version
- PMC12016141 (published 2025-04-22; Genome Biol 26:104)
- doi
- 10.1186/s13059-025-03575-w
- retrieved at
- 2026-10-14T13:36:01Z
- artifact sha256
- 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2
- publication status
- peer_reviewed
- licence
- CC BY 4.0
- media type
- application/xml
- source locator
- Results; Methods 'Spearman's correlation and rank score', 'AUROC and AUPRC', 'ClinVar and gnomAD data', 'DMS datasets', 'VEPs'; Tables 1-3; Data availability
- limitations
- Figures 1-4 print no values; per-VEP results come from Supplementary Material 2.; The authors obtained predictions for 27 VEPs from dbNSFP 4.2 and the rest from pre-calculated downloads, web servers, local runs or the ProteinGym website (Methods, 'VEPs').
- review
- reviewer: claude; reviewer note: Claude review agent; no human review claimed. Independent Claude (Opus 5.5) review agent, separate from the extraction agent that built this batch. Automated review only. Transcription, not reproduction.; reviewed at: 2026-10-14T15:30:00Z; artifact sha256: 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12016141/fullTextXML; method: source-hash-verification; ai-assisted-source-review; method note: Re-downloaded from the recorded URL on 2026-10-14 and matched the SHA-256; URL, version, licence and limitations checked.; note: Hash matches.