Livesey and Marsh 2025 on Eigen and MutationAssessor: DMS against clinical endpoints
Discrepancy review of Eigen rank_score (Table S8)
explained
Review of discrepancy-34c6589a558a894f: explained.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
48 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Action investigated Context-only references | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Action investigated Context-only references | Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Date 2026-10-23 Context-only references | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Date 2026-10-23 Context-only references | Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Discrepancy id discrepancy-34c6589a558a894f Context-only references | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Discrepancy id discrepancy-34c6589a558a894f Context-only references | Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field discrepancy_review Context-only references | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed field discrepancy_review Context-only references | Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Rationale Livesey and Marsh rank MutationAssessor above Eigen on their DMS benchmarks (pairwise Spearman win rate, for example 58.8 against 52.4 over 36 DMS sets) but Eigen above MutationAssessor on their own clinical benchmark (54.6 against 51.4), agreeing with the consensus. Every consensus study is clinical or cancer classification: Cubuk 2021 BRCA functional calls, Chen 2020 driver mutations, Lee 2026 CGC oncogenicity. The split between functional-assay and clinical endpoints is the reason; all results are kept as reported. Context-only references | Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104) | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Rationale Livesey and Marsh rank MutationAssessor above Eigen on their DMS benchmarks (pairwise Spearman win rate, for example 58.8 against 52.4 over 36 DMS sets) but Eigen above MutationAssessor on their own clinical benchmark (54.6 against 51.4), agreeing with the consensus. Every consensus study is clinical or cancer classification: Cubuk 2021 BRCA functional calls, Chen 2020 driver mutations, Lee 2026 CGC oncogenicity. The split between functional-assay and clinical endpoints is the reason; all results are kept as reported. Context-only references | Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8) The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6) Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
2 source records and release history
- Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML) · Original source · PMC12016141 (published 2025-04-22; Genome Biol 26:104)
- Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8) · Original source · 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141
Technical metadata and extraction receipts
Stable ID: discrepancy-review-20261023-livesey-eigen-mutationassessor
- areas
- proteins-complexes
- contexts
- research
- field
- discrepancy_review
- discrepancy id
- discrepancy-34c6589a558a894f
- revision
- 1
- value
- explained
- action
- investigated
- date
- 2026-10-23
- rationale
- Livesey and Marsh rank MutationAssessor above Eigen on their DMS benchmarks (pairwise Spearman win rate, for example 58.8 against 52.4 over 36 DMS sets) but Eigen above MutationAssessor on their own clinical benchmark (54.6 against 51.4), agreeing with the consensus. Every consensus study is clinical or cancer classification: Cubuk 2021 BRCA functional calls, Chen 2020 driver mutations, Lee 2026 CGC oncogenicity. The split between functional-assay and clinical endpoints is the reason; all results are kept as reported.
- source locator
- The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)
- review
- method: automated-source-review; ai-assisted-source-review; reviewer: claude; reviewer note: Recorded by a Claude agent; no human review claimed.; date: 2026-10-23; method note: Read every outlier and consensus result of the finding, with its protocol, metric, configuration and source, from the published contested-result page, and compared the tasks, settings and configurations on each side. The original papers were not re-opened.; note: Records where the discrepancy stands, not a correction to any result. No result value or status was changed.
Related records
- subject: Eigen rank_score (Table S8)
- subject: MutationAssessor rank_score (Table S8)
- subject: Eigen rank_score (Table S3)
- subject: Eigen top_5_winrate (Table S3)
- subject: MutationAssessor rank_score (Table S3)
- subject: MutationAssessor top_5_winrate (Table S3)
- subject: Eigen rank_score_direct (Table S5)
- subject: MutationAssessor rank_score_direct (Table S5)
- subject: Eigen rank_score_indirect (Table S5)
- subject: MutationAssessor rank_score_indirect (Table S5)
- subject: Eigen rank_score (Table S6)
- subject: Eigen rank_score (Table S7)
- subject: MutationAssessor rank_score (Table S7)
- subject: MutationAssessor rank_score (Table S6)