rewirebio.iobenchmarks
Evidence claim

Livesey and Marsh 2025 on Eigen and MutationAssessor: DMS against clinical endpoints

Discrepancy review of Eigen rank_score (Table S8)

explained

Review of discrepancy-34c6589a558a894f: explained.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

48 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Action
investigated
Context-only references
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104)
Retrieved: 2026-10-14T13:36:01Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.action

Source artifact SHA-256: 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2

Hash scope: Hash scope not separately documented; inspect source record

Action
investigated
Context-only references
Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141
Retrieved: 2026-10-14T13:36:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.action

Source artifact SHA-256: 1b0d792d1a5d3daa95545a7973cabb131c45e42c952e7e5a447a72deef1d1e70

Hash scope: Hash scope not separately documented; inspect source record

Date
2026-10-23
Context-only references
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104)
Retrieved: 2026-10-14T13:36:01Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.date

Source artifact SHA-256: 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2

Hash scope: Hash scope not separately documented; inspect source record

Date
2026-10-23
Context-only references
Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141
Retrieved: 2026-10-14T13:36:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.date

Source artifact SHA-256: 1b0d792d1a5d3daa95545a7973cabb131c45e42c952e7e5a447a72deef1d1e70

Hash scope: Hash scope not separately documented; inspect source record

Discrepancy id
discrepancy-34c6589a558a894f
Context-only references
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104)
Retrieved: 2026-10-14T13:36:01Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.discrepancy_id

Source artifact SHA-256: 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2

Hash scope: Hash scope not separately documented; inspect source record

Discrepancy id
discrepancy-34c6589a558a894f
Context-only references
Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141
Retrieved: 2026-10-14T13:36:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.discrepancy_id

Source artifact SHA-256: 1b0d792d1a5d3daa95545a7973cabb131c45e42c952e7e5a447a72deef1d1e70

Hash scope: Hash scope not separately documented; inspect source record

Claimed field
discrepancy_review
Context-only references
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104)
Retrieved: 2026-10-14T13:36:01Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2

Hash scope: Hash scope not separately documented; inspect source record

Claimed field
discrepancy_review
Context-only references
Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141
Retrieved: 2026-10-14T13:36:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 1b0d792d1a5d3daa95545a7973cabb131c45e42c952e7e5a447a72deef1d1e70

Hash scope: Hash scope not separately documented; inspect source record

Rationale
Livesey and Marsh rank MutationAssessor above Eigen on their DMS benchmarks (pairwise Spearman win rate, for example 58.8 against 52.4 over 36 DMS sets) but Eigen above MutationAssessor on their own clinical benchmark (54.6 against 51.4), agreeing with the consensus. Every consensus study is clinical or cancer classification: Cubuk 2021 BRCA functional calls, Chen 2020 driver mutations, Lee 2026 CGC oncogenicity. The split between functional-assay and clinical endpoints is the reason; all results are kept as reported.
Context-only references
Livesey and Marsh 2025, Genome Biology 26:104 (Europe PMC full text XML)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: PMC12016141 (published 2025-04-22; Genome Biol 26:104)
Retrieved: 2026-10-14T13:36:01Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 1735ee461ef192d9de67c914e9ad73d72d8aa255ea0e3479eb68cd8631d99fa2

Hash scope: Hash scope not separately documented; inspect source record

Rationale
Livesey and Marsh rank MutationAssessor above Eigen on their DMS benchmarks (pairwise Spearman win rate, for example 58.8 against 52.4 over 36 DMS sets) but Eigen above MutationAssessor on their own clinical benchmark (54.6 against 51.4), agreeing with the consensus. Every consensus study is clinical or cancer classification: Cubuk 2021 BRCA functional calls, Chen 2020 driver mutations, Lee 2026 CGC oncogenicity. The split between functional-assay and clinical endpoints is the reason; all results are kept as reported.
Context-only references
Livesey and Marsh 2025, Supplementary Material 2 (Tables S1-S8)

Original source ↗

The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 13059_2025_3575_MOESM2_ESM.xlsx as published with PMC12016141
Retrieved: 2026-10-14T13:36:25Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 1b0d792d1a5d3daa95545a7973cabb131c45e42c952e7e5a447a72deef1d1e70

Hash scope: Hash scope not separately documented; inspect source record

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: discrepancy-review-20261023-livesey-eigen-mutationassessor

areas
proteins-complexes
contexts
research
field
discrepancy_review
discrepancy id
discrepancy-34c6589a558a894f
revision
1
value
explained
action
investigated
date
2026-10-23
rationale
Livesey and Marsh rank MutationAssessor above Eigen on their DMS benchmarks (pairwise Spearman win rate, for example 58.8 against 52.4 over 36 DMS sets) but Eigen above MutationAssessor on their own clinical benchmark (54.6 against 51.4), agreeing with the consensus. Every consensus study is clinical or cancer classification: Cubuk 2021 BRCA functional calls, Chen 2020 driver mutations, Lee 2026 CGC oncogenicity. The split between functional-assay and clinical endpoints is the reason; all results are kept as reported.
source locator
The outlier and consensus results of discrepancy-34c6589a558a894f as published at https://benchmarks.rewirebio.io/contested/discrepancy-34c6589a558a894f/ (release 2026-10-23-968c8720eea6)
review
method: automated-source-review; ai-assisted-source-review; reviewer: claude; reviewer note: Recorded by a Claude agent; no human review claimed.; date: 2026-10-23; method note: Read every outlier and consensus result of the finding, with its protocol, metric, configuration and source, from the published contested-result page, and compared the tasks, settings and configurations on each side. The original papers were not re-opened.; note: Records where the discrepancy stands, not a correction to any result. No result value or status was changed.
Related records

Suggest a correction