Dataset subset

mCAD

Source-defined subset: mCAD. Exact membership and scoring coverage remain as reported in the cited artifact.

Evaluation results

12 evaluations · 48 results. Different protocols are not a single leaderboard.

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: PPCOR	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source PPCOR · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 6, column 10
Configuration: SINCERITIES	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.79 Early precision ratio (inhibitory edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SINCERITIES · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 14
Configuration: SCNS	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.983 AUPRC ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SCNS · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 10, column 2
Configuration: LEAP	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.79 Early precision ratio (inhibitory edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source LEAP · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 11, column 14
Configuration: GRISLI	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.688 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRISLI · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 10
Configuration: GRNBOOST2	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.947 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRNBOOST2 · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 5, column 6
Configuration: SCNS	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.947 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SCNS · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 10, column 6
Configuration: SCODE	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	1.38 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SCODE · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 7, column 10
Configuration: GENIE3	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.795 AUPRC ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GENIE3 · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 4, column 2
Configuration: GRNVBEM	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.756 AUPRC ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRNVBEM · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 2
Configuration: SINCERITIES	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	1.38 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SINCERITIES · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 10
Configuration: PPCOR	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.879 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source PPCOR · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 6, column 6
Configuration: LEAP	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.688 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source LEAP · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 11, column 10
Configuration: GENIE3	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.947 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GENIE3 · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 4, column 6
Configuration: GRNVBEM	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.393 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRNVBEM · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 10
Configuration: GENIE3	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.688 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GENIE3 · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 4, column 10
Configuration: GRNBOOST2	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0 Early precision ratio (activating edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRNBOOST2 · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 5, column 10
Configuration: GRISLI	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	1.31 AUPRC ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRISLI · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 2
Configuration: PIDC	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.795 AUPRC ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source PIDC · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 3, column 2
Configuration: SCRIBE	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.888 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SCRIBE · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 14, column 6
Configuration: PIDC	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.79 Early precision ratio (inhibitory edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source PIDC · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 3, column 14
Configuration: SCODE	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	1.18 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SCODE · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 7, column 6
Configuration: PPCOR	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	0.79 Early precision ratio (inhibitory edges only) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source PPCOR · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 6, column 14
Configuration: GRISLI	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	1.07 Early precision ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source GRISLI · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 6
Configuration: SINCERITIES	Protocol: BEELINE 2020 Figure 4 · mCAD Dataset subset: mCAD	1.05 AUPRC ratio unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Author-reported evaluation · Source checked Methods, coverage and source SINCERITIES · BEELINE 2020 Figure 4 · mCAD BEELINE 2020 Figure 4 Aggregation: Median across source-described simulation datasets BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 2

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Research readiness

0 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.

Readiness checks, gaps and artifacts

Release 2026-11-02-a7f03c9e55a5 · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

No verified artifact manifest is linked to this exact record.
File checksums match the recorded files: not yet verified
Predictions are matched to the right samples: not yet verified
Score meaning and direction are confirmed: not yet verified
Metrics are recomputed from the saved predictions: not yet verified

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

No verified artifact manifest is linked to this exact record.
File checksums match the recorded files: not yet verified
Predictions are matched to the right samples: not yet verified
Score meaning and direction are confirmed: not yet verified
Metrics are recomputed from the saved predictions: not yet verified
Sample annotations are recorded: not yet verified
Dependence between samples is assessed: not yet verified

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

No verified artifact manifest is linked to this exact record.
File checksums match the recorded files: not yet verified
Predictions are matched to the right samples: not yet verified
Score meaning and direction are confirmed: not yet verified
A pinned run recipe exists: not yet verified
Compute requirements are estimated: not yet verified

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

No verified artifact manifest is linked to this exact record.
File checksums match the recorded files: not yet verified
Predictions are matched to the right samples: not yet verified
Score meaning and direction are confirmed: not yet verified
Independent validation data exist: not yet verified
Overlap with training data is checked: not yet verified

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Subset and evaluation context

This record describes a particular subset or cohort used in an evaluation. Its results do not describe the full dataset.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

3 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statement	Original source and location	Review and provenance
Source location Figure 4 source CSV row 3, column 2 Context-only references	BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 Original source ↗ Figure 4 source CSV row 3, column 2 Version: 10.1038/s41592-019-0690-6 source data published 2020 Retrieved: 2026-09-19	not individually reviewed No individual claim review recorded Audit details Field: `attributes.source_locator` Source artifact SHA-256: `3582523c27176f7573e62fc3fa11843076568b9ce522e556cd2a6973029c90cb` Hash scope: Exact downloaded bytes, before optional gzip storage Inspected artifact
Description Source-defined subset: mCAD. Exact membership and scoring coverage remain as reported in the cited artifact. Context-only references	BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 Original source ↗ Figure 4 source CSV row 3, column 2 Version: 10.1038/s41592-019-0690-6 source data published 2020 Retrieved: 2026-09-19	not individually reviewed No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `3582523c27176f7573e62fc3fa11843076568b9ce522e556cd2a6973029c90cb` Hash scope: Exact downloaded bytes, before optional gzip storage Inspected artifact
Name mCAD Context-only references	BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 Original source ↗ Figure 4 source CSV row 3, column 2 Version: 10.1038/s41592-019-0690-6 source data published 2020 Retrieved: 2026-09-19	not individually reviewed No individual claim review recorded Audit details Field: `name` Source artifact SHA-256: `3582523c27176f7573e62fc3fa11843076568b9ce522e556cd2a6973029c90cb` Hash scope: Exact downloaded bytes, before optional gzip storage Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: discovered

1 source record and release history

BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Original source · 10.1038/s41592-019-0690-6 source data published 2020

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: acquired-dataset-954ba0c9ef3608077f12

source locator: Figure 4 source CSV row 3, column 2
missing metadata: split manifest: reason: unextracted

Related records

data: PIDC · BEELINE 2020 Figure 4 · mCAD
data: GRNVBEM · BEELINE 2020 Figure 4 · mCAD
data: GRNBOOST2 · BEELINE 2020 Figure 4 · mCAD
data: GRISLI · BEELINE 2020 Figure 4 · mCAD
data: SCODE · BEELINE 2020 Figure 4 · mCAD
data: SCNS · BEELINE 2020 Figure 4 · mCAD
data: LEAP · BEELINE 2020 Figure 4 · mCAD
data: SINGE · BEELINE 2020 Figure 4 · mCAD
data: SCRIBE · BEELINE 2020 Figure 4 · mCAD
data: PPCOR · BEELINE 2020 Figure 4 · mCAD
data: GENIE3 · BEELINE 2020 Figure 4 · mCAD
data: SINCERITIES · BEELINE 2020 Figure 4 · mCAD

Suggest a correction