rewirebio.iobenchmarks
Dataset

gnomAD reference set (Pejaver et al. 2022)

Rare gnomAD missense variants in genes with at least one ClinVar pathogenic variant, used to estimate the prior probability of pathogenicity (4.41%) and to count how often each evidence strength is assigned.

Evaluation results

3 evaluations · 3 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: CADD (Pejaver et al. 2022 calibration)Protocol: Share of gnomAD variants called pathogenic at developer thresholds (Pejaver et al. 2022 Table 3)
Dataset: gnomAD reference set (Pejaver et al. 2022)
0.651 Proportion (gnomAD-set variants predicted pathogenic at the developer threshold)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CADD at developer threshold 20.000: gnomAD fraction called pathogenic (Pejaver et al. 2022)

vep-uc-20261014-protocol-pejaver2022-developer-threshold-gnomad-fraction

Aggregation: Not reported

Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML) · Table 3, row 'CADD', column 'Fraction of predicted pathogenic variants in the gnomAD set'
Configuration: PolyPhen-2 (Pejaver et al. 2022 calibration)Protocol: Share of gnomAD variants called pathogenic at developer thresholds (Pejaver et al. 2022 Table 3)
Dataset: gnomAD reference set (Pejaver et al. 2022)
0.293 Proportion (gnomAD-set variants predicted pathogenic at the developer threshold)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

PolyPhen-2 at developer threshold 0.902: gnomAD fraction called pathogenic (Pejaver et al. 2022)

vep-uc-20261014-protocol-pejaver2022-developer-threshold-gnomad-fraction

Aggregation: Not reported

Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML) · Table 3, row 'PolyPhen-2', column 'Fraction of predicted pathogenic variants in the gnomAD set'
Configuration: SIFT (Pejaver et al. 2022 calibration)Protocol: Share of gnomAD variants called pathogenic at developer thresholds (Pejaver et al. 2022 Table 3)
Dataset: gnomAD reference set (Pejaver et al. 2022)
0.504 Proportion (gnomAD-set variants predicted pathogenic at the developer threshold)
fraction · unknown

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

SIFT at developer threshold 0.050: gnomAD fraction called pathogenic (Pejaver et al. 2022)

vep-uc-20261014-protocol-pejaver2022-developer-threshold-gnomad-fraction

Aggregation: Not reported

Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML) · Table 3, row 'SIFT', column 'Fraction of predicted pathogenic variants in the gnomAD set'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Research readiness

0 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.

Readiness checks, gaps and artifacts

Release 2026-10-22-1b7cf027e4f6 · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Metrics are recomputed from the saved predictions: not yet verified
  • Sample annotations are recorded: not yet verified
  • Dependence between samples is assessed: not yet verified

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • A pinned run recipe exists: not yet verified
  • Compute requirements are estimated: not yet verified

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • File checksums match the recorded files: not yet verified
  • Predictions are matched to the right samples: not yet verified
  • Score meaning and direction are confirmed: not yet verified
  • Independent validation data exist: not yet verified
  • Overlap with training data is checked: not yet verified

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Dataset and evaluation context

A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

9 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Access
Supplementary Data S2 (Excel), not retrieved in this pass.
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.access

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Label semantics
Unlabelled reference population; used for the prior and for the fraction of variants assigned each strength.
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.label_semantics

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Population
363,894 variants from 3,640 genes after quality, segmental-duplication and training-set filters and removal of variants in ClinVar (December 2019).
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.population

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Source location
Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Species
Homo sapiens
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.species

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Split
Whole set; not a labelled test set
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.split

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Version
gnomAD v2.1 exomes and genomes, filtered as in Figure 1B
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Description
Rare gnomAD missense variants in genes with at least one ClinVar pathogenic variant, used to estimate the prior probability of pathogenicity (4.41%) and to count how often each evidence strength is assigned.
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Name
gnomAD reference set (Pejaver et al. 2022)
Context-only references
Pejaver et al. 2022, Am J Hum Genet 109:2163 (Europe PMC full text XML)

Original source ↗

Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B

Version: PMC9748256 (Am J Hum Genet 2022;109(12):2163)
Retrieved: 2026-10-14T14:44:42Z

not individually reviewed

No individual claim review recorded

Audit details

Field: name

Source artifact SHA-256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b

Hash scope: Exact downloaded bytes, before optional gzip storage

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: vep-uc-20261014-dataset-pejaver2022-gnomad

areas
dna-genomes
contexts
clinical_research
version
gnomAD v2.1 exomes and genomes, filtered as in Figure 1B
split
Whole set; not a labelled test set
population
363,894 variants from 3,640 genes after quality, segmental-duplication and training-set filters and removal of variants in ClinVar (December 2019).
label semantics
Unlabelled reference population; used for the prior and for the fraction of variants assigned each strength.
species
Homo sapiens
access
Supplementary Data S2 (Excel), not retrieved in this pass.
source locator
Methods 'The gnomAD set' and 'Estimation of the prevalence of pathogenic variants'; Figure 1B
review
reviewer: claude; reviewer note: Claude review agent; no human review claimed. Independent Claude (Opus 5.5) review agent, separate from the extraction agent that built this batch. Automated review only. Transcription, not reproduction.; reviewed at: 2026-10-14T16:00:00Z; artifact sha256: a78c7bcaacb0ccb72291264bbe7c1f9a16867b0c6207dcbb45c3c59a14af6b3b; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC9748256/fullTextXML; method: source-hash-verification; ai-assisted-source-review; method note: Checked against the Methods, table captions and author lists of the pinned sources.; note: Checked; see the dated review for rulings on origin and carried-over rows.
Related records

Suggest a correction