rewirebio.iobenchmarks
Configuration

fitCons (Brandes et al. 2023 clinical benchmarks)

fitCons: precomputed scores from dbNSFP 4.3a.

4 evaluations · 8 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

4 evaluations · 8 results. Different protocols are not a single leaderboard.

Sorted by AUPRC (balanced PRC-AUC over the variants both methods score: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUPRC (balanced PRC-AUC over the variants both methods score: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot)AUPRC (balanced PRC-AUC: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot)AUROC (global ROC-AUC over all variants; zero-shot)AUROC (global ROC-AUC over the variants both methods score; zero-shot)
fitCons (Brandes et al. 2023 clinical benchmarks)EvaluationHGMD/gnomAD missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2), HGMD/gnomAD missense variants scored by both ESM1b and fitCons (Brandes et al. 2023)0.546 (best in column)Not reportedNot reported0.565 (best in column)
fitCons (Brandes et al. 2023 clinical benchmarks)EvaluationClinVar missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2), ClinVar missense variants scored by both ESM1b and fitCons (Brandes et al. 2023)0.512Not reportedNot reported0.515
fitCons (Brandes et al. 2023 clinical benchmarks)EvaluationClinVar missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2), ClinVar missense pathogenic vs benign, primary isoforms (Brandes et al. 2023, from the EVE portal)Not reported0.512 (best in column)0.529 (best in column)Not reported
fitCons (Brandes et al. 2023 clinical benchmarks)EvaluationHGMD/gnomAD missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2), HGMD disease-causing vs gnomAD common missense variants, primary isoforms (Brandes et al. 2023)Not reported0.4770.468Not reported
All 8 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: ClinVar missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: ClinVar missense pathogenic vs benign, primary isoforms (Brandes et al. 2023, from the EVE portal)
0.512 AUPRC (balanced PRC-AUC: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on ClinVar missense, variants scored by all 19 methods (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-clinvar-all-19-methods

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell C20, row 'fitCons', column 'AUC_Balanced_AUPRC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: ClinVar missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: ClinVar missense pathogenic vs benign, primary isoforms (Brandes et al. 2023, from the EVE portal)
0.529 AUROC (global ROC-AUC over all variants; zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on ClinVar missense, variants scored by all 19 methods (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-clinvar-all-19-methods

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell B20, row 'fitCons', column 'AUC_AUROC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: ClinVar missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: ClinVar missense variants scored by both ESM1b and fitCons (Brandes et al. 2023)
0.512 AUPRC (balanced PRC-AUC over the variants both methods score: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on ClinVar missense, head to head against ESM1b (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-clinvar-head-to-head

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell G20, row 'fitCons', column 'head2head_VEP_auc_Balanced_AUPRC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: ClinVar missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: ClinVar missense variants scored by both ESM1b and fitCons (Brandes et al. 2023)
0.515 AUROC (global ROC-AUC over the variants both methods score; zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on ClinVar missense, head to head against ESM1b (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-clinvar-head-to-head

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell E20, row 'fitCons', column 'head2head_VEP_auc_AUROC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: HGMD/gnomAD missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: HGMD disease-causing vs gnomAD common missense variants, primary isoforms (Brandes et al. 2023)
0.477 AUPRC (balanced PRC-AUC: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on HGMD/gnomAD missense, variants scored by all 19 methods (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-hgmd-all-19-methods

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell C20, row 'fitCons', column 'AUC_Balanced_AUPRC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: HGMD/gnomAD missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: HGMD disease-causing vs gnomAD common missense variants, primary isoforms (Brandes et al. 2023)
0.468 AUROC (global ROC-AUC over all variants; zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on HGMD/gnomAD missense, variants scored by all 19 methods (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-hgmd-all-19-methods

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell B20, row 'fitCons', column 'AUC_AUROC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: HGMD/gnomAD missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: HGMD/gnomAD missense variants scored by both ESM1b and fitCons (Brandes et al. 2023)
0.546 AUPRC (balanced PRC-AUC over the variants both methods score: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on HGMD/gnomAD missense, head to head against ESM1b (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-hgmd-head-to-head

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell G20, row 'fitCons', column 'head2head_VEP_auc_Balanced_AUPRC'
Configuration: fitCons (Brandes et al. 2023 clinical benchmarks)Protocol: HGMD/gnomAD missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: HGMD/gnomAD missense variants scored by both ESM1b and fitCons (Brandes et al. 2023)
0.565 AUROC (global ROC-AUC over the variants both methods score; zero-shot)
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

fitCons on HGMD/gnomAD missense, head to head against ESM1b (Brandes et al. 2023)

gfm-guides-20261014-esm1b-protocol-hgmd-head-to-head

Aggregation: Not reported

Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell E20, row 'fitCons', column 'head2head_VEP_auc_AUROC'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: gfm-guides-20261014-esm1b-config-fitcons

areas
dna-genomes
contexts
clinical_research
method types
specialist
reported name
fitCons
version
dbNSFP 4.3a
parameters
dbNSFP 4.3a score; the three cell-line fitCons versions were excluded, so this is taken to be integrated fitCons
foundation model eligible
false
source locator
Supplementary Table 2 column vep_name 'fitCons'; Methods 'ESM1b' and 'Other VEP methods'
provenance note
fitCons as scored in the Brandes et al. 2023 clinical missense benchmarks.
Related records

Suggest a correction