| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: ClinVar missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: ClinVar missense pathogenic vs benign, primary isoforms (Brandes et al. 2023, from the EVE portal) | 0.875 AUPRC (balanced PRC-AUC: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on ClinVar missense, variants scored by all 19 methods (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-clinvar-all-19-methods Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell C3, row 'EVE', column 'AUC_Balanced_AUPRC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: ClinVar missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: ClinVar missense pathogenic vs benign, primary isoforms (Brandes et al. 2023, from the EVE portal) | 0.883 AUROC (global ROC-AUC over all variants; zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on ClinVar missense, variants scored by all 19 methods (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-clinvar-all-19-methods Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell B3, row 'EVE', column 'AUC_AUROC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: ClinVar missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: ClinVar missense variants scored by both ESM1b and EVE (Brandes et al. 2023) | 0.878 AUPRC (balanced PRC-AUC over the variants both methods score: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on ClinVar missense, head to head against ESM1b (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-clinvar-head-to-head Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell G3, row 'EVE', column 'head2head_VEP_auc_Balanced_AUPRC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: ClinVar missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: ClinVar missense variants scored by both ESM1b and EVE (Brandes et al. 2023) | 0.885 AUROC (global ROC-AUC over the variants both methods score; zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on ClinVar missense, head to head against ESM1b (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-clinvar-head-to-head Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_ClinVar' cell E3, row 'EVE', column 'head2head_VEP_auc_AUROC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: HGMD/gnomAD missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: HGMD disease-causing vs gnomAD common missense variants, primary isoforms (Brandes et al. 2023) | 0.881 AUPRC (balanced PRC-AUC: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on HGMD/gnomAD missense, variants scored by all 19 methods (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-hgmd-all-19-methods Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell C3, row 'EVE', column 'AUC_Balanced_AUPRC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: HGMD/gnomAD missense pathogenicity, variants scored by all 19 eligible methods (Brandes et al. 2023 Fig. 2e-f, Supplementary Table 2)
Dataset: HGMD disease-causing vs gnomAD common missense variants, primary isoforms (Brandes et al. 2023) | 0.885 AUROC (global ROC-AUC over all variants; zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on HGMD/gnomAD missense, variants scored by all 19 methods (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-hgmd-all-19-methods Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell B3, row 'EVE', column 'AUC_AUROC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: HGMD/gnomAD missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: HGMD/gnomAD missense variants scored by both ESM1b and EVE (Brandes et al. 2023) | 0.881 AUPRC (balanced PRC-AUC over the variants both methods score: mean over 100 random downsamples to equal pathogenic and benign counts (80% of the minority class); zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on HGMD/gnomAD missense, head to head against ESM1b (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-hgmd-head-to-head Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell G3, row 'EVE', column 'head2head_VEP_auc_Balanced_AUPRC' |
|---|
| Configuration: EVE (Brandes et al. 2023 clinical benchmarks) | Protocol: HGMD/gnomAD missense pathogenicity, ESM1b head to head with one other method on the variants both score (Brandes et al. 2023 Fig. 2g,h, Supplementary Table 2)
Dataset subset: HGMD/gnomAD missense variants scored by both ESM1b and EVE (Brandes et al. 2023) | 0.884 AUROC (global ROC-AUC over the variants both methods score; zero-shot) unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceEVE on HGMD/gnomAD missense, head to head against ESM1b (Brandes et al. 2023) gfm-guides-20261014-esm1b-protocol-hgmd-head-to-head Aggregation: Not reported Brandes et al. 2023 Supplementary Table 2: full benchmark evaluations of ESM1b and all other methods · Supplementary Table 2 sheet 'Table_of_results_HGMD' cell E3, row 'EVE', column 'head2head_VEP_auc_AUROC' |
|---|