| Configuration: GPN-MSA ablation '51 mammals' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.325 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and source51 mammals on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row '51 mammals', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation '51 mammals' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.323 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and source51 mammals on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row '51 mammals', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation '51 vertebrates' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.347 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and source51 vertebrates on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row '51 vertebrates', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation '51 vertebrates' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.342 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and source51 vertebrates on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row '51 vertebrates', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Default' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.355 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDefault on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Default', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Default' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.348 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDefault on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Default', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Include closest primates' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.219 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceInclude closest primates on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Include closest primates', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Include closest primates' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.214 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceInclude closest primates on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Include closest primates', column 'COSMIC' / 'mean' |
|---|
| Method: MSA frequency | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.27 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceMSA frequency (no neural net) on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'MSA frequency (no neural net)', column 'COSMIC' / 'max' |
|---|
| Method: MSA frequency | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.27 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceMSA frequency (no neural net) on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'MSA frequency (no neural net)', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Don’t replace non-conserved' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.34 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDon’t replace non-conserved on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Don’t replace non-conserved', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Don’t replace non-conserved' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.333 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDon’t replace non-conserved on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Don’t replace non-conserved', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Don’t upweight conserved' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.309 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDon’t upweight conserved on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Don’t upweight conserved', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Don’t upweight conserved' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.303 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDon’t upweight conserved on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Don’t upweight conserved', column 'COSMIC' / 'mean' |
|---|
| Method: Combined phyloP and phastCons | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.141 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCombined phyloP and phastCons on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Combined phyloP and phastCons', column 'COSMIC' / 'max' |
|---|
| Method: Combined phyloP and phastCons | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.141 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCombined phyloP and phastCons on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Combined phyloP and phastCons', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Train on 100% of genome' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.224 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTrain on 100% of genome on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Train on 100% of genome', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Train on 100% of genome' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.21 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTrain on 100% of genome on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Train on 100% of genome', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Train on 50% most conserved' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.257 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTrain on 50% most conserved on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Train on 50% most conserved', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Train on 50% most conserved' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.241 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceTrain on 50% most conserved on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Train on 50% most conserved', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Window size = 16' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.25 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceWindow size = 16 on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Window size = 16', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Window size = 16' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.246 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceWindow size = 16 on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Window size = 16', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Window size = 256' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.376 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceWindow size = 256 on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Window size = 256', column 'COSMIC' / 'max' |
|---|
| Configuration: GPN-MSA ablation 'Window size = 256' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.366 AUPRC (mean over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceWindow size = 256 on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Window size = 256', column 'COSMIC' / 'mean' |
|---|
| Configuration: GPN-MSA ablation 'Window size = 32' (Supplementary Table 4) | Protocol: COSMIC frequent vs gnomAD common missense, AUPRC (GPN-MSA Supplementary Table 4) Dataset: COSMIC frequent vs gnomAD common missense variants (GPN-MSA paper) | 0.328 AUPRC (maximum over three random seeds; zero-shot) unitless · higher Uncertainty: Not reported by the source: Only mean and max over seeds are printed Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceWindow size = 32 on COSMIC (GPN-MSA Supplementary Table 4) gfm-guides-20261014-gpnmsa-protocol-ablation-cosmic-auprc Aggregation: Not reported GPN-MSA: an alignment-based DNA language model for genome-wide variant effect prediction (bioRxiv v2) · Supplementary Table 4 (PDF page 23), row 'Window size = 32', column 'COSMIC' / 'max' |
|---|