| Configuration: Training class prior / majority (MFASS v2 canonical held-out split) | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.5 auroc dimensionless · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Source checkedMethods, coverage and sourceTraining class prior / majority on MFASS v2 canonical held-out split MFASS v2 canonical held-out split Aggregation: Not reported Training class prior / majority: report; Training class prior / majority: audit · metrics.auroc |
|---|
| Configuration: Training class prior / majority (MFASS v2 canonical held-out split) | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.0378 average_precision_sklearn dimensionless · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Source checkedMethods, coverage and sourceTraining class prior / majority on MFASS v2 canonical held-out split MFASS v2 canonical held-out split Aggregation: Not reported Training class prior / majority: report; Training class prior / majority: audit · metrics.average_precision_sklearn |
|---|
| Configuration: Training class prior / majority (MFASS v2 canonical held-out split) | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.04 precision_at_capacity dimensionless · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Source checkedMethods, coverage and sourceTraining class prior / majority on MFASS v2 canonical held-out split MFASS v2 canonical held-out split Aggregation: Not reported Training class prior / majority: report; Training class prior / majority: audit · metrics.precision_at_capacity |
|---|
| Configuration: Corrected k-mer / position baseline | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.778 auroc fraction · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceCorrected k-mer / position baseline on MFASS v2 Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: auroc |
|---|
| Configuration: Corrected k-mer / position baseline | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.286 average_precision fraction · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceCorrected k-mer / position baseline on MFASS v2 Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Aggregation: Not reported MFASS v2 corrected k-mer baseline: pinned upstream result JSON · JSON pointer /metrics/average_precision_sklearn |
|---|
| Configuration: Corrected k-mer / position baseline | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.61 precision_at_100 fraction · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceCorrected k-mer / position baseline on MFASS v2 Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: precision_at_100 |
|---|
| Pipeline: DNABERT-2 117M · frozen pair embeddings | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.55 auroc fraction · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceDNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: auroc |
|---|
| Pipeline: DNABERT-2 117M · frozen pair embeddings | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.0451 average_precision fraction · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceDNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: average_precision |
|---|
| Pipeline: DNABERT-2 117M · frozen pair embeddings | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.03 precision_at_100 fraction · higher Uncertainty: Not reported Coverage: 8324/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceDNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: precision_at_100 |
|---|
| Configuration: Pangolin · mask=False | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.876 auroc fraction · higher Uncertainty: Not reported Coverage: 8301/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourcePangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: auroc |
|---|
| Configuration: Pangolin · mask=False | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.389 average_precision fraction · higher Uncertainty: Not reported Coverage: 8301/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourcePangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: average_precision |
|---|
| Configuration: Pangolin · mask=False | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.65 precision_at_100 fraction · higher Uncertainty: Not reported Coverage: 8301/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourcePangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100 |
|---|
| Configuration: SpliceAI 1.3.1 | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.806 auroc fraction · higher Uncertainty: Not reported Coverage: 8194/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceSpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: auroc |
|---|
| Configuration: SpliceAI 1.3.1 | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.299 average_precision fraction · higher Uncertainty: Not reported Coverage: 8194/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceSpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision |
|---|
| Configuration: SpliceAI 1.3.1 | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.64 precision_at_100 fraction · higher Uncertainty: Not reported Coverage: 8194/8324 | Rewire evaluation · Independently reproducedMethods, coverage and sourceSpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: precision_at_100 |
|---|