Dataset

MFASS v2 eligible assay cohort

Evaluation results

10 evaluations · 30 results. Different protocols are not a single leaderboard.

Filter evaluations

Tested model or methodProtocolDatasetEvaluation setupMetricEvidence origin

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configuration	Protocol and dataset	Finding	Evidence and details
Configuration: Training class prior / majority (MFASS v2 canonical held-out split)	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.5 AUROC unitless · higher Uncertainty: Not reported by the source: Not estimated; one selected evaluation. Coverage: 8324/8324 scored	Rewire evaluation · Source checked Methods, coverage and source Training class prior / majority on MFASS v2 canonical held-out split MFASS v2 canonical held-out split Aggregation: Not reported Training class prior / majority: report; Training class prior / majority: audit · metrics.auroc
Configuration: Training class prior / majority (MFASS v2 canonical held-out split)	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.0378 Average precision unitless · higher Uncertainty: Not reported by the source: Not estimated; one selected evaluation. Coverage: 8324/8324 scored	Rewire evaluation · Source checked Methods, coverage and source Training class prior / majority on MFASS v2 canonical held-out split MFASS v2 canonical held-out split Aggregation: Not reported Training class prior / majority: report; Training class prior / majority: audit · metrics.average_precision_sklearn
Configuration: Training class prior / majority (MFASS v2 canonical held-out split)	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.04 Precision at 100 unitless · higher Uncertainty: Not reported by the source: Not estimated; one selected evaluation. Coverage: 8324/8324 scored	Rewire evaluation · Source checked Methods, coverage and source Training class prior / majority on MFASS v2 canonical held-out split MFASS v2 canonical held-out split Aggregation: Not reported Training class prior / majority: report; Training class prior / majority: audit · metrics.precision_at_capacity
Configuration: Corrected k-mer / position baseline	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.778 AUROC unitless · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source Corrected k-mer / position baseline on MFASS v2 Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: auroc
Configuration: Corrected k-mer / position baseline	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.286 Average precision fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source Corrected k-mer / position baseline on MFASS v2 Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Aggregation: Not reported MFASS v2 corrected k-mer baseline: pinned upstream result JSON · JSON pointer /metrics/average_precision_sklearn
Configuration: Corrected k-mer / position baseline	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.61 Precision at 100 fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source Corrected k-mer / position baseline on MFASS v2 Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: precision_at_100
Pipeline: DNABERT-2 117M · frozen pair embeddings	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.55 AUROC unitless · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source DNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: auroc
Pipeline: DNABERT-2 117M · frozen pair embeddings	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.0451 Average precision fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source DNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: average_precision
Pipeline: DNABERT-2 117M · frozen pair embeddings	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.03 Precision at 100 fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source DNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: precision_at_100
Configuration: Pangolin · mask=False	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.876 AUROC unitless · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8301/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source Pangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: auroc
Configuration: Pangolin · mask=False	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.389 Average precision fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8301/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source Pangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: average_precision
Configuration: Pangolin · mask=False	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.65 Precision at 100 fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8301/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source Pangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100
Configuration: SpliceAI 1.3.1	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.806 AUROC unitless · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8194/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source SpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: auroc
Configuration: SpliceAI 1.3.1	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.299 Average precision fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8194/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source SpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision
Configuration: SpliceAI 1.3.1	Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort	0.64 Precision at 100 fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8194/8324 scored	Rewire evaluation · Independently reproduced Methods, coverage and source SpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: precision_at_100
Configuration: MMSplice (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.256 Average precision unitless · higher Uncertainty: 95% CI 0.226 to 0.285 Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source MMSplice on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'MMSplice', columns 'AP' and 'AP 95% CI'
Configuration: MMSplice (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.758 AUROC unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source MMSplice on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'MMSplice', column 'AUROC'
Configuration: MMSplice (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	27,733 Count (variants scored) count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source MMSplice on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'MMSplice', column 'n'
Configuration: Pangolin (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.421 Average precision unitless · higher Uncertainty: 95% CI 0.386 to 0.454 Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source Pangolin on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'Pangolin', columns 'AP' and 'AP 95% CI'
Configuration: Pangolin (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.888 AUROC unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source Pangolin on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'Pangolin', column 'AUROC'
Configuration: Pangolin (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	27,733 Count (variants scored) count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source Pangolin on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'Pangolin', column 'n'
Configuration: SPANR (legacy) (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.228 Average precision unitless · higher Uncertainty: 95% CI 0.202 to 0.260 Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source SPANR (legacy) on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'SPANR (legacy)', columns 'AP' and 'AP 95% CI'
Configuration: SPANR (legacy) (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.748 AUROC unitless · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source SPANR (legacy) on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'SPANR (legacy)', column 'AUROC'
Configuration: SPANR (legacy) (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	27,663 Count (variants scored) count · unknown Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source SPANR (legacy) on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'SPANR (legacy)', column 'n'
Configuration: SpliceAI (Znabu et al. 2026)	Protocol: MFASS splice-disrupting variant detection, all 27,733 labelled SNVs (Znabu et al. 2026) Dataset: MFASS v2 eligible assay cohort	0.321 Average precision unitless · higher Uncertainty: 95% CI 0.293 to 0.353 Coverage: Not reported scored / Not reported eligible	Independent external evaluation · Source checked Methods, coverage and source SpliceAI on all labelled MFASS SNVs splicing-follow-up-20261009-protocol-znabu2026-mfass-full-cohort Aggregation: Not reported A Reproducible MFASS Benchmark of Splice-Disruption Predictors Reveals a Shared Exon-Interior Blind Spot · Section 4 'Results' table (page 3), row 'SpliceAI', columns 'AP' and 'AP 95% CI'

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Research readiness

2 of 4 readiness checks met. These checks assess whether the evidence supports a reproducible investigation; a source-checked score alone does not meet them.

Readiness checks, gaps and artifacts

Release 2026-11-02-a7f03c9e55a5 · Evidence verified: 2026-09-23

Evidence complete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Supporting evidence

mfass-v2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
mfass-v2-discrepancies: join_integrity: 8324 unique test IDs; scores and outcomes reconcile.
mfass-v2-discrepancies: score_semantics: Higher scores predict higher assay splice disruption; metrics retain their own direction.
mfass-v2-discrepancies: metric_replay: Saved predictions reproduce recorded metrics within 1e-9 absolute tolerance.

Verified: 2026-09-23

Evidence complete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Supporting evidence

mfass-v2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
mfass-v2-discrepancies: join_integrity: 8324 unique test IDs; scores and outcomes reconcile.
mfass-v2-discrepancies: score_semantics: Higher scores predict higher assay splice disruption; metrics retain their own direction.
mfass-v2-discrepancies: metric_replay: Saved predictions reproduce recorded metrics within 1e-9 absolute tolerance.
mfass-v2-discrepancies: annotations: Registered subgroup fields derive from the preserved source snapshot.
mfass-v2-discrepancies: dependence: connected exon/gene group

Verified: 2026-09-23

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

A pinned run recipe exists: not yet verified
Compute requirements are estimated: not yet verified
No pinned local execution recipe is declared.
Local execution requires exactly one pinned prepared artifact.
Local execution requires exactly one pinned recipe code artifact.

Supporting evidence

mfass-v2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
mfass-v2-discrepancies: join_integrity: 8324 unique test IDs; scores and outcomes reconcile.
mfass-v2-discrepancies: score_semantics: Higher scores predict higher assay splice disruption; metrics retain their own direction.

Verified: 2026-09-23

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

Independent validation data exist: not yet verified
Overlap with training data is checked: not yet verified
Data has already been exposed during hypothesis selection; it is not untouched validation.

Supporting evidence

mfass-v2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
mfass-v2-discrepancies: join_integrity: 8324 unique test IDs; scores and outcomes reconcile.
mfass-v2-discrepancies: score_semantics: Higher scores predict higher assay splice disruption; metrics retain their own direction.

Verified: 2026-09-23

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Limitations

Existing test outcomes have been inspected; all new subgroup findings are exploratory.
Specialists use different genomic context and annotation releases; model-only attribution is unsupported.
Boundary bands are symmetric distances, not canonical dinucleotide annotations; baseline uses distance features.
The historical v1 sequence-orientation error is already corrected and is not a new discovery.
Source assay data have no declared redistribution licence; obtain original tables from KosuriLab/MFASS.
Evidence is exploratory because this data has already been examined.

Artifacts and reproduction

One or more artifacts need a local resolver. Their checksums are recorded, but this release does not provide every download.

MFASS v2: model disagreement

Does model disagreement depend on exon boundary distance, assay replicate agreement or gene/exon concentration?

Manifest: mfass-v2-discrepancies
Prepared outcome: assay splice disruption
Outcome type: binary
Units: binary label
Score direction: higher
Join identifier: id
Unit of independence: connected exon/gene group
Split: test
Prior data exposure: Already used for exploration; not untouched validation

Evaluation protocol and run instructions

Resolve each required artifact from its recorded source, verify its SHA-256, and retain the prepared snapshot and identifiers. A missing public URL means this release does not redistribute that file.

mfass-v2-discrepancies-cohort

cohort · tsv

No public download in this release. Obtain access using the documented source and terms.

File SHA-256: 389702ff4c647d7ce10a90092a6fa811ae777d15997baf39ce9aae0346247bd0

mfass-v2-discrepancies-outcomes

outcomes · txt

Artifact source

File SHA-256: a637ca0e307e66ff48811ec7efa22b9ce453bc7883b04f0cacb867f7283132d8

mfass-v2-discrepancies-annotations

annotations · txt

Artifact source

File SHA-256: 71a857fe647c4e68acbb41ca61e959c47e1176de89b1442bd6ca1772aa60d5a1

mfass-v2-discrepancies-split

split · tsv

Artifact source

File SHA-256: 999ebcb7e63a5c5eaa8780fa468e59ac1f934260ad50102814174c396317f052

mfass-v2-discrepancies-baseline-kmer-position-v2-scores

baseline-kmer-position-v2-scores · npy

Artifact source

File SHA-256: ed0ebb3d74183deb1fb475d0e706c0b1211fd6ab9d20449c2c194e57f912d862

mfass-v2-discrepancies-baseline-kmer-position-v2-predictions

baseline-kmer-position-v2-predictions · tsv

Artifact source

File SHA-256: 2f3117c225a8da9ea737abfa2d0f7e1dec97696ae4bacd263864bec9d7f923eb

mfass-v2-discrepancies-baseline-kmer-position-v2-report

baseline-kmer-position-v2-report · json

Artifact source

File SHA-256: 9a0b78674cc714177fec6e8c487588d6186d4fe93d6d7dbcb48bed6858885e15

mfass-v2-discrepancies-dnabert2-117m-frozen-pair-logreg-scores

dnabert2-117m-frozen-pair-logreg-scores · npy

Artifact source

File SHA-256: e6b019babf0b3fb9ec05d4261a9383c0c896183a76c3b31634564c7a63d01105

mfass-v2-discrepancies-dnabert2-117m-frozen-pair-logreg-predictions

dnabert2-117m-frozen-pair-logreg-predictions · tsv

Artifact source

File SHA-256: 3abded2932366e6e2c8d6e0da5836c4240239372758b3c68cd5f19635b8cee11

mfass-v2-discrepancies-dnabert2-117m-frozen-pair-logreg-report

dnabert2-117m-frozen-pair-logreg-report · json

Artifact source

File SHA-256: 60b28541853de349f878d6d1ccbcbe7dfd21b69db976e9c01f60e88bdba0f2a1

mfass-v2-discrepancies-spliceai-1.3.1-predictions

spliceai-1.3.1-predictions · tsv

Artifact source

File SHA-256: b39df773067e4ecd862980f177da69d6117c75c93c754f4cbdd7a77bd419851f

mfass-v2-discrepancies-spliceai-1.3.1-report

spliceai-1.3.1-report · json

Artifact source

File SHA-256: 6d5c59eb0fd60d95064d97e331c9cdb12b2a34db7dc509ff73dfb9502ddf02dd

mfass-v2-discrepancies-pangolin-maskFalse-predictions

pangolin-maskFalse-predictions · tsv

Artifact source

File SHA-256: faa7d4cb3728111f1c5a8e8be6cd2c5958c4cced7c7a366ec96171d03b855ad6

mfass-v2-discrepancies-pangolin-maskFalse-report

pangolin-maskFalse-report · json

Artifact source

File SHA-256: bb0bb6732808699e54938233df1835dfc1f775f33ba7d6acd916e53d588a3c44

mfass-v2-discrepancies-table

table · json

No public download in this release. Obtain access using the documented source and terms.

File SHA-256: c57f9cfe91d02ab54f6bc20934f5b8f678b37c3b13d8d20aa805fa7d73e62c4f

mfass-v2-discrepancies-receipt

receipt · json

No public download in this release. Obtain access using the documented source and terms.

File SHA-256: a9fa54bcf99457f9b23424ad656a952eb262b376845327e267dc035cf85a012e

mfass-v2-discrepancies-preparation_code

preparation code · py

No public download in this release. Obtain access using the documented source and terms.

File SHA-256: 8a1d691de8fdd9fcf8242fe6fa2cfe2703a1c3281b880fe2a226cb8bd946fd1b

mfass-v2-discrepancies-environment

environment · lock

No public download in this release. Obtain access using the documented source and terms.

File SHA-256: 748257abb3664595db1ebf892799e91c6f1a4ca79b0e65eccb3958cf5644a671

Registered recipes and verification receipt

Local recipes: None recorded
Verification: verified at: 2026-09-23T23:00:14.349323+00:00; checks: check: artifact_hashes; status: passed; detail: Exact local bytes recorded; source pins checked where available.; check: join_integrity; status: passed; detail: 8324 unique test IDs; scores and outcomes reconcile.; check: score_semantics; status: passed; detail: Higher scores predict higher assay splice disruption; metrics retain their own direction.; check: metric_replay; status: passed; detail: Saved predictions reproduce recorded metrics within 1e-9 absolute tolerance.; check: annotations; status: passed; detail: Registered subgroup fields derive from the preserved source snapshot.; check: dependence; status: passed; detail: connected exon/gene group; limitations: Existing test outcomes have been inspected; all new subgroup findings are exploratory.; Specialists use different genomic context and annotation releases; model-only attribution is unsupported.; Boundary bands are symmetric distances, not canonical dinucleotide annotations; baseline uses distance features.; The historical v1 sequence-orientation error is already corrected and is not a new discovery.; Source assay data have no declared redistribution licence; obtain original tables from KosuriLab/MFASS.

Dataset and evaluation context

A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

9 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statement	Original source and location	Review and provenance
Cohort variants 27733 Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.cohort_variants` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Independent test groups 463 Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.independent_test_groups` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Split split-v2.tsv Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.split` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Test positives 315 Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.test_positives` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Test variants 8324 Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.test_variants` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Train variants 19409 Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.train_variants` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Version bee9133b83f3aedaf2bbb9013f1875515845607e Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `attributes.version` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Description No value recorded Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	missing or unspecified No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash
Name MFASS v2 eligible assay cohort Context-only references	MFASS v2 pinned rewire artifacts Original source ↗ No field-specific location recorded Version: bee9133b83f3aedaf2bbb9013f1875515845607e Retrieved: 2026-09-16T10:50:02Z	not individually reviewed No individual claim review recorded Audit details Field: `name` Source artifact SHA-256: `a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d` Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release history

MFASS v2 pinned rewire artifacts · Original source · bee9133b83f3aedaf2bbb9013f1875515845607e

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: rewire-mfass-v2-dataset

areas: dna-genomes
version: bee9133b83f3aedaf2bbb9013f1875515845607e
split: split-v2.tsv
cohort variants: 27733
train variants: 19409
test variants: 8324
test positives: 315
independent test groups: 463
entity classification: review date: 2026-09-17; rationale: This record identifies a biological data collection or source-labelled evaluation cohort. Keep its dataset identity; split, assay, taxonomic level, candidate restrictions and comparison context remain attributes rather than automatically becoming new entity kinds.; source ids: rewire-mfass-v2-source; source locator: MFASS v2 revision bee9133b83f3aedaf2bbb9013f1875515845607e; split-v2.tsv and cohort eligibility metadata; ambiguities: None recorded

Related records

Suggest a correction