Datasets
The linked rewire MFASS v2 protocol defines its reconciled eligible variants and fixed test cohort; this guide is not another dataset release.
MFASS prioritisation asks whether variant scores enrich for experimentally disrupted exon recognition.
The linked rewire MFASS v2 protocol defines its reconciled eligible variants and fixed test cohort; this guide is not another dataset release.
Precision at 100, average precision and AUROC in the pinned v2 evaluation. Coverage and paired uncertainty belong beside each comparison.
Variant scores aligned to the MFASS reporter-assay labels; assay-oriented sequence pairs for the corrected local baseline.
Conceptual task guide. Dataset preparation, parameters and scoring must come from a separately identified protocol.
limited source coverage · Automated source review, 2026-09-23. All specifications and missing details
Each comparison retains its reviewed evaluation scope, dataset and metric. Results are shown without a pooled ranking.
Precision at 100 (dimensionless) · Higher values are better.
MFASS: matched GENCODE 44 canonical annotation · MFASS v2 test: matched canonical annotation coverage
Evidence origin: Rewire evaluation.
MFASS matched canonical annotation v1: report.json; MFASS matched canonical annotation v1: manifest-v1.json; MFASS matched canonical annotation v1: verification.json; MFASS matched canonical annotation v1: provenance.json; MFASS matched canonical annotation v1: exclusion-verification.json · report.json: conditions.*.metrics.precision_at_capacity8,297 of 8,324 held-out variants scored in every configuration (314 positives, 460 exon groups). The same 27 rows are excluded: 23 assembly-orientation mismatches and four outside the selected canonical transcript spans. Missing scores are not zero or negative predictions.
Automated source review: 2026-09-25. Numerical source review does not establish independent reproduction.
Dots show point estimates. Whiskers show only explicitly defined uncertainty (standard deviation, standard error or a labelled interval); their definitions remain in Table. Unresolved uncertainty is not plotted. Differences do not establish statistical significance.
Showing 4 of 4 matching rows.
The corrected rewire v2 protocol validates assay-oriented reference and mutant pairs and uses a fixed grouped split. Its baseline window is placed around the validated variant position. This task guide links that concrete protocol without replacing its identity. Preserve specialist sequence context, missing predictions and the chosen review capacity when comparing methods.
This is a task guide, not a single versioned benchmark protocol. The connected resources provide examples or concrete procedures. A candidate method or proposed control is not evidence that an evaluation has been completed.
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
These source-backed links do not make different protocols or scores interchangeable.
Choose a concrete protocol before running an evaluation. Its inputs, split and scoring rules determine which results can be compared.
No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.
Follow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied.
Stable record: catalog-task-mfass-spliceExplanatory profile: limited source coverage · Automated source review, 2026-09-23. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Entity type | Task guide; concrete protocol identities remain separate.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Datasets | The linked rewire MFASS v2 protocol defines its reconciled eligible variants and fixed test cohort; this guide is not another dataset release.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Organisms | Human variants evaluated through the MFASS reporter assay; this is not a population-level clinical validation.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Assays | MFASS reporter-based exon-recognition measurements, using the labels and eligibility rules preserved by the v2 protocol.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Splits | Use the grouped split-v2 manifests in the pinned runner revision. Preserve the train/test assignment and exclusions.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Allowed inputs | Variant scores aligned to the MFASS reporter-assay labels; assay-oriented sequence pairs for the corrected local baseline.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Adaptation | The corrected baseline and frozen-encoder logistic pipeline fit the training arm; the specialist scorers retain their published configurations.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Metrics | Precision at 100, average precision and AUROC in the pinned v2 evaluation. Coverage and paired uncertainty belong beside each comparison.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Baselines | The v2 k-mer/position baseline is a trained comparator. SpliceAI, Pangolin and the frozen DNABERT-2 logistic pipeline retain their own input and fitting definitions.SourcesMFASS v2 pinned rewire artifacts · Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files |
| Coverage and comparison scope | The linked rewire v2 protocol has 8,324 held-out variants, but scored coverage depends on the method. Compare candidate and baseline on their common scored variants and retain excluded counts and connected-group counts. This guide defines no additional cohort or split.Sources (4)MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e; Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-spliceai.json; Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-pangolin-maskFalse.json; Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-dnabert2.json · README.md lines 141–171; comparison JSON: denominators and independent_groups |
| Uncertainty | For the linked v2 comparisons, intervals describe paired candidate-minus-baseline differences from 2,000 whole-group bootstrap draws. They do not represent absolute method confidence intervals; capacity-100 precision keeps the review-list fraction fixed during resampling.Sources (4)Protocol metadata evidence: mfass-metrics.py; Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-spliceai.json; Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-pangolin-maskFalse.json; Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-dnabert2.json · metrics.py lines 65–140; comparison JSON: capacity, seed and paired.* |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Last literature check: 2026-09-17. Primary-source discovery and table/protocol screening; source checked is not independently reproduced. Raw acquisitions not automatically numerical publication approval.
| Paper or primary resource | Version | Reference |
|---|---|---|
| mfass original | PMC primary-source artifact, version pinned by SHA256 | Read source |
| A Multiplexed Assay for Exon Recognition Reveals that an Unappreciated Fraction of Rare Genetic Variants Cause Large-Effect Splicing Disruptions | Original published article | Read source DOI: 10.1016/j.molcel.2018.10.037 |
The catalogue now holds 31 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.
broad task primary raw retrieval blocked existing corrected run retained
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
26 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Conceptual task guide. Dataset preparation, parameters and scoring must come from a separately identified protocol. Individual claims | MFASS v2 pinned rewire artifacts Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
Diagram steps
| MFASS v2 pinned rewire artifacts Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Diagram title Conceptual evaluation workflow Individual claims | MFASS v2 pinned rewire artifacts Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Entity type Task guide; concrete protocol identities remain separate. Individual claims | MFASS v2 pinned rewire artifacts Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Datasets The linked rewire MFASS v2 protocol defines its reconciled eligible variants and fixed test cohort; this guide is not another dataset release. Individual claims | MFASS v2 pinned rewire artifacts Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Uncertainty For the linked v2 comparisons, intervals describe paired candidate-minus-baseline differences from 2,000 whole-group bootstrap draws. They do not represent absolute method confidence intervals; capacity-100 precision keeps the review-list fraction fixed during resampling. Individual claims | Protocol metadata evidence: mfass-metrics.py metrics.py lines 65–140; comparison JSON: capacity, seed and paired.* Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Uncertainty For the linked v2 comparisons, intervals describe paired candidate-minus-baseline differences from 2,000 whole-group bootstrap draws. They do not represent absolute method confidence intervals; capacity-100 precision keeps the review-list fraction fixed during resampling. Individual claims | Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-dnabert2.json metrics.py lines 65–140; comparison JSON: capacity, seed and paired.* Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Uncertainty For the linked v2 comparisons, intervals describe paired candidate-minus-baseline differences from 2,000 whole-group bootstrap draws. They do not represent absolute method confidence intervals; capacity-100 precision keeps the review-list fraction fixed during resampling. Individual claims | Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-pangolin-maskFalse.json metrics.py lines 65–140; comparison JSON: capacity, seed and paired.* Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Uncertainty For the linked v2 comparisons, intervals describe paired candidate-minus-baseline differences from 2,000 whole-group bootstrap draws. They do not represent absolute method confidence intervals; capacity-100 precision keeps the review-list fraction fixed during resampling. Individual claims | Protocol metadata evidence: mfass-results-compare-baseline-v2-vs-spliceai.json metrics.py lines 65–140; comparison JSON: capacity, seed and paired.* Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Organisms Human variants evaluated through the MFASS reporter assay; this is not a population-level clinical validation. Individual claims | MFASS v2 pinned rewire artifacts Pinned MFASS v2 README: Correction, Dataset, Cohort reconciliation and Split; committed results files Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-23 Audit detailsFollow-up review of Coverage and comparison scope, Uncertainty. Source locations and before/after decisions are recorded in the 23 September profile-evidence audit. Other explanatory content retains its earlier source scope. No human scientific review or independent reproduction is implied. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: discovered
Stable ID: catalog-task-mfass-splice