rewirebio.iobenchmarks
Evidence claim

Relevance of MFASS v2 to "Prioritise variants for splicing experiments"

Use case
Prioritise variants for splicing experiments
Assessed by
MFASS v2
Relevance
Proxy evidence
Endpoint
Historical corrected MFASS v2 ranking and top-100 follow-up precision for supervised feature and training-prior controls

Assay-matched measured comparison informs the research decision within its original population and protocol; prospective transfer is not established.

2 reviewed evaluations

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

32 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Citation locations
2 values
  • source id
    rewire-mfass-v2-source
    locator
    results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json
  • source id
    rewire-local-20260921-source-mfass-prior
    locator
    results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json
Context-only references
Training class prior / majority: report

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: 89e06a2f7229f16b980254a6589eb808ec89137018388db98719beb72324f56a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Citation locations
2 values
  • source id
    rewire-mfass-v2-source
    locator
    results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json
  • source id
    rewire-local-20260921-source-mfass-prior
    locator
    results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json
Context-only references
MFASS v2 pinned rewire artifacts

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bee9133b83f3aedaf2bbb9013f1875515845607e
Retrieved: 2026-09-16T10:50:02Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.citation_locators

Source artifact SHA-256: a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d

Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

Constraints
3 values
  • Inspect scored and eligible counts for every condition.
  • Consult recorded paired comparisons before interpreting differences.
  • This mapping contains only the two baseline configurations. Historical specialist and DNABERT2 evaluations remain outside this mapping.
Context-only references
Training class prior / majority: report

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: 89e06a2f7229f16b980254a6589eb808ec89137018388db98719beb72324f56a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Constraints
3 values
  • Inspect scored and eligible counts for every condition.
  • Consult recorded paired comparisons before interpreting differences.
  • This mapping contains only the two baseline configurations. Historical specialist and DNABERT2 evaluations remain outside this mapping.
Context-only references
MFASS v2 pinned rewire artifacts

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bee9133b83f3aedaf2bbb9013f1875515845607e
Retrieved: 2026-09-16T10:50:02Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.constraints

Source artifact SHA-256: a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d

Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

Endpoint
Historical corrected MFASS v2 ranking and top-100 follow-up precision for supervised feature and training-prior controls
Context-only references
Training class prior / majority: report

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: 89e06a2f7229f16b980254a6589eb808ec89137018388db98719beb72324f56a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Endpoint
Historical corrected MFASS v2 ranking and top-100 follow-up precision for supervised feature and training-prior controls
Context-only references
MFASS v2 pinned rewire artifacts

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bee9133b83f3aedaf2bbb9013f1875515845607e
Retrieved: 2026-09-16T10:50:02Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.endpoint

Source artifact SHA-256: a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d

Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

Excluded evaluations
3 values
  • id
    rewire-evaluation-dnabert2-117m-frozen-pair-logreg
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
  • id
    rewire-evaluation-pangolin-maskfalse
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
  • id
    rewire-evaluation-spliceai-1-3-1
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
Context-only references
Training class prior / majority: report

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: 89e06a2f7229f16b980254a6589eb808ec89137018388db98719beb72324f56a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Excluded evaluations
3 values
  • id
    rewire-evaluation-dnabert2-117m-frozen-pair-logreg
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
  • id
    rewire-evaluation-pangolin-maskfalse
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
  • id
    rewire-evaluation-spliceai-1-3-1
    reason
    Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
Context-only references
MFASS v2 pinned rewire artifacts

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bee9133b83f3aedaf2bbb9013f1875515845607e
Retrieved: 2026-09-16T10:50:02Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.excluded_evaluations

Source artifact SHA-256: a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d

Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

Claimed field
links:assessed_by:rewire-mfass-v2
Context-only references
Training class prior / majority: report

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 89e06a2f7229f16b980254a6589eb808ec89137018388db98719beb72324f56a

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed field
links:assessed_by:rewire-mfass-v2
Context-only references
MFASS v2 pinned rewire artifacts

Original source ↗

rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: bee9133b83f3aedaf2bbb9013f1875515845607e
Retrieved: 2026-09-16T10:50:02Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: a3af693afc070b39b334e359beed7f9affd76f7456a4f9264e2d1e9dab26111d

Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash

How to read the evidence

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: use-case-mapping-20260930-339-25925e279972

field
links:assessed_by:rewire-mfass-v2
value
rewire-mfass-v2
relevance
proxy
endpoint
Historical corrected MFASS v2 ranking and top-100 follow-up precision for supervised feature and training-prior controls
rationale
Assay-matched measured comparison informs the research decision within its original population and protocol; prospective transfer is not established.
constraints
Inspect scored and eligible counts for every condition.; Consult recorded paired comparisons before interpreting differences.; This mapping contains only the two baseline configurations. Historical specialist and DNABERT2 evaluations remain outside this mapping.
limitations
Historical v2 annotation/coverage differs from matched-annotation v1: do not combine measurements.; Each method uses its own scored subset; marginal point scores do not establish a matched winner.; The constant prior has tied predictions; top-100 positives depend on fixed label-independent tie order.; Assay labels are not patient RNA or clinical endpoints.; DNABERT2 is represented as a pipeline, which is ineligible for this exact-configuration use-case mapping. Its existing evaluation remains in the catalogue and coverage audit; no record was promoted or score duplicated.
revision
1
reason
Add independently checked primary-source protocol evidence from the 17-use-case coverage audit; retain narrower endpoint and transfer limitations.
citation locators
source id: rewire-mfass-v2-source; locator: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; source id: rewire-local-20260921-source-mfass-prior; locator: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json
source locator
rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json
excluded evaluations
id: rewire-evaluation-dnabert2-117m-frozen-pair-logreg; reason: Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).; id: rewire-evaluation-pangolin-maskfalse; reason: Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).; id: rewire-evaluation-spliceai-1-3-1; reason: Not in the reviewed mapping's evaluation list when use cases moved into the store (2026-10-09).
review
method: automated-source-review; reviewer: codex; reviewer note: Codex source curation, independent worker cross-review and root integration review; reviewed at: 2026-09-30T21:54:30.217Z; note: Source-backed literature curation with independent automated transcription and scope checks. No new model execution, independent experimental replication, qualified human scientific review or clinical validation.
reviewed evaluations
rewire-evaluation-baseline-kmer-position-v2; rewire-local-20260921-evaluation-mfass-prior
pins
record id: evidence-benchmark-mfass-pinned-readme; fields: status; attributes.artifact_sha256; sha256: 1e0a80ec8994de637a0f8d760302da0c6638bc550de977863be8a7b30fb61a00; record id: evidence-expansion-mfass-readme-62a93814; fields: status; attributes.artifact_sha256; sha256: 1e0a80ec8994de637a0f8d760302da0c6638bc550de977863be8a7b30fb61a00; record id: rewire-evaluation-baseline-kmer-position-v2; fields: status; links; attributes.origin; attributes.comparison; sha256: aa36410da2080555d6048eb6293fbc4a21273991e15058da741caa2a84e94795; record id: rewire-local-20260921-evaluation-mfass-prior; fields: status; links; attributes.origin; attributes.comparison; sha256: e59fe333e07998e1ac613002fcf75b0017eae85f0df034d461e189cf8f54a9ae; record id: rewire-local-20260921-result-mfass-prior-auroc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 740cfed6df00daea81802475ff0146baae86587f3541403336ac67ef36b6afa5; record id: rewire-local-20260921-result-mfass-prior-average-precision-sklearn; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 0e2ff4176ede84071d8376a3f9d7feedb329f17dc2fd4a4a6d8e1ba03721f5c1; record id: rewire-local-20260921-result-mfass-prior-precision-at-capacity; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 2245dd11195a7bb0ff609c6bb551fb9d98d98524216acb0f63554c6f3c893659; record id: rewire-local-20260921-source-mfass-prior; fields: status; attributes.artifact_sha256; sha256: d39af79c193d38ef54d52bef37ed88422d661d878ab07b13076c47b12fb7edbb; record id: rewire-mfass-v2; fields: status; name; description; facets; source_ids; links; attributes; sha256: 0b2bb4a77f60d7c6c95c101ac634b6d6c90ec112effd28e8e5997b28c1218e72; record id: rewire-mfass-v2-source; fields: status; attributes.artifact_sha256; sha256: 0eb5958d7f8b8df6eee790ce6863bfe4301a57c9c61b030cd8f542ef5ea3ee8a; record id: rewire-result-baseline-kmer-position-v2-auroc; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 3b9fc866ef3ce99e78f116d99fd9f2725ac821c7f25542f2d3ee378c72bf1f4d; record id: rewire-result-baseline-kmer-position-v2-average-precision; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 06c66a8b38def270aee08c397f5ac4ef38bd28e8112459090360ba2f1da64fa3; record id: rewire-result-baseline-kmer-position-v2-precision-at-100; fields: status; attributes.metric; attributes.metric_qualifier; attributes.printed_value; attributes.numeric_value; sha256: 161890d342b30f1280931b4f1121dc461d2be48e6d5e4255e361b2feb7a13a9a; record id: run-doc-mfass-pyproject-toml-68d1ee53; fields: status; attributes.artifact_sha256; sha256: b87c68147f884ce7540bb394c7185c59f8ea6e273c5700bc27aea68bf77aca4b; record id: run-doc-mfass-readme-md-68d1ee53; fields: status; attributes.artifact_sha256; sha256: 1e0a80ec8994de637a0f8d760302da0c6638bc550de977863be8a7b30fb61a00; record id: runner-receipt-mfass-v2-cpu-baselines-779eeb5c; fields: status; attributes.artifact_sha256; sha256: 7ae4c152743ed6bff181d4caaa3d7e975268c6d4a4430b9a678a33057415e6c7; record id: runner-recipe-docs-hpc-md-f80cef7f; fields: status; attributes.artifact_sha256; sha256: 5ff35d71252cfb26fcbd81eee021ee1fe96e2e8da125a7dc4b306e8e7e38c15e; record id: runner-recipe-docs-mfass-md-f80cef7f; fields: status; attributes.artifact_sha256; sha256: 01d5a91e9f65f084f1302fcfa776d869e240a6deda594380db0cc28528058b4e; record id: runner-recipe-docs-sdk-md-f80cef7f; fields: status; attributes.artifact_sha256; sha256: f4a00d76451058cae052ea00514cbab5f96b0a1608fd47cee1c3199f44664e23; record id: runner-recipe-packages-rewirebench-src-rewirebench-adapters-mfass-py-f80cef7f; fields: status; attributes.artifact_sha256; sha256: 5685c4fd0c5ceaf12f7c4ba09a5f7b82ad6e5580a9d0b932c5d0e2e2c7aee9ef; record id: runner-recipe-packages-rewirebench-src-rewirebench-protocols-mfass-py-f80cef7f; fields: status; attributes.artifact_sha256; sha256: 7feebfe80d57f6e88037e939c6de7b75f27c0cd91d56c901798b4438d394ccaf; record id: use-case-splicing-follow-up; fields: status; name; description; facets; attributes.question; attributes.decision; attributes.inputs; attributes.output; attributes.exclusions; attributes.setting; attributes.clinical_scope; attributes.intended_users; sha256: a811d697e1ee1733fb4ed295b0083737c626980c1af83116dc2e404cbf01821b
Related records

Suggest a correction