Source

rewirebench: MFASS protocol code

f80cef7f818bec33e51b7f43ad499eb5078c8d87

What this source contributed

Records in this release that cite this source. A record can cite several sources.

1 protocol
1 baseline
4 evaluations
12 results
1 evidence claim

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configuration	Metric	Value	Dataset	Evaluation
Corrected k-mer / position baseline	AUROC	0.7779498064677238 unitless	MFASS v2 eligible assay cohort	Corrected k-mer / position baseline on MFASS v2
Corrected k-mer / position baseline	Average precision	0.2864167459589237 fraction	MFASS v2 eligible assay cohort	Corrected k-mer / position baseline on MFASS v2
Corrected k-mer / position baseline	Precision at 100	0.61 fraction	MFASS v2 eligible assay cohort	Corrected k-mer / position baseline on MFASS v2
DNABERT-2 117M · frozen pair embeddings	AUROC	0.5500324040216661 unitless	MFASS v2 eligible assay cohort	DNABERT-2 117M · frozen pair embeddings on MFASS v2
DNABERT-2 117M · frozen pair embeddings	Average precision	0.04508654312652131 fraction	MFASS v2 eligible assay cohort	DNABERT-2 117M · frozen pair embeddings on MFASS v2
DNABERT-2 117M · frozen pair embeddings	Precision at 100	0.03 fraction	MFASS v2 eligible assay cohort	DNABERT-2 117M · frozen pair embeddings on MFASS v2
Pangolin · mask=False	AUROC	0.8756851300560864 unitless	MFASS v2 eligible assay cohort	Pangolin · mask=False on MFASS v2
Pangolin · mask=False	Average precision	0.3887617543064248 fraction	MFASS v2 eligible assay cohort	Pangolin · mask=False on MFASS v2
Pangolin · mask=False	Precision at 100	0.65 fraction	MFASS v2 eligible assay cohort	Pangolin · mask=False on MFASS v2
SpliceAI 1.3.1	AUROC	0.8055241740253153 unitless	MFASS v2 eligible assay cohort	SpliceAI 1.3.1 on MFASS v2
SpliceAI 1.3.1	Average precision	0.2986855472760137 fraction	MFASS v2 eligible assay cohort	SpliceAI 1.3.1 on MFASS v2
SpliceAI 1.3.1	Precision at 100	0.64 fraction	MFASS v2 eligible assay cohort	SpliceAI 1.3.1 on MFASS v2

Claims

Statements this source supports, each with where in the source it was checked.

Relevance of MFASS v2 to "Prioritise variants for splicing experiments": Assessed by MFASS v2 (rewire-mfass-v2-source: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json; rewire-local-20260921-source-mfass-prior: results/baseline-kmer-position-v2.json; matched specialist and DNABERT2 result files; training-prior.report.json)

Models, benchmarks and other records

Protocols (1)

MFASS v2

Baselines (1)

Corrected k-mer / position baseline measured comparator

Evaluations (4)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statement	Original source and location	Review and provenance
Artifact format text Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.artifact_format` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Artifact SHA-256 6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93 Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.artifact_sha256` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Hash scope complete file bytes Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.hash_scope` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Retrieved at 2026-09-17 Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.retrieved_at` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Review: method note AI-assisted implementation and protocol review Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.review.method_note` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Review method 1 values ai-assisted-source-review Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.review.method` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Source location packages/rewirebench/src/rewirebench/protocols/mfass.py Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.source_locator` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Url https://github.com/rewire-bio/rewire-benchmarks/blob/f80cef7f818bec33e51b7f43ad499eb5078c8d87/packages/rewirebench/src/rewirebench/protocols/mfass.py Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.url` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Version f80cef7f818bec33e51b7f43ad499eb5078c8d87 Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `attributes.version` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text
Description No value recorded Source metadata	rewirebench: MFASS protocol code Original source ↗ No field-specific location recorded Version: f80cef7f818bec33e51b7f43ad499eb5078c8d87 Retrieved: 2026-09-17	catalogued No individual claim review recorded Audit details Field: `description` Source artifact SHA-256: `6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93` Hash scope: complete file bytes Format: text

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)

Technical metadata and extraction receipts

Stable ID: runner-recipe-packages-rewirebench-src-rewirebench-protocols-mfass-py-f80cef7f

url: https://github.com/rewire-bio/rewire-benchmarks/blob/f80cef7f818bec33e51b7f43ad499eb5078c8d87/packages/rewirebench/src/rewirebench/protocols/mfass.py
version: f80cef7f818bec33e51b7f43ad499eb5078c8d87
retrieved at: 2026-09-17
artifact sha256: 6d090a6b1622fe571b8c48ecc213b9b6adf3cbf06cc2abc2d3bfc891a3f8ed93
hash scope: complete file bytes
artifact format: text
source locator: packages/rewirebench/src/rewirebench/protocols/mfass.py
review: method: ai-assisted-source-review; method note: AI-assisted implementation and protocol review

Related records

Suggest a correction