rewirebio.iobenchmarks
Source

MFASS matched canonical annotation v1: report.json

093fd1ae198c80ce34408d84d6543bca4fc538f2

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
Pangolin 1.0.2 + per-gene masking patch · mask False (P0)AUROC0.8763341447710142 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask False (P0) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask False (P0)Average precision0.3886980279221367 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask False (P0) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask False (P0)Precision at 1000.65 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask False (P0) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask False (P0)Recall at 1000.2070063694267516 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask False (P0) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask True (P1)AUROC0.8725933133386153 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask True (P1) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask True (P1)Average precision0.4106314557636091 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask True (P1) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask True (P1)Precision at 1000.66 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask True (P1) on MFASS matched annotation
Pangolin 1.0.2 + per-gene masking patch · mask True (P1)Recall at 1000.21019108280254778 unitlessMFASS v2 test: matched canonical annotation coveragePangolin 1.0.2 + per-gene masking patch · mask True (P1) on MFASS matched annotation
SpliceAI 1.3.1 · mask 0 (S0)AUROC0.8035576794956798 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 0 (S0) on MFASS matched annotation
SpliceAI 1.3.1 · mask 0 (S0)Average precision0.29537139738069396 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 0 (S0) on MFASS matched annotation
SpliceAI 1.3.1 · mask 0 (S0)Precision at 1000.63 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 0 (S0) on MFASS matched annotation
SpliceAI 1.3.1 · mask 0 (S0)Recall at 1000.20063694267515925 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 0 (S0) on MFASS matched annotation
SpliceAI 1.3.1 · mask 1 (S1)AUROC0.8148394159244446 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation
SpliceAI 1.3.1 · mask 1 (S1)Average precision0.3125881842529626 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation
SpliceAI 1.3.1 · mask 1 (S1)Precision at 1000.65 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation
SpliceAI 1.3.1 · mask 1 (S1)Recall at 1000.2070063694267516 unitlessMFASS v2 test: matched canonical annotation coverageSpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Configurations (4)

Protocols (1)

Dataset subsets (1)

Baselines (2)

Evaluations (4)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

14 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/093fd1ae198c80ce34408d84d6543bca4fc538f2/benchmarks/mfass/results/matched-annotation-v1/report.json
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Evidence origin
rewire_run
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.evidence_origin

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-25T11:24:56Z
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source type
rewire_execution_report
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.source_type

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://github.com/rewire-bio/rewire-benchmarks/blob/093fd1ae198c80ce34408d84d6543bca4fc538f2/benchmarks/mfass/results/matched-annotation-v1/report.json
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
093fd1ae198c80ce34408d84d6543bca4fc538f2
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
8,297 of 8,324 held-out variants scored in every configuration (314 positives, 460 exon groups). The same 27 rows are excluded: 23 assembly-orientation mismatches and four outside the selected canonical transcript spans. Missing scores are not zero or negative predictions.
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Facets: areas
1 values
  • dna-genomes
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: facets.areas

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record ID
rewire-mfass-matched-v1-source-report
Source metadata
MFASS matched canonical annotation v1: report.json

Original source ↗

No field-specific location recorded

Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2
Retrieved: 2026-09-25T11:24:56Z

catalogued

No individual claim review recorded

Audit details

Field: id

Source artifact SHA-256: 259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

8,297 of 8,324 held-out variants scored in every configuration (314 positives, 460 exon groups). The same 27 rows are excluded: 23 assembly-orientation mismatches and four outside the selected canonical transcript spans. Missing scores are not zero or negative predictions.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: rewire-mfass-matched-v1-source-report

areas
dna-genomes
url
https://github.com/rewire-bio/rewire-benchmarks/blob/093fd1ae198c80ce34408d84d6543bca4fc538f2/benchmarks/mfass/results/matched-annotation-v1/report.json
artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/093fd1ae198c80ce34408d84d6543bca4fc538f2/benchmarks/mfass/results/matched-annotation-v1/report.json
artifact sha256
259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3
version
093fd1ae198c80ce34408d84d6543bca4fc538f2
retrieved at
2026-09-25T11:24:56Z
source type
rewire_execution_report
evidence origin
rewire_run
Related records

    Suggest a correction