Recall (positives per known event or gene, negatives per true-negative sample; aggregated across the tissue sets each tool was run on (Table S9)) of MINTIE (Silverstein et al. 2026) on NIH neuromuscular diagnosed RNA-seq truth set (Silverstein et al. 2026)
0.348 Recall (positives per known event or gene, negatives per true-negative sample; aggregated across the tissue sets each tool was run on (Table S9))
Methods
- Tested configuration
- MINTIE (Silverstein et al. 2026)
- Protocol
- Recovery of known pathogenic splicing events and outlier calls in true-negative samples, patient RNA-seq (Silverstein et al. Table S9, splicing tools)
- Dataset
- NIH neuromuscular diagnosed RNA-seq truth set (Silverstein et al. 2026)
- Procedure
- Recovery of known pathogenic splicing events and outlier calls in true-negative samples, patient RNA-seq (Silverstein et al. Table S9, splicing tools)
- Evaluation
- MINTIE on the NIH neuromuscular diagnosed RNA-seq truth set (splicing)
- Coverage
- Not reported scored / Not reported eligible
- Uncertainty
- Not reported by the source
- Evidence
- Independent external evaluation · source checkedBenchmarking RNA-seq Tools for Real-World Diagnostic Applications (Silverstein et al., medRxiv 2026); Silverstein et al. 2026 Supplemental Tables S1-S10 (medRxiv media-3.xlsx) · Table S9 (sheet 'Table S9') cell H3, row 'MINTIE', column 'Recall'
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.
Reproduction
- Split
- No split
- Adaptation
- Not reported
- Scoring implementation
- Spreadsheet formulas over TP, FN, TN and FP (Table S9); MCC from the binary confusion matrix
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
2 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result 0.34782608695652173 Individual claims | Benchmarking RNA-seq Tools for Real-World Diagnostic Applications (Silverstein et al., medRxiv 2026) Table S9 (sheet 'Table S9') cell H3, row 'MINTIE', column 'Recall' Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: medRxiv preprint version 1, posted 2026-01-28; JATS source XML | source checked ["source-hash-verification","independent-cell-check","automated-source-review"] · 2026-10-12 independent paper Audit detailsChecked by reviewer-scnv against the pinned source; verdict in docs/reviews/use-cases/splicing-cnv-use-cases-2026-10-12.md and in this batch's review.md. Formula in the cell: B3/(B3+C3). Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: |
| Reported result 0.34782608695652173 Individual claims | Silverstein et al. 2026 Supplemental Tables S1-S10 (medRxiv media-3.xlsx) Table S9 (sheet 'Table S9') cell H3, row 'MINTIE', column 'Recall' Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: medRxiv preprint version 1 supplement DC3 (file 344940_file09.xlsx in the JATS XML) | source checked ["source-hash-verification","independent-cell-check","automated-source-review"] · 2026-10-12 independent paper Audit detailsChecked by reviewer-scnv against the pinned source; verdict in docs/reviews/use-cases/splicing-cnv-use-cases-2026-10-12.md and in this batch's review.md. Formula in the cell: B3/(B3+C3). Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
2 source records and release history
- Benchmarking RNA-seq Tools for Real-World Diagnostic Applications (Silverstein et al., medRxiv 2026) · Original source · medRxiv preprint version 1, posted 2026-01-28; JATS source XML
- Silverstein et al. 2026 Supplemental Tables S1-S10 (medRxiv media-3.xlsx) · Original source · medRxiv preprint version 1 supplement DC3 (file 344940_file09.xlsx in the JATS XML)
Technical metadata and extraction receipts
Stable ID: rna-splicing-20261011-silverstein2026-result-mintie-recall
- metric
- recall
- metric direction
- higher
- unit
- fraction
- printed value
- 0.34782608695652173
- source locator
- Table S9 (sheet 'Table S9') cell H3, row 'MINTIE', column 'Recall'
- review
- method: source-hash-verification; independent-cell-check; automated-source-review; reviewer: claude; reviewer note: Independent Claude review agent reviewer-scnv; did not extract this batch; no human review claimed; date: 2026-10-12; artifact sha256: 3d137444b13225cf1223ad73758fdfcb4b5f772263e0aafd827d8ca57ca00120; retrieval url: https://www.medrxiv.org/content/medrxiv/early/2026/01/28/2026.01.27.26344940/DC3/embed/media-3.xlsx?download=true; method note: Read sheet 'Table S9' of the pinned workbook with a stdlib OOXML reader (extract/ooxml.py); header row A1:J1 and tool labels A2:A10 asserted; printed_value is the shortest round-trip decimal of the stored cell value.; note: Checked by reviewer-scnv against the pinned source; verdict in docs/reviews/use-cases/splicing-cnv-use-cases-2026-10-12.md and in this batch's review.md. Formula in the cell: B3/(B3+C3).
- numeric value
- 0.34782608695652173
- metric qualifier
- positives per known event or gene, negatives per true-negative sample; aggregated across the tissue sets each tool was run on (Table S9)
- missing metadata
- uncertainty: reason: unreported
- raw xml value
- 0.34782608695652173
- workbook number format
- General