AUPRC (GTEx splicing task, Splice-15class, averaged over categories) of SpTransformer retrained under the authors' framework (You et al. 2026) on GTEx-derived tissue-specific splice site usage dataset (You et al. 2026)
0.8568(0.0005) AUPRC (GTEx splicing task, Splice-15class, averaged over categories)
Methods
- Tested configuration
- SpTransformer retrained under the authors' framework (You et al. 2026)
- Protocol
- GTEx tissue-specific splicing prediction, Splice-15class (You et al. 2026 Supplementary Table 5)
- Dataset
- GTEx-derived tissue-specific splice site usage dataset (You et al. 2026)
- Procedure
- GTEx tissue-specific splicing prediction, Splice-15class (You et al. 2026 Supplementary Table 5)
- Evaluation
- SpTransformer on the GTEx splicing task, Splice-15class
- Coverage
- Not reported scored / Not reported eligible
- Uncertainty
- SD 0.0005
- Evidence
- Author-reported evaluation · source checkedBenchmarking pre-trained genomic language models for RNA sequence-related predictive applications; You et al. 2026, Supplementary Information · Supplementary Table 5, block 'Splice-15class', row 'SpTransformer', column 'Average PR-AUC'
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.
Reproduction
- Split
- 242,017 train / 99,813 test
- Adaptation
- Fine-tuned task-specific model
- Scoring implementation
- Average PR-AUC and average top-k accuracy
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
2 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result 0.8568(0.0005) Individual claims | Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications Supplementary Table 5, block 'Splice-15class', row 'SpTransformer', column 'Average PR-AUC' Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: Nat Commun 17:223, published online 2025-12-07; PMC12780105 full-text XML | source checked ["source-hash-verification","pdf-text-parse","independent-cell-check"] · 2026-10-11 author reported Audit detailsIndependent review 2026-10-11: value and identity match the source. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: |
| Reported result 0.8568(0.0005) Individual claims | You et al. 2026, Supplementary Information Supplementary Table 5, block 'Splice-15class', row 'SpTransformer', column 'Average PR-AUC' Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 41467_2025_66899_MOESM1_ESM.pdf inside the Europe PMC supplementaryFiles zip (outer zip 9a0d0a8d8643872ab265e3e6ed7eea944563da4861bf764f97c68fc6aa502525, assembled per request; the member hash is the bound artifact) | source checked ["source-hash-verification","pdf-text-parse","independent-cell-check"] · 2026-10-11 author reported Audit detailsIndependent review 2026-10-11: value and identity match the source. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Extraction artifact SHA-256: |
Sources and history
Release 2026-10-22-1b7cf027e4f6 · Record review: source checked
2 source records and release history
- Benchmarking pre-trained genomic language models for RNA sequence-related predictive applications · Original source · Nat Commun 17:223, published online 2025-12-07; PMC12780105 full-text XML
- You et al. 2026, Supplementary Information · Original source · 41467_2025_66899_MOESM1_ESM.pdf inside the Europe PMC supplementaryFiles zip (outer zip 9a0d0a8d8643872ab265e3e6ed7eea944563da4861bf764f97c68fc6aa502525, assembled per request; the member hash is the bound artifact)
Technical metadata and extraction receipts
Stable ID: gfm2-20261011-you2026-result-t5-splice-15class-sptransformer-average-pr-auc
- metric
- auprc
- metric direction
- higher
- unit
- fraction
- printed value
- 0.8568(0.0005)
- numeric value
- 0.8568
- source locator
- Supplementary Table 5, block 'Splice-15class', row 'SpTransformer', column 'Average PR-AUC'
- metric qualifier
- GTEx splicing task, Splice-15class, averaged over categories
- uncertainty
- type: standard_deviation; value: 0.0005; printed: (0.0005); n: 3; scope: Three fine-tuning runs with different random initialisations
- review
- method: source-hash-verification; pdf-text-parse; independent-cell-check; method note: Re-downloaded the article XML (SHA-256 matches) and the supplementaryFiles zip, whose MOESM1_ESM.pdf member matches the pinned SHA-256. Parsed Supplementary Tables 4 and 5 from the `pdftotext -layout` (poppler 26.08.0) text with a separate parser (review/review.py) and checked printed value, numeric value, spread, metric, qualifier, unit, direction, locator and the linked configuration, protocol and dataset against the block, row and column labels and the article's Methods and Table 1.; reviewer: claude; reviewer note: Claude (Opus 5.5) review agent reviewer-gfm-a, independent of the extractor lit-gfm-2; no human review claimed; date: 2026-10-11; artifact sha256: cbb69e05045a4526e35479d2c1361ebb9cfadfd968e00675390dad597035d882; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12780105/supplementaryFiles; note: Independent review 2026-10-11: value and identity match the source.