Training-mean control: automated execution audit
ca73fa47136d182f2d4ddb083d084712198fc0e2
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Evidence summary: Set baselines for UTR translation experiments: Summary Only two sequence-only controls have been measured on the target split, both in Rewire's own runs, so there is no model comparison on it yet. On the 15,003 held-out records of the mRNABench designed-reporter test split, the composition ridge control reached a mean squared error of 1.914 against 2.366 for the training-mean control, and a Pearson correlation of 0.437; the training-mean control has no defined correlation, because its prediction is constant. The published FramePool panels are the only model comparison recorded here: neural models (FramePool and Optimus) reached Pearson 0.743 to 0.966 on the two random-sequence panels and 0.700 to 0.894 on the two human panels, while k-mer random forests, which were evaluated on the random panels only, reached 0.616 to 0.877. Those values are reported in the FramePool study on its own library, one split per panel with no uncertainty interval, and they are not measured on the designed-reporter split, so they are not baselines for it. Both Rewire controls are single runs on one split with no seed variability, and their automated audit checks the run itself, not a published score. (rewire-local-20260920 run outputs: metrics.mse and metrics.pearson for the composition and training-mean controls; uc20260930-source-framepool-s1: S1 Table rows Random 50nt, Random 25-100nt, Human 50nt and Human 25-100nt; uc20260930-source-framepool-s4: S4 Table columns B and C)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
13 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984 Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-09-20T20:54:03Z Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Source type automated_execution_audit Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Url https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Version ca73fa47136d182f2d4ddb083d084712198fc0e2 Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description Verification of coverage, saved predictions and reference metric calculations; no human review or published-score reproduction implied. Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Facets: areas1 values
| Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Record ID rewire-local-20260920-audit-source-mrnabench-train-mean Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Record type source Source metadata | Training-mean control: automated execution audit No field-specific location recorded Version: ca73fa47136d182f2d4ddb083d084712198fc0e2 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-02-a7f03c9e55a5 · Record review: source checked
Verification of coverage, saved predictions and reference metric calculations; no human review or published-score reproduction implied.
Technical metadata and extraction receipts
Stable ID: rewire-local-20260920-audit-source-mrnabench-train-mean
- areas
- rna-transcriptomes
- url
- https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json
- artifact url
- https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json
- artifact sha256
- 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984
- version
- ca73fa47136d182f2d4ddb083d084712198fc0e2
- retrieved at
- 2026-09-20T20:54:03Z
- source type
- automated_execution_audit