rewirebio.iobenchmarks
Source

Training-mean control: local execution report (20 September 2026)

ca73fa47136d182f2d4ddb083d084712198fc0e2

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Claims

Statements this source supports, each with where in the source it was checked.

  • Evidence summary: Set baselines for UTR translation experiments: Summary Only two sequence-only controls have been measured on the target split, both in Rewire's own runs, so there is no model comparison on it yet. On the 15,003 held-out records of the mRNABench designed-reporter test split, the composition ridge control reached a mean squared error of 1.914 against 2.366 for the training-mean control, and a Pearson correlation of 0.437; the training-mean control has no defined correlation, because its prediction is constant. The published FramePool panels are the only model comparison recorded here: neural models (FramePool and Optimus) reached Pearson 0.743 to 0.966 on the two random-sequence panels and 0.700 to 0.894 on the two human panels, while k-mer random forests, which were evaluated on the random panels only, reached 0.616 to 0.877. Those values are reported in the FramePool study on its own library, one split per panel with no uncertainty interval, and they are not measured on the designed-reporter split, so they are not baselines for it. Both Rewire controls are single runs on one split with no seed variability, and their automated audit checks the run itself, not a published score. (rewire-local-20260920 run outputs: metrics.mse and metrics.pearson for the composition and training-mean controls; uc20260930-source-framepool-s1: S1 Table rows Random 50nt, Random 25-100nt, Human 50nt and Human 25-100nt; uc20260930-source-framepool-s4: S4 Table columns B and C)
  • Relevance of mRNABench Sample designed MRL to "Set baselines for UTR translation experiments": Assessed by mRNABench Sample designed MRL (rewire-local-20260920-source-mrnabench-composition: /coverage; /model_configuration; /protocol_configuration; /protocol_results; /provenance; rewire-local-20260920-source-mrnabench-train-mean: /coverage; /model_configuration; /protocol_results/metric_unavailable_reasons; /provenance; rewire-local-20260920-instructions-mrnabench: Results: RNA evaluation paragraph; Provenance and review; Reproduce the four sequence controls)

Models, benchmarks and other records

Configurations (1)

Protocols (1)

Baselines (1)

Evaluations (1)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/report.json
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Evidence origin
rewire_run
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.evidence_origin

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieval note
Generated local execution report, verified against saved predictions; immutable public Git source.
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieval_note

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-20T20:54:03Z
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source type
rewire_execution_report
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.source_type

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/report.json
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
ca73fa47136d182f2d4ddb083d084712198fc0e2
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Public sanitized execution evidence. Raw sequences and predictions remain local. Automated checking does not establish reproduction of a published model score.
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Facets: areas
1 values
  • rna-transcriptomes
Source metadata
Training-mean control: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: facets.areas

Source artifact SHA-256: c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Public sanitized execution evidence. Raw sequences and predictions remain local. Automated checking does not establish reproduction of a published model score.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: rewire-local-20260920-source-mrnabench-train-mean

areas
rna-transcriptomes
url
https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/report.json
artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/report.json
artifact sha256
c036d9fa75b6ba4d5c65d31cd575ee2bfc357beec3ca7e6c80f07e3128a04e71
version
ca73fa47136d182f2d4ddb083d084712198fc0e2
retrieved at
2026-09-20T20:54:03Z
source type
rewire_execution_report
evidence origin
rewire_run
retrieval note
Generated local execution report, verified against saved predictions; immutable public Git source.
Related records

    Suggest a correction