rewirebio.iobenchmarks
Source

Training-mean control: automated execution audit

ca73fa47136d182f2d4ddb083d084712198fc0e2

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Claims

Statements this source supports, each with where in the source it was checked.

  • Evidence summary: Set baselines for UTR translation experiments: Summary Only two sequence-only controls have been measured on the target split, both in Rewire's own runs, so there is no model comparison on it yet. On the 15,003 held-out records of the mRNABench designed-reporter test split, the composition ridge control reached a mean squared error of 1.914 against 2.366 for the training-mean control, and a Pearson correlation of 0.437; the training-mean control has no defined correlation, because its prediction is constant. The published FramePool panels are the only model comparison recorded here: neural models (FramePool and Optimus) reached Pearson 0.743 to 0.966 on the two random-sequence panels and 0.700 to 0.894 on the two human panels, while k-mer random forests, which were evaluated on the random panels only, reached 0.616 to 0.877. Those values are reported in the FramePool study on its own library, one split per panel with no uncertainty interval, and they are not measured on the designed-reporter split, so they are not baselines for it. Both Rewire controls are single runs on one split with no seed variability, and their automated audit checks the run itself, not a published score. (rewire-local-20260920 run outputs: metrics.mse and metrics.pearson for the composition and training-mean controls; uc20260930-source-framepool-s1: S1 Table rows Random 50nt, Random 25-100nt, Human 50nt and Human 25-100nt; uc20260930-source-framepool-s4: S4 Table columns B and C)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

13 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-20T20:54:03Z
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source type
automated_execution_audit
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.source_type

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
ca73fa47136d182f2d4ddb083d084712198fc0e2
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Verification of coverage, saved predictions and reference metric calculations; no human review or published-score reproduction implied.
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Facets: areas
1 values
  • rna-transcriptomes
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: facets.areas

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record ID
rewire-local-20260920-audit-source-mrnabench-train-mean
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: id

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record type
source
Source metadata
Training-mean control: automated execution audit

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: kind

Source artifact SHA-256: 9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Verification of coverage, saved predictions and reference metric calculations; no human review or published-score reproduction implied.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: rewire-local-20260920-audit-source-mrnabench-train-mean

areas
rna-transcriptomes
url
https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json
artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/mrnabench-train-mean/audit.json
artifact sha256
9aad168bcc131d8beb9fe152fe8550078ae03452128e339171761b8ac5911984
version
ca73fa47136d182f2d4ddb083d084712198fc0e2
retrieved at
2026-09-20T20:54:03Z
source type
automated_execution_audit
Related records

    Suggest a correction