rewirebio.iobenchmarks
Source

Amino-acid composition + fixed ridge: local execution report (20 September 2026)

ca73fa47136d182f2d4ddb083d084712198fc0e2

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Claims

Statements this source supports, each with where in the source it was checked.

  • Amino-acid composition + fixed ridge (FLIP2 Rhomax by_wild_type): facets.method_types: Facets: method types ["conventional_pipeline"] (Fixed training-mean and composition-ridge probes (record descriptions))
  • Evidence summary: Assess rhodopsin wavelength prediction across sequence backgrounds: Summary RhoMax, which adds structural binding-pocket inputs, had the lowest wavelength error on each of its own wild-type holdout splits. In separate Rewire runs on the FLIP2 split, two amino-acid composition probes outranked two frozen ESM-2 probes, and both ESM-2 probes fell below a constant control. Averaged over four RhoMax splits, mean absolute error was 10.45 nm for RhoMax, 13.46 nm for RhoMax plus retinal and 14.90 nm for the BLASSO comparator, with standard deviations of 10.9 to 11.7 nm; per-split RhoMax error ran from 7.28 to 16.68 nm. In electronvolts the three methods are closer, and on split 3 all three print the same mean absolute error of 0.045 eV. On the FLIP2 Rhomax by_wild_type split of 184 held-out sequences, Rewire's runs gave a Spearman correlation of 0.418 for a 40-feature amino-acid composition probe and 0.418 for a 22-feature one, against -0.146 for a frozen ESM-2 8M probe and -0.222 for a 35M probe; NDCG was 0.955, 0.955, 0.896 and 0.907 against 0.921 for a training-mean control, whose Spearman is undefined. The two split definitions are different and their scores must not be pooled. The RhoMax values are reported by its authors with no independent reproduction, and the Rewire runs are single runs with no seed variability, with the 35M checkpoint chosen after the 8M outcome was known. (uc20260930-source-rhomax-2024: per-split and mean rows of the wild-type holdout table, nm and eV columns; rewire-local-20260920 and rewire-local-20260921 run outputs: metrics.spearman and metrics.ndcg)
  • Relevance of FLIP2 Rhomax by_wild_type to "Assess rhodopsin wavelength prediction across sequence backgrounds": Assessed by FLIP2 Rhomax by_wild_type (rewire-local-20260921-instructions-esm2-35m: Matched Rhomax evaluations; Procedure and evidence; Re-run or inspect; rewire-local-20260921-source-esm2-35m: /metrics; /coverage; /model_configuration; /protocol_configuration; /execution; /provenance; rewire-local-20260921-source-esm2-8m: /metrics; /coverage; /model_configuration; /protocol_configuration; /execution; /provenance; rewire-local-20260921-source-composition22: /metrics; /model_configuration; /protocol_configuration; rewire-local-20260920-source-flip2-train-mean: /metrics; /coverage; /model_configuration; rewire-local-20260920-source-flip2-composition: /metrics; /coverage; /model_configuration; /provenance)
  • Selected concrete evaluation protocol belongs to this benchmark; no suite-wide score is implied.: Part of FLIP2 (protocol_id; protocol_configuration; provenance)

Models, benchmarks and other records

Configurations (1)

Protocols (1)

Dataset subsets (1)

Baselines (1)

Evaluations (1)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/flip2-composition/report.json
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Evidence origin
rewire_run
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.evidence_origin

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieval note
Generated local execution report, verified against saved predictions; immutable public Git source.
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieval_note

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-20T20:54:03Z
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source type
rewire_execution_report
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.source_type

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/flip2-composition/report.json
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
ca73fa47136d182f2d4ddb083d084712198fc0e2
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Public sanitized execution evidence. Raw sequences and predictions remain local. Automated checking does not establish reproduction of a published model score.
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Facets: areas
1 values
  • proteins-complexes
Source metadata
Amino-acid composition + fixed ridge: local execution report (20 September 2026)

Original source ↗

No field-specific location recorded

Version: ca73fa47136d182f2d4ddb083d084712198fc0e2
Retrieved: 2026-09-20T20:54:03Z

catalogued

No individual claim review recorded

Audit details

Field: facets.areas

Source artifact SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Public sanitized execution evidence. Raw sequences and predictions remain local. Automated checking does not establish reproduction of a published model score.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: rewire-local-20260920-source-flip2-composition

areas
proteins-complexes
url
https://github.com/rewire-bio/rewire-benchmarks/blob/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/flip2-composition/report.json
artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/ca73fa47136d182f2d4ddb083d084712198fc0e2/research/local-runs-2026-09-20/flip2-composition/report.json
artifact sha256
abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6
version
ca73fa47136d182f2d4ddb083d084712198fc0e2
retrieved at
2026-09-20T20:54:03Z
source type
rewire_execution_report
evidence origin
rewire_run
retrieval note
Generated local execution report, verified against saved predictions; immutable public Git source.
Related records

    Suggest a correction