rewirebio.iobenchmarks
Source

ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

1663d1f04b2bbd6dfcff77fea78129d30b0de191

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Claims

Statements this source supports, each with where in the source it was checked.

  • ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire) (FLIP2 Rhomax by_wild_type): facets.method_types: Facets: method types ["foundation_model"] (Frozen ESM-2 embeddings with a ridge probe)
  • Evaluated ESM-2 checkpoint belongs to ESM-2: Family ESM-2 (model_configuration.checkpoint; model.name)
  • Evidence summary: Assess rhodopsin wavelength prediction across sequence backgrounds: Summary RhoMax, which adds structural binding-pocket inputs, had the lowest wavelength error on each of its own wild-type holdout splits. In separate Rewire runs on the FLIP2 split, two amino-acid composition probes outranked two frozen ESM-2 probes, and both ESM-2 probes fell below a constant control. Averaged over four RhoMax splits, mean absolute error was 10.45 nm for RhoMax, 13.46 nm for RhoMax plus retinal and 14.90 nm for the BLASSO comparator, with standard deviations of 10.9 to 11.7 nm; per-split RhoMax error ran from 7.28 to 16.68 nm. In electronvolts the three methods are closer, and on split 3 all three print the same mean absolute error of 0.045 eV. On the FLIP2 Rhomax by_wild_type split of 184 held-out sequences, Rewire's runs gave a Spearman correlation of 0.418 for a 40-feature amino-acid composition probe and 0.418 for a 22-feature one, against -0.146 for a frozen ESM-2 8M probe and -0.222 for a 35M probe; NDCG was 0.955, 0.955, 0.896 and 0.907 against 0.921 for a training-mean control, whose Spearman is undefined. The two split definitions are different and their scores must not be pooled. The RhoMax values are reported by its authors with no independent reproduction, and the Rewire runs are single runs with no seed variability, with the 35M checkpoint chosen after the 8M outcome was known. (uc20260930-source-rhomax-2024: per-split and mean rows of the wild-type holdout table, nm and eV columns; rewire-local-20260920 and rewire-local-20260921 run outputs: metrics.spearman and metrics.ndcg)
  • Relevance of FLIP2 Rhomax by_wild_type to "Assess rhodopsin wavelength prediction across sequence backgrounds": Assessed by FLIP2 Rhomax by_wild_type (rewire-local-20260921-instructions-esm2-35m: Matched Rhomax evaluations; Procedure and evidence; Re-run or inspect; rewire-local-20260921-source-esm2-35m: /metrics; /coverage; /model_configuration; /protocol_configuration; /execution; /provenance; rewire-local-20260921-source-esm2-8m: /metrics; /coverage; /model_configuration; /protocol_configuration; /execution; /provenance; rewire-local-20260921-source-composition22: /metrics; /model_configuration; /protocol_configuration; rewire-local-20260920-source-flip2-train-mean: /metrics; /coverage; /model_configuration; rewire-local-20260920-source-flip2-composition: /metrics; /coverage; /model_configuration; /provenance)

Models, benchmarks and other records

Configurations (1)

Evaluations (1)

Use cases (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

13 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/1663d1f04b2bbd6dfcff77fea78129d30b0de191/research/baseline-programme-2026-09-21/rhomax-35m/esm2.report.json
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-22T21:18:22Z
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source type
rewire_execution_report
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.source_type

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://github.com/rewire-bio/rewire-benchmarks/blob/1663d1f04b2bbd6dfcff77fea78129d30b0de191/research/baseline-programme-2026-09-21/rhomax-35m/esm2.report.json
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
1663d1f04b2bbd6dfcff77fea78129d30b0de191
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Pinned local execution evidence; automated source review is not published-score reproduction.
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Facets: areas
1 values
  • proteins-complexes
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: facets.areas

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record ID
rewire-local-20260921-source-esm2-35m
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: id

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Record type
source
Source metadata
ESM-2 35M frozen residue-mean embeddings + fixed ridge (Rewire): report

Original source ↗

No field-specific location recorded

Version: 1663d1f04b2bbd6dfcff77fea78129d30b0de191
Retrieved: 2026-09-22T21:18:22Z

catalogued

No individual claim review recorded

Audit details

Field: kind

Source artifact SHA-256: 29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Pinned local execution evidence; automated source review is not published-score reproduction.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: rewire-local-20260921-source-esm2-35m

areas
proteins-complexes
url
https://github.com/rewire-bio/rewire-benchmarks/blob/1663d1f04b2bbd6dfcff77fea78129d30b0de191/research/baseline-programme-2026-09-21/rhomax-35m/esm2.report.json
artifact url
https://raw.githubusercontent.com/rewire-bio/rewire-benchmarks/1663d1f04b2bbd6dfcff77fea78129d30b0de191/research/baseline-programme-2026-09-21/rhomax-35m/esm2.report.json
artifact sha256
29d7c0ae7f47d45861a769eb8813bf8c650c9a95b3a6821c524b216b0b907ef0
version
1663d1f04b2bbd6dfcff77fea78129d30b0de191
retrieved at
2026-09-22T21:18:22Z
source type
rewire_execution_report
Related records

    Suggest a correction