rewire.itbenchmarks
Result

0.64 Spearman's rho

TAPE Stability Bepler Spearman rho

Tested model
TAPE Bepler
Task
TAPE Stability
Dataset
TAPE Stability source dataset
Procedure
Test 17 one-mutation neighbourhoods around candidate proteins; train on broad experimental design rounds
Evaluation
TAPE Stability Bepler leaderboard evaluation
Coverage
scored: unreported; eligible: unreported
Uncertainty
Not reported
Evidence
Author-reported evaluation · source checkedsonglab-cal/tape official source; tape primary benchmark evidence · README.md > Leaderboard > Stability; row Bepler; column Spearman's rho

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: discovered. Source checked does not mean independently reproduced.

Reproduction

Split
Test 17 one-mutation neighbourhoods around candidate proteins; train on broad experimental design rounds
Adaptation
Supervised pretraining; original TAPE paper task-specific supervised head
Scoring implementation
Not reported

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Reported result
0.64
Individual claims
tape primary benchmark evidence

Original source ↗

README.md > Leaderboard > Stability; row Bepler; column Spearman's rho

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

source checked

automated table parse plus separate source read and manually enumerated row/value cross-check · 2026-09-16T10:35:25.806835+00:00

author reported

Audit details

All six rows checked for this task. Source checked, not experiment reproduced. Historical README does not resolve exact checkpoint or data release.

Field: attributes.printed_value

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Reported result
0.64
Individual claims
songlab-cal/tape official source

Original source ↗

README.md > Leaderboard > Stability; row Bepler; column Spearman's rho

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: 6d345c2b2bbf52cd32cf179325c222afd92aec7e
Retrieved: 2026-09-16T10:31:32.443187+00:00

source checked

automated table parse plus separate source read and manually enumerated row/value cross-check · 2026-09-16T10:35:25.806835+00:00

author reported

Audit details

All six rows checked for this task. Source checked, not experiment reproduced. Historical README does not resolve exact checkpoint or data release.

Field: attributes.printed_value

Source artifact SHA-256: b28c74fe3cd6b69a8ba6d84891d0539e54dfef882abd5ed4d11ed0b029bb477a

Hash scope: Hash scope not separately documented; inspect source record

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: source checked

2 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: discovery-result-tape-stability-bepler-spearman-rho

areas
protein-function
metric
Spearman's rho
metric direction
higher
missing metadata
denominator: unextracted; seeds: unreported; uncertainty: unreported
numeric value
0.64
printed value
0.64
review
method: automated table parse plus separate source read and manually enumerated row/value cross-check; notes: All six rows checked for this task. Source checked, not experiment reproduced. Historical README does not resolve exact checkpoint or data release.; reviewed at: 2026-09-16T10:35:25.806835+00:00; reviewer: Codex research agent; no human review claimed
source locator
README.md > Leaderboard > Stability; row Bepler; column Spearman's rho
uncertainty
Not reported
unit
correlation
Related records

Suggest a correction