rewirebio.iobenchmarks
Configuration

Transformer (no pretraining)

Transformer as evaluated in the cited study. No pretraining; original TAPE paper task-specific supervised head

Sourcestape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnSecondary structure

5 evaluations · 5 results

Overview

Key specifications have not been extracted for this record. See the linked evaluation and sources for the reported setup.

limited source coverage · Automated source review, 2026-09-17. All specifications and missing details

Model Capabilities & Hardware Requirements

Deployment facts recorded for Transformer (no pretraining). Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluated Checkpoint: No pretraining; original TAPE paper task-specific supervised head

Evaluations and results

5 evaluations · 5 results. Different protocols are not a single leaderboard.

Sorted by Accuracy (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

All 5 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Transformer (no pretraining)Task: TAPE Secondary Structure
Dataset: CB513
0.7 Accuracy
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Transformer (no pretraining): CB513

CB513 test set; train/test proteins filtered at 25% sequence identity

Aggregation: Not reported

tape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnSecondary structure
Configuration: Transformer (no pretraining)Task: TAPE Fluorescence
Dataset: TAPE Fluorescence source dataset
0.22 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Transformer (no pretraining): Sarkisyan GFP fluorescence

Train/validation at most 3 mutations; test 4–15 mutations from the GFP parent

Aggregation: Not reported

tape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnFluorescence
Configuration: Transformer (no pretraining)Task: TAPE Stability
Dataset: TAPE Stability source dataset
-0.06 Spearman
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Transformer (no pretraining): Rocklin designed-protein stability

Test 17 one-mutation neighbourhoods around candidate proteins; train on broad experimental design rounds

Aggregation: Not reported

tape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnStability
Configuration: Transformer (no pretraining)Task: TAPE Remote Homology Detection
Dataset: SCOP1.75 fold-level test
0.09 Accuracy
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Transformer (no pretraining): SCOP1.75 fold-level test

Held-out evolutionary groups; fold-level classification into 1,195 folds

Aggregation: Not reported

tape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnRemote homology
Configuration: Transformer (no pretraining)Task: TAPE Contact Prediction
Dataset: ProteinNet CASP12
0.32 Precision at l 5
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Transformer (no pretraining): ProteinNet CASP12

CASP12 test, 30% sequence-identity partition; medium/long-range contacts

Aggregation: Not reported

tape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnContact prediction

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Use this configuration

How it works, versions and access

How it works

Evaluation in this paper

No pretraining; original TAPE paper task-specific supervised head

Sourcestape primary benchmark evidence · Table2,p.7,row1(No pretraining/Transformer),columnSecondary structure
Strengths, limitations and unresolved questions

Strengths and limitations

Strengths and considerations

No source-reviewed explanatory claims are recorded here yet.

Limitations and conditions

No source-reviewed explanatory claims are recorded here yet.

Profile review details

Primary-source transcription and separate automated review. No human sign-off or experimental reproduction.

Stable record: paper-model-536a4bbdbe5a079837

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-17. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Inputs, outputs and configuration
PropertyDescription and evidence
Model typeNot extracted or verified for this record.
InputsNot extracted or verified for this record.
OutputsNot extracted or verified for this record.
ParametersNot extracted or verified for this record.
Known versionsNot extracted or verified for this record.
Training dataNot extracted or verified for this record.
Context limitsNot extracted or verified for this record.
AccessNot extracted or verified for this record.
Code licenceNot extracted or verified for this record.
Weights licenceNot extracted or verified for this record.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

2 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Evaluation in this paper
No pretraining; original TAPE paper task-specific supervised head
Individual claims
tape primary benchmark evidence

Original source ↗

Table2,p.7,row1(No pretraining/Transformer),columnSecondary structure

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

source checked

automated source review · 2026-09-17

Audit details

Primary-source transcription and separate automated review. No human sign-off or experimental reproduction.

Field: attributes.profile.sections.0.body

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Introduction
Transformer as evaluated in the cited study. No pretraining; original TAPE paper task-specific supervised head
Individual claims
tape primary benchmark evidence

Original source ↗

Table2,p.7,row1(No pretraining/Transformer),columnSecondary structure

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

source checked

automated source review · 2026-09-17

Audit details

Primary-source transcription and separate automated review. No human sign-off or experimental reproduction.

Field: attributes.profile.summary

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: needs review

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID paper-model-536a4bbdbe5a079837.

Related records

How to cite

Transformer (no pretraining). Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/paper-model-536a4bbdbe5a079837/

Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction