rewirebio.iobenchmarks
Source

tape primary benchmark evidence

1906.08230v1

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AlignmentAccuracy0.80 fractionCB513Alignment: CB513
AlignmentPrecision at l 50.64 fractionProteinNet CASP12Alignment: ProteinNet CASP12
AlignmentSpearmanN/A unitlessTAPE Stability source datasetAlignment: Rocklin designed-protein stability
AlignmentSpearmanN/A unitlessTAPE Fluorescence source datasetAlignment: Sarkisyan GFP fluorescence
AlignmentAccuracy0.09 fractionSCOP1.75 fold-level testAlignment: SCOP1.75 fold-level test
LSTM (no pretraining)Accuracy0.71 fractionCB513LSTM (no pretraining): CB513
LSTM (no pretraining)Precision at l 50.19 fractionProteinNet CASP12LSTM (no pretraining): ProteinNet CASP12
LSTM (no pretraining)Spearman0.28 unitlessTAPE Stability source datasetLSTM (no pretraining): Rocklin designed-protein stability
LSTM (no pretraining)Spearman0.21 unitlessTAPE Fluorescence source datasetLSTM (no pretraining): Sarkisyan GFP fluorescence
LSTM (no pretraining)Accuracy0.12 fractionSCOP1.75 fold-level testLSTM (no pretraining): SCOP1.75 fold-level test
ResNet (no pretraining)Accuracy0.70 fractionCB513ResNet (no pretraining): CB513
ResNet (no pretraining)Precision at l 50.20 fractionProteinNet CASP12ResNet (no pretraining): ProteinNet CASP12
ResNet (no pretraining)Spearman0.61 unitlessTAPE Stability source datasetResNet (no pretraining): Rocklin designed-protein stability
ResNet (no pretraining)Spearman-0.28 unitlessTAPE Fluorescence source datasetResNet (no pretraining): Sarkisyan GFP fluorescence
ResNet (no pretraining)Accuracy0.10 fractionSCOP1.75 fold-level testResNet (no pretraining): SCOP1.75 fold-level test
TAPE BeplerAccuracy0.73 fractionCB513TAPE Bepler: CB513
TAPE BeplerPrecision at l 50.40 fractionProteinNet CASP12TAPE Bepler: ProteinNet CASP12
TAPE BeplerAccuracy0.17 fractionSCOP1.75 fold-level testTAPE Bepler: SCOP1.75 fold-level test
TAPE BeplerSpearman0.33 unitlessTAPE Fluorescence source datasetTAPE Fluorescence Bepler leaderboard evaluation
TAPE LSTMSpearman0.67 unitlessTAPE Fluorescence source datasetTAPE Fluorescence LSTM leaderboard evaluation
TAPE One HotSpearman0.14 unitlessTAPE Fluorescence source datasetTAPE Fluorescence One Hot leaderboard evaluation
TAPE ResNetSpearman0.21 unitlessTAPE Fluorescence source datasetTAPE Fluorescence ResNet leaderboard evaluation
TAPE TransformerSpearman0.68 unitlessTAPE Fluorescence source datasetTAPE Fluorescence Transformer leaderboard evaluation
TAPE UnirepSpearman0.67 unitlessTAPE Fluorescence source datasetTAPE Fluorescence Unirep leaderboard evaluation
TAPE LSTMAccuracy0.75 fractionCB513TAPE LSTM: CB513
TAPE LSTMPrecision at l 50.39 fractionProteinNet CASP12TAPE LSTM: ProteinNet CASP12
TAPE LSTMAccuracy0.26 fractionSCOP1.75 fold-level testTAPE LSTM: SCOP1.75 fold-level test
TAPE One HotAccuracy0.69 fractionCB513TAPE One Hot: CB513
TAPE One HotPrecision at l 50.29 fractionProteinNet CASP12TAPE One Hot: ProteinNet CASP12
TAPE One HotAccuracy0.09 fractionSCOP1.75 fold-level testTAPE One Hot: SCOP1.75 fold-level test
TAPE ResNetAccuracy0.75 fractionCB513TAPE ResNet: CB513
TAPE ResNetPrecision at l 50.29 fractionProteinNet CASP12TAPE ResNet: ProteinNet CASP12
TAPE ResNetAccuracy0.17 fractionSCOP1.75 fold-level testTAPE ResNet: SCOP1.75 fold-level test
TAPE BeplerSpearman0.64 unitlessTAPE Stability source datasetTAPE Stability Bepler leaderboard evaluation
TAPE LSTMSpearman0.69 unitlessTAPE Stability source datasetTAPE Stability LSTM leaderboard evaluation
TAPE One HotSpearman0.19 unitlessTAPE Stability source datasetTAPE Stability One Hot leaderboard evaluation
TAPE ResNetSpearman0.73 unitlessTAPE Stability source datasetTAPE Stability ResNet leaderboard evaluation
TAPE TransformerSpearman0.73 unitlessTAPE Stability source datasetTAPE Stability Transformer leaderboard evaluation
TAPE UnirepSpearman0.73 unitlessTAPE Stability source datasetTAPE Stability Unirep leaderboard evaluation
TAPE TransformerAccuracy0.73 fractionCB513TAPE Transformer: CB513
TAPE TransformerPrecision at l 50.36 fractionProteinNet CASP12TAPE Transformer: ProteinNet CASP12
TAPE TransformerAccuracy0.21 fractionSCOP1.75 fold-level testTAPE Transformer: SCOP1.75 fold-level test
TAPE UnirepAccuracy0.73 fractionCB513TAPE Unirep: CB513
TAPE UnirepPrecision at l 50.34 fractionProteinNet CASP12TAPE Unirep: ProteinNet CASP12
TAPE UnirepAccuracy0.23 fractionSCOP1.75 fold-level testTAPE Unirep: SCOP1.75 fold-level test
Transformer (no pretraining)Accuracy0.70 fractionCB513Transformer (no pretraining): CB513
Transformer (no pretraining)Precision at l 50.32 fractionProteinNet CASP12Transformer (no pretraining): ProteinNet CASP12
Transformer (no pretraining)Spearman-0.06 unitlessTAPE Stability source datasetTransformer (no pretraining): Rocklin designed-protein stability
Transformer (no pretraining)Spearman0.22 unitlessTAPE Fluorescence source datasetTransformer (no pretraining): Sarkisyan GFP fluorescence
Transformer (no pretraining)Accuracy0.09 fractionSCOP1.75 fold-level testTransformer (no pretraining): SCOP1.75 fold-level test

Claims

Statements this source supports, each with where in the source it was checked.

  • TAPE Contact Prediction: links:part_of:discovery-benchmark-tape: Part of TAPE (Results on downstream supervised tasks; Table2,p.7,row1(No pretraining/Transformer),columnContact prediction; Table2,p.7,row2(No pretraining/LSTM),columnContact prediction; Table2,p.7,row3(No pretraining/ResNet),columnContact prediction; Table2,p.7,row4(Self-supervised pretraining/Transformer),columnContact prediction; Table2,p.7,row5(Self-supervised pretraining/LSTM),columnContact prediction; Table2,p.7,row6(Self-supervised pretraining/ResNet),columnContact prediction; Table2,p.7,row7(Supervised pretraining/Bepler supervised LSTM),columnContact prediction; Table2,p.7,row8(Self-supervised pretraining/UniRep mLSTM),columnContact prediction; Table2,p.7,row9(One-hot baseline/One-hot),columnContact prediction; Table2,p.7,row10(Task-specific alignment/HMM baseline/Alignment),columnContact prediction)
  • TAPE Fluorescence: links:part_of:discovery-benchmark-tape: Part of TAPE (Results on downstream supervised tasks; Table2,p.7,row1(No pretraining/Transformer),columnFluorescence; Table2,p.7,row2(No pretraining/LSTM),columnFluorescence; Table2,p.7,row3(No pretraining/ResNet),columnFluorescence; Table2,p.7,row4(Self-supervised pretraining/Transformer),columnFluorescence; Table2,p.7,row5(Self-supervised pretraining/LSTM),columnFluorescence; Table2,p.7,row6(Self-supervised pretraining/ResNet),columnFluorescence; Table2,p.7,row7(Supervised pretraining/Bepler supervised LSTM),columnFluorescence; Table2,p.7,row8(Self-supervised pretraining/UniRep mLSTM),columnFluorescence; Table2,p.7,row9(One-hot baseline/One-hot),columnFluorescence; Table2,p.7,row10(Task-specific alignment/HMM baseline/Alignment),columnFluorescence)
  • TAPE Remote Homology Detection: links:part_of:discovery-benchmark-tape: Part of TAPE (Results on downstream supervised tasks; Table2,p.7,row1(No pretraining/Transformer),columnRemote homology; Table2,p.7,row2(No pretraining/LSTM),columnRemote homology; Table2,p.7,row3(No pretraining/ResNet),columnRemote homology; Table2,p.7,row4(Self-supervised pretraining/Transformer),columnRemote homology; Table2,p.7,row5(Self-supervised pretraining/LSTM),columnRemote homology; Table2,p.7,row6(Self-supervised pretraining/ResNet),columnRemote homology; Table2,p.7,row7(Supervised pretraining/Bepler supervised LSTM),columnRemote homology; Table2,p.7,row8(Self-supervised pretraining/UniRep mLSTM),columnRemote homology; Table2,p.7,row9(One-hot baseline/One-hot),columnRemote homology; Table2,p.7,row10(Task-specific alignment/HMM baseline/Alignment),columnRemote homology)
  • TAPE Secondary Structure: links:part_of:discovery-benchmark-tape: Part of TAPE (Results on downstream supervised tasks; Table2,p.7,row1(No pretraining/Transformer),columnSecondary structure; Table2,p.7,row2(No pretraining/LSTM),columnSecondary structure; Table2,p.7,row3(No pretraining/ResNet),columnSecondary structure; Table2,p.7,row4(Self-supervised pretraining/Transformer),columnSecondary structure; Table2,p.7,row5(Self-supervised pretraining/LSTM),columnSecondary structure; Table2,p.7,row6(Self-supervised pretraining/ResNet),columnSecondary structure; Table2,p.7,row7(Supervised pretraining/Bepler supervised LSTM),columnSecondary structure; Table2,p.7,row8(Self-supervised pretraining/UniRep mLSTM),columnSecondary structure; Table2,p.7,row9(One-hot baseline/One-hot),columnSecondary structure; Table2,p.7,row10(Task-specific alignment/HMM baseline/Alignment),columnSecondary structure)
  • TAPE Stability: links:part_of:discovery-benchmark-tape: Part of TAPE (Results on downstream supervised tasks; Table2,p.7,row1(No pretraining/Transformer),columnStability; Table2,p.7,row2(No pretraining/LSTM),columnStability; Table2,p.7,row3(No pretraining/ResNet),columnStability; Table2,p.7,row4(Self-supervised pretraining/Transformer),columnStability; Table2,p.7,row5(Self-supervised pretraining/LSTM),columnStability; Table2,p.7,row6(Self-supervised pretraining/ResNet),columnStability; Table2,p.7,row7(Supervised pretraining/Bepler supervised LSTM),columnStability; Table2,p.7,row8(Self-supervised pretraining/UniRep mLSTM),columnStability; Table2,p.7,row9(One-hot baseline/One-hot),columnStability; Table2,p.7,row10(Task-specific alignment/HMM baseline/Alignment),columnStability)

Models, benchmarks and other records

Configurations (4)

Benchmarks (1)

Tasks (5)

Datasets (5)

Evaluations (50)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://arxiv.org/pdf/1906.08230v1
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-09-16T20:23:48.238777+00:00
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: scope
Benchmark methodology metadata only; no independent reproduction or new numerical result extraction.
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source location
Full primary artifact; individual claims specify their section.
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Url
https://arxiv.org/pdf/1906.08230v1
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Version
1906.08230v1
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Primary paper or official task implementation inspected for the named methodology claims.
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Search facets
None recorded
Source metadata
tape primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 1906.08230v1
Retrieved: 2026-09-16T20:23:48.238777+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: 6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Primary paper or official task implementation inspected for the named methodology claims.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: evidence-discovery-final-tape

artifact sha256
6ee0c3e6e870635cba8fa67e0a4abc5598c0ab2a10ba127a46b67ac450ae0168
artifact url
https://arxiv.org/pdf/1906.08230v1
retrieved at
2026-09-16T20:23:48.238777+00:00
url
https://arxiv.org/pdf/1906.08230v1
version
1906.08230v1
source locator
Full primary artifact; individual claims specify their section.
review
method: automated-source-review; scope: Benchmark methodology metadata only; no independent reproduction or new numerical result extraction.
Related records

    Suggest a correction