rewirebio.iobenchmarks
Configuration

ProtBert (DeepProtein benchmark)

Configuration of ProtBert: protein language model; default DeepProtein configuration.

8 evaluations · 8 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

8 evaluations · 8 results. Different protocols are not a single leaderboard.

Sorted by MAE (mean absolute error) (lower is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetMAE (mean absolute error)Spearman (Spearman rank correlation, as defined in the article's Evaluation metrics section; supervised split)AUPRC (area under the precision-recall curve, printed on a 0 to 100 scale)Macro F1 (averaged macro F1 (Figure 3 caption: 'averaged macro F1'), printed on a 0 to 100 scale)
ProtBert (DeepProtein benchmark)EvaluationDeepProtein beta-lactamase (PEER): MAE ↓, beta-lactamase (PEER)0.207 ± 0.001 (best in column)Not reportedNot reportedNot reported
ProtBert (DeepProtein benchmark)EvaluationDeepProtein Stability (TAPE): MAE ↓, Stability (TAPE)0.322 ± 0.026Not reportedNot reportedNot reported
ProtBert (DeepProtein benchmark)EvaluationDeepProtein Fluorescence (TAPE): MAE ↓, Fluorescence (TAPE)0.583 ± 0.007Not reportedNot reportedNot reported
ProtBert (DeepProtein benchmark)EvaluationDeepProtein beta-lactamase (PEER): ρ ↑, beta-lactamase (PEER)Not reported0.572 ± 0.001Not reportedNot reported
ProtBert (DeepProtein benchmark)EvaluationDeepProtein Fluorescence (TAPE): ρ ↑, Fluorescence (TAPE)Not reported0.566 ± 0.001Not reportedNot reported
ProtBert (DeepProtein benchmark)EvaluationDeepProtein Solubility (PEER): Averaged F1 ↑, Solubility (PEER)Not reportedNot reportedNot reported62.53 ± 2.67%
ProtBert (DeepProtein benchmark)EvaluationDeepProtein Solubility (PEER): PR-AUC ↑, Solubility (PEER)Not reportedNot reported70.70 ± 0.47%Not reported
ProtBert (DeepProtein benchmark)EvaluationDeepProtein Stability (TAPE): ρ ↑, Stability (TAPE)Not reported0.646 ± 0.064 (best in column)Not reportedNot reported
All 8 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein beta-lactamase (PEER): MAE ↓
Dataset: beta-lactamase (PEER)
0.207 ± 0.001 MAE (mean absolute error)
unit-unreported · lower

Uncertainty: SD 0.001

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein beta-lactamase (PEER) (MAE ↓)

lit-protein-20261011-deepprotein-protocol-beta-lactamase-mae

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'β-lactamase', column 'MAE ↓'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein beta-lactamase (PEER): ρ ↑
Dataset: beta-lactamase (PEER)
0.572 ± 0.001 Spearman (Spearman rank correlation, as defined in the article's Evaluation metrics section; supervised split)
unitless · higher

Uncertainty: SD 0.001

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein beta-lactamase (PEER) (ρ ↑)

lit-protein-20261011-deepprotein-protocol-beta-lactamase-rho

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'β-lactamase', column 'ρ ↑'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein Fluorescence (TAPE): MAE ↓
Dataset: Fluorescence (TAPE)
0.583 ± 0.007 MAE (mean absolute error)
unit-unreported · lower

Uncertainty: SD 0.007

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein Fluorescence (TAPE) (MAE ↓)

lit-protein-20261011-deepprotein-protocol-fluorescence-mae

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'Fluorescence', column 'MAE ↓'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein Fluorescence (TAPE): ρ ↑
Dataset: Fluorescence (TAPE)
0.566 ± 0.001 Spearman (Spearman rank correlation, as defined in the article's Evaluation metrics section; supervised split)
unitless · higher

Uncertainty: SD 0.001

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein Fluorescence (TAPE) (ρ ↑)

lit-protein-20261011-deepprotein-protocol-fluorescence-rho

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'Fluorescence', column 'ρ ↑'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein Solubility (PEER): Averaged F1 ↑
Dataset: Solubility (PEER)
62.53 ± 2.67% Macro F1 (averaged macro F1 (Figure 3 caption: 'averaged macro F1'), printed on a 0 to 100 scale)
percent · higher

Uncertainty: SD 2.67

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein Solubility (PEER) (Averaged F1 ↑)

lit-protein-20261011-deepprotein-protocol-solubility-avg-f1

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'Solubility', column 'Averaged F1 ↑'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein Solubility (PEER): PR-AUC ↑
Dataset: Solubility (PEER)
70.70 ± 0.47% AUPRC (area under the precision-recall curve, printed on a 0 to 100 scale)
percent · higher

Uncertainty: SD 0.47

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein Solubility (PEER) (PR-AUC ↑)

lit-protein-20261011-deepprotein-protocol-solubility-pr-auc

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'Solubility', column 'PR-AUC ↑'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein Stability (TAPE): MAE ↓
Dataset: Stability (TAPE)
0.322 ± 0.026 MAE (mean absolute error)
unit-unreported · lower

Uncertainty: SD 0.026

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein Stability (TAPE) (MAE ↓)

lit-protein-20261011-deepprotein-protocol-stability-mae

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'Stability', column 'MAE ↓'
Configuration: ProtBert (DeepProtein benchmark)Protocol: DeepProtein Stability (TAPE): ρ ↑
Dataset: Stability (TAPE)
0.646 ± 0.064 Spearman (Spearman rank correlation, as defined in the article's Evaluation metrics section; supervised split)
unitless · higher

Uncertainty: SD 0.064

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ProtBert on DeepProtein Stability (TAPE) (ρ ↑)

lit-protein-20261011-deepprotein-protocol-stability-rho

Aggregation: Not reported

DeepProtein: deep learning library and benchmark for protein sequence learning · Table 2. row 'ProtBert', column group 'Stability', column 'ρ ↑'

Source checking is not independent reproduction. Release 2026-10-22-1b7cf027e4f6.

Use this configuration

How it works, versions and access
Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: lit-protein-20261011-deepprotein-config-protbert

areas
protein-function
contexts
research
method types
foundation_model
reported name
ProtBert
reported configuration
protein language model; default DeepProtein configuration (Table 9)
foundation model eligible
true
source locator
Tables 2 to 8, row 'ProtBert'; Table 9 for the default configuration
missing metadata
version: reason: unreported; note: The tables name the model without a release version
provenance note
ProtBert as trained and evaluated in the DeepProtein benchmark (protein language model).
Related records

Suggest a correction