rewirebio.iobenchmarks
Source

proteinbench primary benchmark evidence

2409.06744v1

DOI: 10.48550/arXiv.2409.06744Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AbDPOSequence recovery (cdr-h3)31.29% ± 7.29 percentRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-ACCURACY-AAR: Accuracy AAR
AbDPORMSD (cdr-h3, ca atoms)2.79 ± 3.01 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-ACCURACY-RMSD: Accuracy RMSD
AbDPOTM score (cdr-h3)0.35 ± 0.06 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-ACCURACY-TM-SCORE: Accuracy TM-score
AbDPOProteinbench binding energy116.06 ± 186.06 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-FUNCTIONALITY-BINDING-ENERGY: Functionality Binding Energy
AbDPOProteinbench clashes inner4.14 ± 1.84 countRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-RATIONALITY-CLASHES-INNER: Rationality Clashes-inner
AbDPOProteinbench clashes outer0 .10 ± 0.24 countRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-RATIONALITY-CLASHES-OUTER: Rationality Clashes-outer
AbDPOProteinbench cn score1.33 ± 2.31 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-RATIONALITY-CN-SCORE: Rationality CN-score
AbDPOScrmsd2.79 ± 3.25 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-RATIONALITY-SCRMSD: Rationality scRMSD
AbDPOProteinbench seqnat-1.99 ± 0.34 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-RATIONALITY-SEQNAT: Rationality SeqNat
AbDPOProteinbench total energy270.12 ± 217.45 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-RATIONALITY-TOTAL-ENERGY: Rationality Total Energy
AbDPOProteinbench phr69.69% ± 8.49 percentRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-SPECIFICITY-PHR: Specificity PHR
AbDPOProteinbench seqsim inner0 .60 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-SPECIFICITY-SEQSIM-INNER: Specificity SeqSim-inner
AbDPOProteinbench seqsim outer0 .38 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO on ProteinBench AB-SPECIFICITY-SEQSIM-OUTER: Specificity SeqSim-outer
AbDPO++Sequence recovery (cdr-h3)36.25% ± 7.95 percentRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-ACCURACY-AAR: Accuracy AAR
AbDPO++RMSD (cdr-h3, ca atoms)2.48 ± 0.59 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-ACCURACY-RMSD: Accuracy RMSD
AbDPO++TM score (cdr-h3)0.35 ± 0.06 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-ACCURACY-TM-SCORE: Accuracy TM-score
AbDPO++Proteinbench binding energy2 23.73 ± 281.7 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-FUNCTIONALITY-BINDING-ENERGY: Functionality Binding Energy
AbDPO++Proteinbench clashes inner1.66 ± 1.28 countRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-RATIONALITY-CLASHES-INNER: Rationality Clashes-inner
AbDPO++Proteinbench clashes outer0.08 ± 0.20 countRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-RATIONALITY-CLASHES-OUTER: Rationality Clashes-outer
AbDPO++Proteinbench cn score2.34 ± 3.20 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-RATIONALITY-CN-SCORE: Rationality CN-score
AbDPO++Scrmsd2.50 ± 0.75 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-RATIONALITY-SCRMSD: Rationality scRMSD
AbDPO++Proteinbench seqnat- 1.78 ± 0.43 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-RATIONALITY-SEQNAT: Rationality SeqNat
AbDPO++Proteinbench total energy3 38.14 ± 266.48 unit-unreportedRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-RATIONALITY-TOTAL-ENERGY: Rationality Total Energy
AbDPO++Proteinbench phr44.51% ± 9.55 percentRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-SPECIFICITY-PHR: Specificity PHR
AbDPO++Proteinbench seqsim inner0.54 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-SPECIFICITY-SEQSIM-INNER: Specificity SeqSim-inner
AbDPO++Proteinbench seqsim outer0.39 unitlessRAbD, 55 antibody-antigen complexes (ProteinBench split)AbDPO++ on ProteinBench AB-SPECIFICITY-SEQSIM-OUTER: Specificity SeqSim-outer
AlphaFold2GDT ts (mean over targets)0.860 fractionCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-GDT-TS-MEAN: Accuracy GDT-TS (mean)
AlphaFold2GDT ts (median over targets)0.921 fractionCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-GDT-TS-MEDIAN: Accuracy GDT-TS (median)
AlphaFold2lDDT (mean over targets)0.904 fractionCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-LDDT-MEAN: Accuracy lDDT (mean)
AlphaFold2lDDT (median over targets)0.933 fractionCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-LDDT-MEDIAN: Accuracy lDDT (median)
AlphaFold2RMSD (mean over targets)3.21 unit-unreportedCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-RMSD-MEAN: Accuracy RMSD (mean)
AlphaFold2RMSD (median over targets)1.64 unit-unreportedCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-RMSD-MEDIAN: Accuracy RMSD (median)
AlphaFold2TM score (mean over targets)0.871 unitlessCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-TM-SCORE-MEAN: Accuracy TM-score (mean)
AlphaFold2TM score (median over targets)0.952 unitlessCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-ACCURACY-TM-SCORE-MEDIAN: Accuracy TM-score (median)
AlphaFold2Proteinbench ca break (mean over targets)0.0 percentCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-QUALITY-CA-BREAK-MEAN: Quality CA break (%) (mean)
AlphaFold2Proteinbench ca break (median over targets)0.0 percentCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-QUALITY-CA-BREAK-MEDIAN: Quality CA break (%) (median)
AlphaFold2Proteinbench ca clash (mean over targets)0.3 percentCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-QUALITY-CA-CLASH-MEAN: Quality CA clash (%) (mean)
AlphaFold2Proteinbench ca clash (median over targets)0.0 percentCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-QUALITY-CA-CLASH-MEDIAN: Quality CA clash (%) (median)
AlphaFold2Proteinbench pepbond break (mean over targets)4.8 percentCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-QUALITY-PEPBOND-BREAK-MEAN: Quality PepBond break (%) (mean)
AlphaFold2Proteinbench pepbond break (median over targets)4.1 percentCAMEO2022, 183 proteins (ProteinBench split)AlphaFold2 on ProteinBench FOLD-QUALITY-PEPBOND-BREAK-MEDIAN: Quality PepBond break (%) (median)
ChromaProteinbench max clust0.48 fractionDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-50-DIVERSITY-MAX-CLUST: length 50, Diversity Max Clust.
ChromaProteinbench pairwise TM0.29 ± 0.01 unitlessDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-50-DIVERSITY-PAIRWISE-TM: length 50, Diversity pairwise TM
ChromaProteinbench max TM0.59 ± 0.08 unitlessDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-50-NOVELTY-MAX-TM: length 50, Novelty Max TM
ChromaScrmsd1.05 ± 1.49 unit-unreportedDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-50-QUALITY-SCRMSD: length 50, Quality scRMSD
ChromaSctm0.85 ± 0.15 unitlessDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-50-QUALITY-SCTM: length 50, Quality scTM
ChromaProteinbench max clust0.59 fractionDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-100-DIVERSITY-MAX-CLUST: length 100, Diversity Max Clust.
ChromaProteinbench pairwise TM0.35 ± 0.03 unitlessDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-100-DIVERSITY-PAIRWISE-TM: length 100, Diversity pairwise TM
ChromaProteinbench max TM0.70 ± 0.01 unitlessDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-100-NOVELTY-MAX-TM: length 100, Novelty Max TM
ChromaScrmsd1.27 ± 1.85 unit-unreportedDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-100-QUALITY-SCRMSD: length 100, Quality scRMSD
ChromaSctm0.89 ± 0.13 unitlessDesigned backbones at fixed lengths (ProteinBench split)Chroma on ProteinBench BB-LENGTH-100-QUALITY-SCTM: length 100, Quality scTM

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Configurations (34)

Benchmarks (1)

Tasks (96)

Dataset subsets (6)

Evaluations (556)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://arxiv.org/html/2409.06744v1
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Doi
10.48550/arXiv.2409.06744
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-16T21:07:13.231727+00:00
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://arxiv.org/html/2409.06744v1
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
2409.06744v1
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
proteinbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2409.06744v1
Retrieved: 2026-09-16T21:07:13.231727+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: expansion-p3-proteinbench

url
https://arxiv.org/html/2409.06744v1
doi
10.48550/arXiv.2409.06744
version
2409.06744v1
retrieved at
2026-09-16T21:07:13.231727+00:00
artifact sha256
4334d636223ad42bfb9ae68aae03f5a255c29ba1cebe7b8f9588fb3b9b5453b2
artifact url
https://arxiv.org/html/2409.06744v1
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

    Suggest a correction