rewirebio.iobenchmarks
Source

pfmbench primary benchmark evidence

2506.14796v1

DOI: 10.48550/arXiv.2506.14796Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
DPLMAccuracy0 .68732 fractionAntibiotic resistance (PFMBench split)DPLM on PFMBench ANTI-RES: Antibiotic resistance
DPLMSpearman0.17408 unitlessBindingDB (PFMBench split)DPLM on PFMBench BINDING-DB: BindingDB
DPLMAUROC0.81247 unitlessCloning CLF (PFMBench split)DPLM on PFMBench CLONING-CLF: Cloning CLF
DPLMF1 max (multi-label; TorchDrug-style F1_score_max)0.75759 fractionDeepLoc2 Multi (PFMBench split)DPLM on PFMBench DEEPLOC2: DeepLoc2 Multi
DPLMAUROC0.82841 unitlessDeepSol (PFMBench split)DPLM on PFMBench DEEPSOL: DeepSol
DPLMF1 max (multi-label; TorchDrug-style F1_score_max)0.75521 fractionEnzyme Commission (PFMBench split)DPLM on PFMBench EC: Enzyme Commission
DPLMAccuracy0.80144 fractionMaterial production (PFMBench split)DPLM on PFMBench MAT-PROD: Material production
DPLMAccuracy0.70056 fractionMetal ion binding (PFMBench split)DPLM on PFMBench METAL-ION: Metal ion binding
DPLMSpearman0.13659 unitlessPDBbind (PFMBench split)DPLM on PFMBench PDB-BIND: PDBbind
DPLMSpearman0.42922 unitlessProteinGym (PFMBench split)DPLM on PFMBench PROTEINGYM-ZS: ProteinGym zero-shot variant effect prediction
DPLMAccuracy0.75695 fractionSecondary structure (PFMBench split)DPLM on PFMBench SEC-STRUCT: Secondary structure
DPLMSpearman0.29440 unitlessTAPE_Stability (PFMBench split)DPLM on PFMBench STABILITY: TAPE_Stability
ESM-2Accuracy0.63422 fractionAntibiotic resistance (PFMBench split)ESM-2 on PFMBench ANTI-RES: Antibiotic resistance
ESM-2Spearman0.13692 unitlessBindingDB (PFMBench split)ESM-2 on PFMBench BINDING-DB: BindingDB
ESM-2AUROC0.80586 unitlessCloning CLF (PFMBench split)ESM-2 on PFMBench CLONING-CLF: Cloning CLF
ESM-2F1 max (multi-label; TorchDrug-style F1_score_max)0 .76191 fractionDeepLoc2 Multi (PFMBench split)ESM-2 on PFMBench DEEPLOC2: DeepLoc2 Multi
ESM-2AUROC0.84494 unitlessDeepSol (PFMBench split)ESM-2 on PFMBench DEEPSOL: DeepSol
ESM-2F1 max (multi-label; TorchDrug-style F1_score_max)0.73578 fractionEnzyme Commission (PFMBench split)ESM-2 on PFMBench EC: Enzyme Commission
ESM-2Accuracy0.81189 fractionMaterial production (PFMBench split)ESM-2 on PFMBench MAT-PROD: Material production
ESM-2Accuracy0.71170 fractionMetal ion binding (PFMBench split)ESM-2 on PFMBench METAL-ION: Metal ion binding
ESM-2Spearman0.14677 unitlessPDBbind (PFMBench split)ESM-2 on PFMBench PDB-BIND: PDBbind
ESM-2Spearman0.43904 unitlessProteinGym (PFMBench split)ESM-2 on PFMBench PROTEINGYM-ZS: ProteinGym zero-shot variant effect prediction
ESM-2Accuracy0.76375 fractionSecondary structure (PFMBench split)ESM-2 on PFMBench SEC-STRUCT: Secondary structure
ESM-2Spearman0.32112 unitlessTAPE_Stability (PFMBench split)ESM-2 on PFMBench STABILITY: TAPE_Stability
ESM-CAccuracy0.67257 fractionAntibiotic resistance (PFMBench split)ESM-C on PFMBench ANTI-RES: Antibiotic resistance
ESM-CSpearman0 .20716 unitlessBindingDB (PFMBench split)ESM-C on PFMBench BINDING-DB: BindingDB
ESM-CAUROC0.81033 unitlessCloning CLF (PFMBench split)ESM-C on PFMBench CLONING-CLF: Cloning CLF
ESM-CF1 max (multi-label; TorchDrug-style F1_score_max)0.75395 fractionDeepLoc2 Multi (PFMBench split)ESM-C on PFMBench DEEPLOC2: DeepLoc2 Multi
ESM-CAUROC0.84171 unitlessDeepSol (PFMBench split)ESM-C on PFMBench DEEPSOL: DeepSol
ESM-CF1 max (multi-label; TorchDrug-style F1_score_max)0.71694 fractionEnzyme Commission (PFMBench split)ESM-C on PFMBench EC: Enzyme Commission
ESM-CAccuracy0.81009 fractionMaterial production (PFMBench split)ESM-C on PFMBench MAT-PROD: Material production
ESM-CAccuracy0.70195 fractionMetal ion binding (PFMBench split)ESM-C on PFMBench METAL-ION: Metal ion binding
ESM-CSpearman0.14692 unitlessPDBbind (PFMBench split)ESM-C on PFMBench PDB-BIND: PDBbind
ESM-CSpearman0.43422 unitlessProteinGym (PFMBench split)ESM-C on PFMBench PROTEINGYM-ZS: ProteinGym zero-shot variant effect prediction
ESM-CAccuracy0.76777 fractionSecondary structure (PFMBench split)ESM-C on PFMBench SEC-STRUCT: Secondary structure
ESM-CSpearman0.29976 unitlessTAPE_Stability (PFMBench split)ESM-C on PFMBench STABILITY: TAPE_Stability
ESM3Accuracy0.58407 fractionAntibiotic resistance (PFMBench split)ESM3 on PFMBench ANTI-RES: Antibiotic resistance
ESM3Spearman0.22519 unitlessBindingDB (PFMBench split)ESM3 on PFMBench BINDING-DB: BindingDB
ESM3AUROC0.77391 unitlessCloning CLF (PFMBench split)ESM3 on PFMBench CLONING-CLF: Cloning CLF
ESM3F1 max (multi-label; TorchDrug-style F1_score_max)0.65853 fractionDeepLoc2 Multi (PFMBench split)ESM3 on PFMBench DEEPLOC2: DeepLoc2 Multi
ESM3AUROC0.78106 unitlessDeepSol (PFMBench split)ESM3 on PFMBench DEEPSOL: DeepSol
ESM3F1 max (multi-label; TorchDrug-style F1_score_max)0.64830 fractionEnzyme Commission (PFMBench split)ESM3 on PFMBench EC: Enzyme Commission
ESM3Accuracy0.77514 fractionMaterial production (PFMBench split)ESM3 on PFMBench MAT-PROD: Material production
ESM3Accuracy0.70334 fractionMetal ion binding (PFMBench split)ESM3 on PFMBench METAL-ION: Metal ion binding
ESM3Spearman0.15572 unitlessPDBbind (PFMBench split)ESM3 on PFMBench PDB-BIND: PDBbind
ESM3Spearman0.41401 unitlessProteinGym (PFMBench split)ESM3 on PFMBench PROTEINGYM-ZS: ProteinGym zero-shot variant effect prediction
ESM3Accuracy0.81264 fractionSecondary structure (PFMBench split)ESM3 on PFMBench SEC-STRUCT: Secondary structure
ESM3Spearman0.15650 unitlessTAPE_Stability (PFMBench split)ESM3 on PFMBench STABILITY: TAPE_Stability
PGLMAccuracy0.67257 fractionAntibiotic resistance (PFMBench split)PGLM on PFMBench ANTI-RES: Antibiotic resistance
PGLMSpearman0.16884 unitlessBindingDB (PFMBench split)PGLM on PFMBench BINDING-DB: BindingDB

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Configurations (12)

Benchmarks (1)

Tasks (12)

Dataset subsets (12)

Evaluations (141)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://arxiv.org/html/2506.14796v1
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Doi
10.48550/arXiv.2506.14796
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-16T21:06:29.716004+00:00
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://arxiv.org/html/2506.14796v1
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
2506.14796v1
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
pfmbench primary benchmark evidence

Original source ↗

No field-specific location recorded

Version: 2506.14796v1
Retrieved: 2026-09-16T21:06:29.716004+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: expansion-p3-pfmbench

url
https://arxiv.org/html/2506.14796v1
doi
10.48550/arXiv.2506.14796
version
2506.14796v1
retrieved at
2026-09-16T21:06:29.716004+00:00
artifact sha256
59c7bbb888e8e91f33c1e2cabfde062c32381d6ca727d23b6655c977aabf97a2
artifact url
https://arxiv.org/html/2506.14796v1
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

    Suggest a correction