| Comparison: adaptation Zero-shot: no model was trained or fine-tuned on POISK Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.adaptation Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: aggregation As printed by the source for this endpoint Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.aggregation Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: budget Folding all 22,494 complexes with all six models took approximately 9,000 NVIDIA B200 GPU-hours Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.budget Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: dataset version POISK dataset version 1.0.1; the folding predictions of the six models were run against that version Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.dataset_version Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: inputs Antibody heavy-chain and light-chain amino-acid sequences and the target amino-acid sequence, with ColabFold multiple sequence alignments and no templates Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.inputs Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: metric implementation Cross-model pose agreement: DockQ scores are computed for the Fv-antigen interface of each model's predicted complex, and consensus is the stated number of models predicting the same pose above the stated DockQ threshold. The paper states the decision rule as "For any given pair, a prediction was considered successful if the binder demonstrated structural agreement amongst more models than its decoy". The pair is decided by which member has agreement among more models, not by an interface confidence score; ipSAE does not enter this endpoint. Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.metric_implementation Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: population binder identified as the pair member with more agreeing folding-model poses above a DockQ threshold, over the pairs eligible at that threshold Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.population Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: protocol id poisk-20261115-protocol-consensus-pairwise-accuracy Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.protocol_id Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
| Comparison: split Evaluation only; the benchmark is scored in full and nothing is held out for training Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.split Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|
Limitations3 values- Reported by the authors of the benchmark, who built the dataset and ran every model on it. Not reproduced by Rewire.
- The scores being ranked are structural confidence scores, not measured binding or affinity.
- The negatives are putative: constructed from repertoire antibodies or by germline reversion, not shown experimentally not to bind.
Context-only references | Tupikina et al. 2026, Can Folding Models Tell Binders from Bluffers? Evidence from POISK (bioRxiv v1 PDF) Original source ↗ Section 3.3.1, sentence beginning "For instance, at k ≥ 3 and DockQ ≥ 0.80" Version: v1, posted 26 October 2026 Retrieved: 2026-11-15T23:32:24Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.limitations Source artifact SHA-256: 526def150fb5ae8f9ac4533efcf16c86e547e636cdb9bfba9a574cd1e2a2f924 Hash scope: One download of 2026-11-15. The PDF container is not byte-stable: bioRxiv regenerates it on request, so artifact_sha256 is that one download's hash and no refetch reproduces it. Three downloads on 2026-11-16 gave 3389c1bf6d3654c5b2151a07fcfcefc67cf6f36e5f0facfc03c33521d8b84491 twice and d699fd680e3b0097ca80130c288e8d872773dc1e523044f4605e06fc4f89d9bc once. All three yield the same pdftotext -layout text layer, SHA-256 e75c18130ca43770d2f0ed05ae96528759666c0e4fa08f7725f5a32b21187696, which is the article's stable identity, is archived gzipped in artifacts/biorxiv-v1-layout.txt.gz under archive_sha256, is what extract/build_batch.py asserts, and is what every stored value was read from. Format: application/pdf, 16 pages |
|---|