RFD4-Proteina benchmarks/provenance.json at revision 621b785
Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 · Project source
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
| Model or configuration | Metric | Value | Dataset | Evaluation |
|---|---|---|---|---|
| AlphaProtein-novo (Codesign), Atomic Motif Enzyme | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: protein-backbone RMSD at most 2 A, required motif all-atom RMSD at most 1.5 A, and AF3 minimum interface PAE below 1.5 A) | 26.02 count-per-hour | Frozen project benchmark Atomic Motif Enzyme target set, 37 tasks | AlphaProtein-novo (Codesign) on Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour |
| BoltzGen, frozen project benchmark recipe | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A and DNA-target-aligned binder backbone RMSD at most 8 A, aligning on all target DNA atoms in both the fixed and unfixed modes) | 9.46 count-per-hour | Frozen project benchmark DNA-binding target set, 3 targets | BoltzGen (fixed DNA) on Frozen project benchmark DNA binding, fixed DNA: distinct passers per GPU-hour |
| BoltzGen, frozen project benchmark recipe | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A, chain-of-interest ipTM at least 80 out of 100, protein-backbone RMSD at most 1.5 A, and protein-backbone-aligned ligand RMSD at most 5 A (the sm_binder criterion, not the looser historical disco criterion)) | 15.48 count-per-hour | Frozen project benchmark small-molecule binding target set, 77 targets | BoltzGen on Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour |
| Proteina-Complexa (V1), protein binding, all-atom conditioning | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 binder pTM at least 80 on the native 0 to 100 scale, minimum interface PAE at most 1.5 A, and target-backbone-aligned binder backbone RMSD at most 2.5 A, with valid required target mapping and conditioning) | 13.24 count-per-hour | Frozen project benchmark protein-binding target set, 24 targets | Proteina-Complexa on Frozen project benchmark protein binding, all-atom conditioning: distinct passers per GPU-hour |
| RFD4-Proteina (high thinking), previous release pair | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: protein-backbone RMSD at most 2 A, required motif all-atom RMSD at most 1.5 A, and AF3 minimum interface PAE below 1.5 A) | 91.18 count-per-hour | Frozen project benchmark Atomic Motif Enzyme target set, 37 tasks | RFD4-Proteina, high thinking on Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour |
| RFD4-Proteina (high thinking), previous release pair | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A and DNA-target-aligned binder backbone RMSD at most 8 A, aligning on all target DNA atoms in both the fixed and unfixed modes) | 41.97 count-per-hour | Frozen project benchmark DNA-binding target set, 3 targets | RFD4-Proteina, high thinking on Frozen project benchmark DNA binding, unfixed DNA: distinct passers per GPU-hour |
| RFD4-Proteina (high thinking), previous release pair | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 binder pTM at least 80 on the native 0 to 100 scale, minimum interface PAE at most 1.5 A, and target-backbone-aligned binder backbone RMSD at most 2.5 A, with valid required target mapping and conditioning) | 71.60 count-per-hour | Frozen project benchmark protein-binding target set, 24 targets | RFD4-Proteina, high thinking on Frozen project benchmark protein binding, backbone conditioning: distinct passers per GPU-hour |
| RFD4-Proteina (high thinking), previous release pair | Passing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A, chain-of-interest ipTM at least 80 out of 100, protein-backbone RMSD at most 1.5 A, and protein-backbone-aligned ligand RMSD at most 5 A (the sm_binder criterion, not the looser historical disco criterion)) | 112.25 count-per-hour | Frozen project benchmark small-molecule binding target set, 77 targets | RFD4-Proteina, high thinking on Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour |
Claims
Statements this source supports, each with where in the source it was checked.
- RFD4-Proteina frozen project benchmark, October 9 2026 supplement: efficiency table scope: Efficiency table scope The card prints above the efficiency table: 'These numbers were measured on the previous release pair, in the October 9, 2026 frozen project benchmark, which predates the current checkpoints. They have not been re-measured on the current release and should not be read as describing it.' The provenance file gives the packet's source release as supplement-20261009 from paper commit 8614542c149875b13ed3fed5d8d6ec739f2daff4, and its scope as 'Frozen project benchmark runs; not a new evaluation of every model Hub revision.' (Hugging Face model card, 'Measured design efficiency' blockquote; benchmarks/provenance.json, keys source_release, paper_commit and scope)
- RFD4-Proteina frozen project benchmark, October 9 2026 supplement: metric definition: Metric definition The card defines the table's metric as 'mean per-target structurally distinct computational passers per GPU-hour, including generation and common AF3 evaluation', higher being better, and adds that computational passers do not establish experimental activity. The provenance file gives the expression mean_over_targets(3600 * passing_structure_clusters / (generation_gpu_s + af3_gpu_s)). The methods supplement defines a passing cluster as a distinct Foldseek cluster among passing originals, computed within each model, protocol and target at TM threshold 0.5, and says these are algorithmic structural clusters, not experimental successes or globally distinct proteins. (Hugging Face model card, 'Measured design efficiency' metric line and the paragraph below the table; benchmarks/provenance.json, key metric; benchmarks/METHODS.md, final paragraph of 'Common AF3 scoring')
Models, benchmarks and other records
Models (1)
Configurations (1)
Benchmarks (1)
Protocols (6)
- Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour
- Frozen project benchmark DNA binding, fixed DNA: distinct passers per GPU-hour
- Frozen project benchmark DNA binding, unfixed DNA: distinct passers per GPU-hour
- Frozen project benchmark protein binding, all-atom conditioning: distinct passers per GPU-hour
- Frozen project benchmark protein binding, backbone conditioning: distinct passers per GPU-hour
- Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour
Evaluations (8)
- AlphaProtein-novo (Codesign) on Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour
- BoltzGen (fixed DNA) on Frozen project benchmark DNA binding, fixed DNA: distinct passers per GPU-hour
- BoltzGen on Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour
- Proteina-Complexa on Frozen project benchmark protein binding, all-atom conditioning: distinct passers per GPU-hour
- RFD4-Proteina, high thinking on Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour
- RFD4-Proteina, high thinking on Frozen project benchmark DNA binding, unfixed DNA: distinct passers per GPU-hour
- RFD4-Proteina, high thinking on Frozen project benchmark protein binding, backbone conditioning: distinct passers per GPU-hour
- RFD4-Proteina, high thinking on Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
27 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Archive member artifacts/hf_benchmarks_provenance.json.gz Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Archive sha256 90008405bef72cb56f687e08d4dd5678b4cc867cb9987dcbe2098eae217cc50a Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Artifact SHA-256 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336 Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Licence BSD 3-Clause Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Media type application/json Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Publication status official_project_source Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Retrieval url https://huggingface.co/nvidia/RFD4-Proteina/raw/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Retrieved at 2026-11-15T23:10:00Z Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Review: artifact sha256 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336 Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
| Review: date 2026-11-15 Source metadata | RFD4-Proteina benchmarks/provenance.json at revision 621b785 No field-specific location recorded Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record Archive member: artifacts/hf_benchmarks_provenance.json.gz |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
The provenance file of the published benchmark packet, naming the frozen supplement release it was taken from, the metric expression and the scope of the runs.
Technical metadata and extraction receipts
Stable ID: rfd4-proteina-20261115-source-hf-benchmark-provenance
- areas
- proteins-complexes; protein-structure; molecular-interactions
- contexts
- research
- archive member
- artifacts/hf_benchmarks_provenance.json.gz
- archive sha256
- 90008405bef72cb56f687e08d4dd5678b4cc867cb9987dcbe2098eae217cc50a
- artifact sha256
- 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336
- licence
- BSD 3-Clause
- media type
- application/json
- publication status
- official_project_source
- retrieval url
- https://huggingface.co/nvidia/RFD4-Proteina/raw/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json
- retrieved at
- 2026-11-15T23:10:00Z
- review
- artifact sha256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336; date: 2026-11-15; method: source-hash-verification; automated-source-review; note: Retrieved twice on 2026-11-15 with identical bytes; the hash is of the retrieved artifact, not of a text layer.; retrieval url: https://huggingface.co/nvidia/RFD4-Proteina/raw/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json; reviewer: claude; reviewer note: Claude (Opus 5) extraction agent; no human review claimed. Extraction only: a different agent reviews this batch, and nothing here is reproduced.
- source locator
- Keys 'source_release', 'paper_commit', 'metric', 'sha256' and 'scope'
- url
- https://huggingface.co/nvidia/RFD4-Proteina/blob/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json
- version
- Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030