rewirebio.iobenchmarks
Source

RFD4-Proteina benchmarks/provenance.json at revision 621b785

Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030 · Project source

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
AlphaProtein-novo (Codesign), Atomic Motif EnzymePassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: protein-backbone RMSD at most 2 A, required motif all-atom RMSD at most 1.5 A, and AF3 minimum interface PAE below 1.5 A)26.02 count-per-hourFrozen project benchmark Atomic Motif Enzyme target set, 37 tasksAlphaProtein-novo (Codesign) on Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour
BoltzGen, frozen project benchmark recipePassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A and DNA-target-aligned binder backbone RMSD at most 8 A, aligning on all target DNA atoms in both the fixed and unfixed modes)9.46 count-per-hourFrozen project benchmark DNA-binding target set, 3 targetsBoltzGen (fixed DNA) on Frozen project benchmark DNA binding, fixed DNA: distinct passers per GPU-hour
BoltzGen, frozen project benchmark recipePassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A, chain-of-interest ipTM at least 80 out of 100, protein-backbone RMSD at most 1.5 A, and protein-backbone-aligned ligand RMSD at most 5 A (the sm_binder criterion, not the looser historical disco criterion))15.48 count-per-hourFrozen project benchmark small-molecule binding target set, 77 targetsBoltzGen on Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour
Proteina-Complexa (V1), protein binding, all-atom conditioningPassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 binder pTM at least 80 on the native 0 to 100 scale, minimum interface PAE at most 1.5 A, and target-backbone-aligned binder backbone RMSD at most 2.5 A, with valid required target mapping and conditioning)13.24 count-per-hourFrozen project benchmark protein-binding target set, 24 targetsProteina-Complexa on Frozen project benchmark protein binding, all-atom conditioning: distinct passers per GPU-hour
RFD4-Proteina (high thinking), previous release pairPassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: protein-backbone RMSD at most 2 A, required motif all-atom RMSD at most 1.5 A, and AF3 minimum interface PAE below 1.5 A)91.18 count-per-hourFrozen project benchmark Atomic Motif Enzyme target set, 37 tasksRFD4-Proteina, high thinking on Frozen project benchmark Atomic Motif Enzyme, fixed ligand: distinct passers per GPU-hour
RFD4-Proteina (high thinking), previous release pairPassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A and DNA-target-aligned binder backbone RMSD at most 8 A, aligning on all target DNA atoms in both the fixed and unfixed modes)41.97 count-per-hourFrozen project benchmark DNA-binding target set, 3 targetsRFD4-Proteina, high thinking on Frozen project benchmark DNA binding, unfixed DNA: distinct passers per GPU-hour
RFD4-Proteina (high thinking), previous release pairPassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 binder pTM at least 80 on the native 0 to 100 scale, minimum interface PAE at most 1.5 A, and target-backbone-aligned binder backbone RMSD at most 2.5 A, with valid required target mapping and conditioning)71.60 count-per-hourFrozen project benchmark protein-binding target set, 24 targetsRFD4-Proteina, high thinking on Frozen project benchmark protein binding, backbone conditioning: distinct passers per GPU-hour
RFD4-Proteina (high thinking), previous release pairPassing design clusters per accelerator hour (mean over targets of structurally distinct computational passers per GPU-hour, counting generation and common AlphaFold3 evaluation time, with 200 original attempts per target and failed attempts included; passing designs clustered within each model, protocol and target by Foldseek at TM 0.5; pass criterion: AF3 minimum interface PAE at most 1.5 A, chain-of-interest ipTM at least 80 out of 100, protein-backbone RMSD at most 1.5 A, and protein-backbone-aligned ligand RMSD at most 5 A (the sm_binder criterion, not the looser historical disco criterion))112.25 count-per-hourFrozen project benchmark small-molecule binding target set, 77 targetsRFD4-Proteina, high thinking on Frozen project benchmark small-molecule binding, unfixed ligand: distinct passers per GPU-hour

Claims

Statements this source supports, each with where in the source it was checked.

  • RFD4-Proteina frozen project benchmark, October 9 2026 supplement: efficiency table scope: Efficiency table scope The card prints above the efficiency table: 'These numbers were measured on the previous release pair, in the October 9, 2026 frozen project benchmark, which predates the current checkpoints. They have not been re-measured on the current release and should not be read as describing it.' The provenance file gives the packet's source release as supplement-20261009 from paper commit 8614542c149875b13ed3fed5d8d6ec739f2daff4, and its scope as 'Frozen project benchmark runs; not a new evaluation of every model Hub revision.' (Hugging Face model card, 'Measured design efficiency' blockquote; benchmarks/provenance.json, keys source_release, paper_commit and scope)
  • RFD4-Proteina frozen project benchmark, October 9 2026 supplement: metric definition: Metric definition The card defines the table's metric as 'mean per-target structurally distinct computational passers per GPU-hour, including generation and common AF3 evaluation', higher being better, and adds that computational passers do not establish experimental activity. The provenance file gives the expression mean_over_targets(3600 * passing_structure_clusters / (generation_gpu_s + af3_gpu_s)). The methods supplement defines a passing cluster as a distinct Foldseek cluster among passing originals, computed within each model, protocol and target at TM threshold 0.5, and says these are algorithmic structural clusters, not experimental successes or globally distinct proteins. (Hugging Face model card, 'Measured design efficiency' metric line and the paragraph below the table; benchmarks/provenance.json, key metric; benchmarks/METHODS.md, final paragraph of 'Common AF3 scoring')

Models, benchmarks and other records

Models (1)

Configurations (1)

Benchmarks (1)

Protocols (6)

Evaluations (8)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

27 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Archive member
artifacts/hf_benchmarks_provenance.json.gz
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.archive_member

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Archive sha256
90008405bef72cb56f687e08d4dd5678b4cc867cb9987dcbe2098eae217cc50a
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.archive_sha256

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Artifact SHA-256
4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Licence
BSD 3-Clause
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.licence

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Media type
application/json
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Publication status
official_project_source
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Retrieval url
https://huggingface.co/nvidia/RFD4-Proteina/raw/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieval_url

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Retrieved at
2026-11-15T23:10:00Z
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Review: artifact sha256
4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

Review: date
2026-11-15
Source metadata
RFD4-Proteina benchmarks/provenance.json at revision 621b785

Original source ↗

No field-specific location recorded

Version: Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Retrieved: 2026-11-15T23:10:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.date

Source artifact SHA-256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336

Hash scope: Hash scope not separately documented; inspect source record

Archive member: artifacts/hf_benchmarks_provenance.json.gz

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

The provenance file of the published benchmark packet, naming the frozen supplement release it was taken from, the metric expression and the scope of the runs.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: rfd4-proteina-20261115-source-hf-benchmark-provenance

areas
proteins-complexes; protein-structure; molecular-interactions
contexts
research
archive member
artifacts/hf_benchmarks_provenance.json.gz
archive sha256
90008405bef72cb56f687e08d4dd5678b4cc867cb9987dcbe2098eae217cc50a
artifact sha256
4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336
licence
BSD 3-Clause
media type
application/json
publication status
official_project_source
retrieval url
https://huggingface.co/nvidia/RFD4-Proteina/raw/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json
retrieved at
2026-11-15T23:10:00Z
review
artifact sha256: 4e7a3051a58902cc7713d02c52941894eb9581b82e5af85a3b4f256f1a258336; date: 2026-11-15; method: source-hash-verification; automated-source-review; note: Retrieved twice on 2026-11-15 with identical bytes; the hash is of the retrieved artifact, not of a text layer.; retrieval url: https://huggingface.co/nvidia/RFD4-Proteina/raw/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json; reviewer: claude; reviewer note: Claude (Opus 5) extraction agent; no human review claimed. Extraction only: a different agent reviews this batch, and nothing here is reproduced.
source locator
Keys 'source_release', 'paper_commit', 'metric', 'sha256' and 'scope'
url
https://huggingface.co/nvidia/RFD4-Proteina/blob/621b785abf9d61dd24f4b81ae4dbd1330728f030/benchmarks/provenance.json
version
Hugging Face revision 621b785abf9d61dd24f4b81ae4dbd1330728f030
Related records

Suggest a correction