Genie
Protein model evaluated by the ProteinBench authors under their harness.
Overview
Protein model evaluated by the ProteinBench authors under their harness.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
Evaluations and results
20 evaluations · 20 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Genie | Task: ProteinBench BB-LENGTH-100-DIVERSITY-MAX-CLUST: length 100, Diversity Max Clust. Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.96 max-clust score · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-100-DIVERSITY-MAX-CLUST: length 100, Diversity Max Clust. Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 100, Diversity Max Clust.↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-100-DIVERSITY-PAIRWISE-TM: length 100, Diversity pairwise TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.31 ± 0.02 pairwise-tm score · lower Uncertainty: type: standard_deviation; value: 0.02 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-100-DIVERSITY-PAIRWISE-TM: length 100, Diversity pairwise TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 100, Diversity pairwise TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-100-NOVELTY-MAX-TM: length 100, Novelty Max TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.59 ± 0.01 max-tm score · lower Uncertainty: type: standard_deviation; value: 0.01 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-100-NOVELTY-MAX-TM: length 100, Novelty Max TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 100, Novelty Max TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-100-QUALITY-SCRMSD: length 100, Quality scRMSD Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 3.38 ± 3.04 scrmsd score · lower Uncertainty: type: standard_deviation; value: 3.04 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-100-QUALITY-SCRMSD: length 100, Quality scRMSD Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 100, Quality scRMSD ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-100-QUALITY-SCTM: length 100, Quality scTM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.69 ± 0.17 sctm score · higher Uncertainty: type: standard_deviation; value: 0.17 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-100-QUALITY-SCTM: length 100, Quality scTM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 100, Quality scTM ↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-300-DIVERSITY-MAX-CLUST: length 300, Diversity Max Clust. Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 1 max-clust score · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-300-DIVERSITY-MAX-CLUST: length 300, Diversity Max Clust. Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 300, Diversity Max Clust. ↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-300-DIVERSITY-PAIRWISE-TM: length 300, Diversity pairwise TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.23 ± 0.01 pairwise-tm score · lower Uncertainty: type: standard_deviation; value: 0.01 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-300-DIVERSITY-PAIRWISE-TM: length 300, Diversity pairwise TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 300, Diversity pairwise TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-300-NOVELTY-MAX-TM: length 300, Novelty Max TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.30 ± 0.01 max-tm score · lower Uncertainty: type: standard_deviation; value: 0.01 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-300-NOVELTY-MAX-TM: length 300, Novelty Max TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 300, Novelty Max TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-300-QUALITY-SCRMSD: length 300, Quality scRMSD Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 20.37 ± 1.70 scrmsd score · lower Uncertainty: type: standard_deviation; value: 1.70 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-300-QUALITY-SCRMSD: length 300, Quality scRMSD Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 300, Quality scRMSD ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-300-QUALITY-SCTM: length 300, Quality scTM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.27 ± 0.02 sctm score · higher Uncertainty: type: standard_deviation; value: 0.02 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-300-QUALITY-SCTM: length 300, Quality scTM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 300, Quality scTM ↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-50-DIVERSITY-MAX-CLUST: length 50, Diversity Max Clust. Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.9 max-clust score · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-50-DIVERSITY-MAX-CLUST: length 50, Diversity Max Clust. Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 50, Diversity Max Clust. ↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-50-DIVERSITY-PAIRWISE-TM: length 50, Diversity pairwise TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.32 ± 0.02 pairwise-tm score · lower Uncertainty: type: standard_deviation; value: 0.02 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-50-DIVERSITY-PAIRWISE-TM: length 50, Diversity pairwise TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 50, Diversity pairwise TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-50-NOVELTY-MAX-TM: length 50, Novelty Max TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.57 ± 0.03 max-tm score · lower Uncertainty: type: standard_deviation; value: 0.03 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-50-NOVELTY-MAX-TM: length 50, Novelty Max TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 50, Novelty Max TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-50-QUALITY-SCRMSD: length 50, Quality scRMSD Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 3.12 ± 2.07 scrmsd score · lower Uncertainty: type: standard_deviation; value: 2.07 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-50-QUALITY-SCRMSD: length 50, Quality scRMSD Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 50, Quality scRMSD ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-50-QUALITY-SCTM: length 50, Quality scTM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.57 ± 0.15 sctm score · higher Uncertainty: type: standard_deviation; value: 0.15 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-50-QUALITY-SCTM: length 50, Quality scTM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 50, Quality scTM ↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-500-DIVERSITY-MAX-CLUST: length 500, Diversity Max Clust. Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 1 max-clust score · higher Uncertainty: Not reported Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-500-DIVERSITY-MAX-CLUST: length 500, Diversity Max Clust. Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 500, Diversity Max Clust.↑) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-500-DIVERSITY-PAIRWISE-TM: length 500, Diversity pairwise TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.23 ± 0.004 pairwise-tm score · lower Uncertainty: type: standard_deviation; value: 0.004 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-500-DIVERSITY-PAIRWISE-TM: length 500, Diversity pairwise TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 500, Diversity pairwise TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-500-NOVELTY-MAX-TM: length 500, Novelty Max TM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.22 ± 0.002 max-tm score · lower Uncertainty: type: standard_deviation; value: 0.002 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-500-NOVELTY-MAX-TM: length 500, Novelty Max TM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 500, Novelty Max TM ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-500-QUALITY-SCRMSD: length 500, Quality scRMSD Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 26.08 ± 1.58 scrmsd score · lower Uncertainty: type: standard_deviation; value: 1.58 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-500-QUALITY-SCRMSD: length 500, Quality scRMSD Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 500, Quality scRMSD ↓) |
| Configuration: Genie | Task: ProteinBench BB-LENGTH-500-QUALITY-SCTM: length 500, Quality scTM Dataset subset: Designed backbones at fixed lengths (ProteinBench split) | 0.25 ± 0.01 sctm score · higher Uncertainty: type: standard_deviation; value: 0.01 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGenie on ProteinBench BB-LENGTH-500-QUALITY-SCTM: length 500, Quality scTM Unconditional backbone design at a fixed sequence length. Values are the median over repeated runs. Aggregation: Not reported proteinbench primary benchmark evidence · Table 3, row(Genie), column(length 500, Quality scTM ↑) |
Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.
Use this model
How it works, versions and access
Strengths, limitations and unresolved questions
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
View linked audit checks and correction history
Release 2026-09-29-06401fd5b220 · Record review: source checked
1 source records and release history
- proteinbench primary benchmark evidence · Original source · 2409.06744v1
Technical metadata and extraction receipts
Stable ID: proteinbench-method-genie
- areas
- proteins-complexes
- source locator
- Table 3, row(Genie)
- missing metadata
- checkpoint revision: unreported; parameters: unextracted
Related records
- model: Genie on ProteinBench BB-LENGTH-100-DIVERSITY-MAX-CLUST: length 100, Diversity Max Clust.
- model: Genie on ProteinBench BB-LENGTH-100-DIVERSITY-PAIRWISE-TM: length 100, Diversity pairwise TM
- model: Genie on ProteinBench BB-LENGTH-100-NOVELTY-MAX-TM: length 100, Novelty Max TM
- model: Genie on ProteinBench BB-LENGTH-100-QUALITY-SCRMSD: length 100, Quality scRMSD
- model: Genie on ProteinBench BB-LENGTH-100-QUALITY-SCTM: length 100, Quality scTM
- model: Genie on ProteinBench BB-LENGTH-300-DIVERSITY-MAX-CLUST: length 300, Diversity Max Clust.
- model: Genie on ProteinBench BB-LENGTH-300-DIVERSITY-PAIRWISE-TM: length 300, Diversity pairwise TM
- model: Genie on ProteinBench BB-LENGTH-300-NOVELTY-MAX-TM: length 300, Novelty Max TM
- model: Genie on ProteinBench BB-LENGTH-300-QUALITY-SCRMSD: length 300, Quality scRMSD
- model: Genie on ProteinBench BB-LENGTH-300-QUALITY-SCTM: length 300, Quality scTM
- model: Genie on ProteinBench BB-LENGTH-50-DIVERSITY-MAX-CLUST: length 50, Diversity Max Clust.
- model: Genie on ProteinBench BB-LENGTH-50-DIVERSITY-PAIRWISE-TM: length 50, Diversity pairwise TM
- model: Genie on ProteinBench BB-LENGTH-50-NOVELTY-MAX-TM: length 50, Novelty Max TM
- model: Genie on ProteinBench BB-LENGTH-50-QUALITY-SCRMSD: length 50, Quality scRMSD
- model: Genie on ProteinBench BB-LENGTH-50-QUALITY-SCTM: length 50, Quality scTM
- model: Genie on ProteinBench BB-LENGTH-500-DIVERSITY-MAX-CLUST: length 500, Diversity Max Clust.
- model: Genie on ProteinBench BB-LENGTH-500-DIVERSITY-PAIRWISE-TM: length 500, Diversity pairwise TM
- model: Genie on ProteinBench BB-LENGTH-500-NOVELTY-MAX-TM: length 500, Novelty Max TM
- model: Genie on ProteinBench BB-LENGTH-500-QUALITY-SCRMSD: length 500, Quality scRMSD
- model: Genie on ProteinBench BB-LENGTH-500-QUALITY-SCTM: length 500, Quality scTM