BenchBench-Cloning
Benchmark of 65 molecular cloning tasks that scores whether a language-model agent can work out which constructs a scientific objective needs and plan an executable construction route to them from supplied starting materials.
24 evaluations · 24 results2 benchmarks with further results
Overview
An explanatory profile has not yet been reviewed for this record.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
24 recorded evaluations, 24 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.
Results
Results are available, but no reviewed comparison panel is linked in this release.
All evaluations
24 evaluations · 24 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 15.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 9.8 to 21.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Mythos 5.1 at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'mid' effort 'high', column 'Aggregate % [95% CI]' |
| Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 10.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 6.3 to 15.4. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Mythos 5.1 at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, max reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 16% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 10.5 to 22.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Mythos 5.1 at max effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Claude Mythos 5.1', column 'Aggregate %' |
| Configuration: Claude Opus 5.5 in Claude Code 2.1.289, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 20% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 14.2 to 26.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Opus 5.5 at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'mid' effort 'high', column 'Aggregate % [95% CI]' |
| Configuration: Claude Opus 5.5 in Claude Code 2.1.289, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 12.3% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 7.7 to 17.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Opus 5.5 at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: Claude Opus 5.5 in Claude Code 2.1.289, max reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 20.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 13.7 to 27.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Opus 5.5 at max effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Claude Opus 5.5', column 'Aggregate %' |
| Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 8.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 4.0 to 14.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 3.8 Flash at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'top' effort 'high', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 3.8 Flash', column 'Aggregate %' |
| Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 10.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 5.7 to 16.6. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 3.8 Flash at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, medium reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 9.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 4.5 to 14.6. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 3.8 Flash at medium effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'mid' effort 'medium', column 'Aggregate % [95% CI]' |
| Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 18.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 11.5 to 26.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 4 Argon at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'top' effort 'high', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 4 Argon', column 'Aggregate %' |
| Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 15.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 10.4 to 21.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 4 Argon at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, medium reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 18.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 12.3 to 25.4. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 4 Argon at medium effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'mid' effort 'medium', column 'Aggregate % [95% CI]' |
| Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 21.7% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 15.7 to 28.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6.1 Sol at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'mid' effort 'high', column 'Aggregate % [95% CI]' |
| Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 17.1% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 11.2 to 23.5. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6.1 Sol at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 22.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 16.3 to 28.5. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6.1 Sol at max effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Aggregate %' |
| Configuration: GPT-6 Astra in Codex CLI 0.156.1, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 26.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 19.4 to 34.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6 Astra at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'mid' effort 'high', column 'Aggregate % [95% CI]' |
| Configuration: GPT-6 Astra in Codex CLI 0.156.1, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 19.4% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 13.2 to 26.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6 Astra at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: GPT-6 Astra in Codex CLI 0.156.1, max reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 30.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 23.2 to 38.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6 Astra at max effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6 Astra', column 'Aggregate %' |
| Configuration: Grok 4.7 in Grok Build 1.0.46, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 8.3% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 4.3 to 12.9. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGrok 4.7 at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'mid' effort 'high', column 'Aggregate % [95% CI]' |
| Configuration: Grok 4.7 in Grok Build 1.0.46, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 3.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 1.4 to 6.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGrok 4.7 at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: Grok 4.7 in Grok Build 1.0.46, xhigh reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 10.9% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 6.3 to 16.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGrok 4.7 at xhigh effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'top' effort 'xhigh', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Grok 4.7', column 'Aggregate %' |
| Configuration: Kimi K3 in Pi 1.0.3, high reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 8.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 4.9 to 13.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceKimi K3 at high effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'top' effort 'high', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Kimi K3', column 'Aggregate %' |
| Configuration: Kimi K3 in Pi 1.0.3, low reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 6.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 2.5 to 10.6. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceKimi K3 at low effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'low' effort 'low', column 'Aggregate % [95% CI]' |
| Configuration: Kimi K3 in Pi 1.0.3, medium reasoning effort | Benchmark: BenchBench-Cloning Dataset subset: BenchBench-Cloning protocol-development tasks (50) | 11.1% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 6.6 to 15.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.) | Author-reported evaluation · Source checkedMethods, coverage and sourceKimi K3 at medium effort on BenchBench-Cloning aggregate score benchbench-cloning-20261106-protocol-aggregate-score Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'mid' effort 'medium', column 'Aggregate % [95% CI]' |
Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.
Further results on linked records
2 linked records have results that are not included above, because no reviewed claim yet ties the link to this benchmark. Each record keeps its own settings and evaluations, and its scores are on its own page.
- BenchBench-Cloning construct-design set Benchmark · part of this benchmark · 24 evaluations · 24 results
- BenchBench-Cloning protocol-development set Benchmark · part of this benchmark · 56 evaluations · 56 results
Methods and evaluation design
Procedure, tasks and evaluated configurations
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- Claude Mythos 5.1 at high effort on BenchBench-Cloning aggregate score
- Claude Mythos 5.1 at low effort on BenchBench-Cloning aggregate score
- Claude Mythos 5.1 at max effort on BenchBench-Cloning aggregate score
- Claude Opus 5.5 at high effort on BenchBench-Cloning aggregate score
- Claude Opus 5.5 at low effort on BenchBench-Cloning aggregate score
- Claude Opus 5.5 at max effort on BenchBench-Cloning aggregate score
- Gemini 3.8 Flash at high effort on BenchBench-Cloning aggregate score
- Gemini 3.8 Flash at low effort on BenchBench-Cloning aggregate score
- Gemini 3.8 Flash at medium effort on BenchBench-Cloning aggregate score
- Gemini 4 Argon at high effort on BenchBench-Cloning aggregate score
- Gemini 4 Argon at low effort on BenchBench-Cloning aggregate score
- Gemini 4 Argon at medium effort on BenchBench-Cloning aggregate score
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
Baseline status by linked protocol
- BenchBench-Cloning aggregate score over all 65 tasks · 0/2 roles measured
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-11-21-adc15377fab2. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run instructions
No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
3 source records and release history
- BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Original source · arXiv v1, dated 23 October 2026
- arXiv abstract page for 2610.33355 · Original source · Abstract page as served on 2026-11-06
- How good is AI at molecular biology? (Benchling announcement) · Original source · Blog post dated 30 October 2026, as served on 2026-11-06
Technical metadata and record identifiers
Technical metadata for this record is tracked under stable ID benchbench-cloning-20261106-benchmark-suite.
Source locator: Abstract; Section 3; Table 1; Appendix A
Related records
- part of: BenchBench-Cloning construct-design set
- part of: BenchBench-Cloning protocol-development set
- subject: BenchBench-Cloning: announcement characterisation
- subject: BenchBench-Cloning: attempt budget
- subject: BenchBench-Cloning: attempts per task
- subject: BenchBench-Cloning: licence
- subject: BenchBench-Cloning: systems evaluated
- subject: BenchBench-Cloning: task count
- subject: BenchBench-Cloning: measurement scope
- assessment: Claude Mythos 5.1 at high effort on BenchBench-Cloning aggregate score
- assessment: Claude Mythos 5.1 at low effort on BenchBench-Cloning aggregate score
- assessment: Claude Mythos 5.1 at max effort on BenchBench-Cloning aggregate score
- assessment: Claude Opus 5.5 at high effort on BenchBench-Cloning aggregate score
- assessment: Claude Opus 5.5 at low effort on BenchBench-Cloning aggregate score
- assessment: Claude Opus 5.5 at max effort on BenchBench-Cloning aggregate score
- assessment: Gemini 3.8 Flash at high effort on BenchBench-Cloning aggregate score
- assessment: Gemini 3.8 Flash at low effort on BenchBench-Cloning aggregate score
- assessment: Gemini 3.8 Flash at medium effort on BenchBench-Cloning aggregate score
- assessment: Gemini 4 Argon at high effort on BenchBench-Cloning aggregate score
- assessment: Gemini 4 Argon at low effort on BenchBench-Cloning aggregate score
- assessment: Gemini 4 Argon at medium effort on BenchBench-Cloning aggregate score
- assessment: GPT-6.1 Sol at high effort on BenchBench-Cloning aggregate score
- assessment: GPT-6.1 Sol at low effort on BenchBench-Cloning aggregate score
- assessment: GPT-6.1 Sol at max effort on BenchBench-Cloning aggregate score
- assessment: GPT-6 Astra at high effort on BenchBench-Cloning aggregate score
- assessment: GPT-6 Astra at low effort on BenchBench-Cloning aggregate score
- assessment: GPT-6 Astra at max effort on BenchBench-Cloning aggregate score
- assessment: Grok 4.7 at high effort on BenchBench-Cloning aggregate score
- assessment: Grok 4.7 at low effort on BenchBench-Cloning aggregate score
- assessment: Grok 4.7 at xhigh effort on BenchBench-Cloning aggregate score
- assessment: Kimi K3 at high effort on BenchBench-Cloning aggregate score
- assessment: Kimi K3 at low effort on BenchBench-Cloning aggregate score
- assessment: Kimi K3 at medium effort on BenchBench-Cloning aggregate score
- part of: BenchBench-Cloning aggregate score over all 65 tasks