BenchBench-Cloning construct-design set
The 15 BenchBench-Cloning tasks in which an agent is given a scientific objective with sequence records and supporting materials and must return the constructs the objective calls for, their annotated sequences and a construction plan.
Overview
An explanatory profile has not yet been reviewed for this record.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
24 recorded evaluations, 24 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.
Results
Results are available, but no reviewed comparison panel is linked in this release.
All evaluations
24 evaluations · 24 results. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 24% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 8.0 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Mythos 5.1 at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'mid' effort 'high', column 'Construct design % [95% CI]' |
| Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 16% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 4.0 to 29.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Mythos 5.1 at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, max reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 17.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 5.3 to 30.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 13, and 13/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Mythos 5.1 at max effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Claude Mythos 5.1', column 'Construct design %' |
| Configuration: Claude Opus 5.5 in Claude Code 2.1.289, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 34.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 17.3 to 53.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Opus 5.5 at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'mid' effort 'high', column 'Construct design % [95% CI]' |
| Configuration: Claude Opus 5.5 in Claude Code 2.1.289, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 29.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 13.3 to 46.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Opus 5.5 at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: Claude Opus 5.5 in Claude Code 2.1.289, max reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 25.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 9.3 to 44.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 19, and 19/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude Opus 5.5 at max effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Claude Opus 5.5', column 'Construct design %' |
| Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 24% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 8.0 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 18, and 18/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 3.8 Flash at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'top' effort 'high', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 3.8 Flash', column 'Construct design %' |
| Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 5.3 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 3.8 Flash at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, medium reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 5.3 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 3.8 Flash at medium effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'mid' effort 'medium', column 'Construct design % [95% CI]' |
| Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 30.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 10.7 to 52.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 23, and 23/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 4 Argon at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'top' effort 'high', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 4 Argon', column 'Construct design %' |
| Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 31.9% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 10.7 to 52.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 4 Argon at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, medium reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 33.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 13.3 to 54.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGemini 4 Argon at medium effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'mid' effort 'medium', column 'Construct design % [95% CI]' |
| Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 37.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 20.0 to 56.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6.1 Sol at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'mid' effort 'high', column 'Construct design % [95% CI]' |
| Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 9.3 to 38.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6.1 Sol at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 41.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 22.7 to 61.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 31, and 31/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6.1 Sol at max effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Construct design %' |
| Configuration: GPT-6 Astra in Codex CLI 0.156.1, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 44% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 22.7 to 66.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6 Astra at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'mid' effort 'high', column 'Construct design % [95% CI]' |
| Configuration: GPT-6 Astra in Codex CLI 0.156.1, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 28% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 13.3 to 45.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6 Astra at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: GPT-6 Astra in Codex CLI 0.156.1, max reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 42.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 22.7 to 64.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 32, and 32/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-6 Astra at max effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6 Astra', column 'Construct design %' |
| Configuration: Grok 4.7 in Grok Build 1.0.46, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 6.7 to 41.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGrok 4.7 at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'mid' effort 'high', column 'Construct design % [95% CI]' |
| Configuration: Grok 4.7 in Grok Build 1.0.46, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 10.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 2.7 to 21.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGrok 4.7 at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: Grok 4.7 in Grok Build 1.0.46, xhigh reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 26.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 9.3 to 46.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 20, and 20/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceGrok 4.7 at xhigh effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'top' effort 'xhigh', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Grok 4.7', column 'Construct design %' |
| Configuration: Kimi K3 in Pi 1.0.3, high reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 20% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings) percent · higher Uncertainty: 95% CI 6.7 to 36.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 15, and 15/75 reproduces the printed rate.) | Author-reported evaluation · Source checkedMethods, coverage and sourceKimi K3 at high effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'top' effort 'high', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Kimi K3', column 'Construct design %' |
| Configuration: Kimi K3 in Pi 1.0.3, low reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 16% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings) percent · higher Uncertainty: 95% CI 2.7 to 33.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceKimi K3 at low effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'low' effort 'low', column 'Construct design % [95% CI]' |
| Configuration: Kimi K3 in Pi 1.0.3, medium reasoning effort | Benchmark: BenchBench-Cloning construct-design set Dataset subset: BenchBench-Cloning construct-design tasks (15) | 29.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings) percent · higher Uncertainty: 95% CI 12.0 to 48.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4). Coverage: 75/75 attempts scored (15 tasks x 5 attempts.) | Author-reported evaluation · Source checkedMethods, coverage and sourceKimi K3 at medium effort on BenchBench-Cloning construct-design pass rate benchbench-cloning-20261106-protocol-construct-design-pass-rate Aggregation: Not reported BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'mid' effort 'medium', column 'Construct design % [95% CI]' |
Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.
Further results on linked records
15 linked records have results that are not included above, because no reviewed claim yet ties the link to this benchmark. Each record keeps its own settings and evaluations, and its scores are on its own page.
- BenchBench-Cloning construct design: AG/AP1 chimera plasmid Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Alkaloid-pathway GoldenBraid set Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Detector choice from antibody data Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Dual-luciferase frame panel Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: GFP into EcoFlex vector Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Insulin intermediate construct Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Insulin two-chain constructs Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Matched promoter panel Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Minimal-edit recoding Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: MPRA construct rebuild Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Prime-assembly donor family Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Reporter choice from data Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Sodium-channel promoter repair Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Synthetic-chromosome locus edit Task · part of this benchmark · 8 evaluations · 8 results
- BenchBench-Cloning construct design: Tus/TerB HEK293 constructs Task · part of this benchmark · 8 evaluations · 8 results
Methods and evaluation design
Procedure, tasks and evaluated configurations
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- Claude Mythos 5.1 at high effort on BenchBench-Cloning construct-design pass rate
- Claude Mythos 5.1 at low effort on BenchBench-Cloning construct-design pass rate
- Claude Mythos 5.1 at max effort on BenchBench-Cloning construct-design pass rate
- Claude Opus 5.5 at high effort on BenchBench-Cloning construct-design pass rate
- Claude Opus 5.5 at low effort on BenchBench-Cloning construct-design pass rate
- Claude Opus 5.5 at max effort on BenchBench-Cloning construct-design pass rate
- Gemini 3.8 Flash at high effort on BenchBench-Cloning construct-design pass rate
- Gemini 3.8 Flash at low effort on BenchBench-Cloning construct-design pass rate
- Gemini 3.8 Flash at medium effort on BenchBench-Cloning construct-design pass rate
- Gemini 4 Argon at high effort on BenchBench-Cloning construct-design pass rate
- Gemini 4 Argon at low effort on BenchBench-Cloning construct-design pass rate
- Gemini 4 Argon at medium effort on BenchBench-Cloning construct-design pass rate
Baseline coverage
Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.
0 of 6 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.
Baseline status by linked protocol
- BenchBench-Cloning construct design: single-attempt pass rate over 15 tasks · 0/2 roles measured
- BenchBench-Cloning construct design, per task: attempts passed out of 5, deterministic grading only · 0/2 roles measured
- BenchBench-Cloning construct design, per task: attempts passed out of 5, deterministic grading with a rubric model judge · 0/2 roles measured
Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)
Coverage is derived from release 2026-11-21-adc15377fab2. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.
Run instructions
No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
0 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|
No evidence rows match these filters. Choose another scope or clear the search.
Sources and history
Release 2026-11-21-adc15377fab2 · Record review: source checked
1 source record and release history
- BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Original source · arXiv v1, dated 23 October 2026
Technical metadata and record identifiers
Technical metadata for this record is tracked under stable ID benchbench-cloning-20261106-benchmark-construct-design.
Source locator: Section 3.2; Appendix A, Table A1
Related records
- part of: BenchBench-Cloning
- uses data: BenchBench-Cloning construct-design tasks (15)
- subject: BenchBench-Cloning: model graded task count
- subject: BenchBench-Cloning: tasks supplying experimental records
- subject: BenchBench-Cloning: pass threshold
- subject: BenchBench-Cloning: task count
- used in: BenchBench-Cloning construct-design tasks graded deterministically only (5)
- used in: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
- used in: BenchBench-Cloning construct-design tasks (15)
- assessment: Claude Mythos 5.1 at high effort on BenchBench-Cloning construct-design pass rate
- assessment: Claude Mythos 5.1 at low effort on BenchBench-Cloning construct-design pass rate
- assessment: Claude Mythos 5.1 at max effort on BenchBench-Cloning construct-design pass rate
- assessment: Claude Opus 5.5 at high effort on BenchBench-Cloning construct-design pass rate
- assessment: Claude Opus 5.5 at low effort on BenchBench-Cloning construct-design pass rate
- assessment: Claude Opus 5.5 at max effort on BenchBench-Cloning construct-design pass rate
- assessment: Gemini 3.8 Flash at high effort on BenchBench-Cloning construct-design pass rate
- assessment: Gemini 3.8 Flash at low effort on BenchBench-Cloning construct-design pass rate
- assessment: Gemini 3.8 Flash at medium effort on BenchBench-Cloning construct-design pass rate
- assessment: Gemini 4 Argon at high effort on BenchBench-Cloning construct-design pass rate
- assessment: Gemini 4 Argon at low effort on BenchBench-Cloning construct-design pass rate
- assessment: Gemini 4 Argon at medium effort on BenchBench-Cloning construct-design pass rate
- assessment: GPT-6.1 Sol at high effort on BenchBench-Cloning construct-design pass rate
- assessment: GPT-6.1 Sol at low effort on BenchBench-Cloning construct-design pass rate
- assessment: GPT-6.1 Sol at max effort on BenchBench-Cloning construct-design pass rate
- assessment: GPT-6 Astra at high effort on BenchBench-Cloning construct-design pass rate
- assessment: GPT-6 Astra at low effort on BenchBench-Cloning construct-design pass rate
- assessment: GPT-6 Astra at max effort on BenchBench-Cloning construct-design pass rate
- assessment: Grok 4.7 at high effort on BenchBench-Cloning construct-design pass rate
- assessment: Grok 4.7 at low effort on BenchBench-Cloning construct-design pass rate
- assessment: Grok 4.7 at xhigh effort on BenchBench-Cloning construct-design pass rate
- assessment: Kimi K3 at high effort on BenchBench-Cloning construct-design pass rate
- assessment: Kimi K3 at low effort on BenchBench-Cloning construct-design pass rate
- assessment: Kimi K3 at medium effort on BenchBench-Cloning construct-design pass rate
- part of: BenchBench-Cloning agreement judge (Claude Mythos 5.1)
- part of: BenchBench-Cloning construct-design deterministic graders
- part of: BenchBench-Cloning rubric judge (GPT-6 Astra)
- part of: BenchBench-Cloning construct design: single-attempt pass rate over 15 tasks
- part of: BenchBench-Cloning construct design, per task: attempts passed out of 5, deterministic grading only
- part of: BenchBench-Cloning construct design, per task: attempts passed out of 5, deterministic grading with a rubric model judge
- part of: BenchBench-Cloning construct design: AG/AP1 chimera plasmid
- part of: BenchBench-Cloning construct design: Alkaloid-pathway GoldenBraid set
- part of: BenchBench-Cloning construct design: Detector choice from antibody data
- part of: BenchBench-Cloning construct design: Dual-luciferase frame panel
- part of: BenchBench-Cloning construct design: GFP into EcoFlex vector
- part of: BenchBench-Cloning construct design: Insulin intermediate construct
- part of: BenchBench-Cloning construct design: Insulin two-chain constructs
- part of: BenchBench-Cloning construct design: Matched promoter panel
- part of: BenchBench-Cloning construct design: Minimal-edit recoding
- part of: BenchBench-Cloning construct design: MPRA construct rebuild
- part of: BenchBench-Cloning construct design: Prime-assembly donor family
- part of: BenchBench-Cloning construct design: Reporter choice from data
- part of: BenchBench-Cloning construct design: Sodium-channel promoter repair
- part of: BenchBench-Cloning construct design: Synthetic-chromosome locus edit
- part of: BenchBench-Cloning construct design: Tus/TerB HEK293 constructs