rewirebio.iobenchmarks
Benchmark

BenchBench-Cloning construct-design set

The 15 BenchBench-Cloning tasks in which an agent is given a scientific objective with sequence records and supporting materials and must return the constructs the objective calls for, their annotated sequences and a construction plan.

24 evaluations · 24 results15 tasks with further results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

24 recorded evaluations, 24 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

24 evaluations · 24 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
24% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 8.0 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'mid' effort 'high', column 'Construct design % [95% CI]'
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
16% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 4.0 to 29.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, max reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
17.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 5.3 to 30.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 13, and 13/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 at max effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Claude Mythos 5.1', column 'Construct design %'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
34.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 17.3 to 53.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'mid' effort 'high', column 'Construct design % [95% CI]'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
29.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 13.3 to 46.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, max reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
25.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 9.3 to 44.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 19, and 19/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 at max effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Claude Opus 5.5', column 'Construct design %'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
24% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 8.0 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 18, and 18/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'top' effort 'high', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 3.8 Flash', column 'Construct design %'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 5.3 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, medium reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 5.3 to 42.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash at medium effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'mid' effort 'medium', column 'Construct design % [95% CI]'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
30.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 10.7 to 52.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 23, and 23/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'top' effort 'high', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 4 Argon', column 'Construct design %'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
31.9% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 10.7 to 52.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, medium reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
33.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 13.3 to 54.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon at medium effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'mid' effort 'medium', column 'Construct design % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
37.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 20.0 to 56.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'mid' effort 'high', column 'Construct design % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 9.3 to 38.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
41.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 22.7 to 61.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 31, and 31/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at max effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Construct design %'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
44% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 22.7 to 66.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'mid' effort 'high', column 'Construct design % [95% CI]'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
28% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 13.3 to 45.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
42.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 22.7 to 64.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 32, and 32/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra at max effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6 Astra', column 'Construct design %'
Configuration: Grok 4.7 in Grok Build 1.0.46, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
22.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 6.7 to 41.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'mid' effort 'high', column 'Construct design % [95% CI]'
Configuration: Grok 4.7 in Grok Build 1.0.46, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
10.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 2.7 to 21.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: Grok 4.7 in Grok Build 1.0.46, xhigh reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
26.7% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 9.3 to 46.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 20, and 20/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 at xhigh effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'top' effort 'xhigh', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Grok 4.7', column 'Construct design %'
Configuration: Kimi K3 in Pi 1.0.3, high reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
20% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 6.7 to 36.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 15, and 15/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 at high effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'top' effort 'high', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'Kimi K3', column 'Construct design %'
Configuration: Kimi K3 in Pi 1.0.3, low reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
16% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 2.7 to 33.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 at low effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'low' effort 'low', column 'Construct design % [95% CI]'
Configuration: Kimi K3 in Pi 1.0.3, medium reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
29.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 12.0 to 48.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts.)

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 at medium effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'mid' effort 'medium', column 'Construct design % [95% CI]'

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Further results on linked records

15 linked records have results that are not included above, because no reviewed claim yet ties the link to this benchmark. Each record keeps its own settings and evaluations, and its scores are on its own page.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Explore all linked results

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 6 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

Baseline status by linked protocol

Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)

Coverage is derived from release 2026-11-21-adc15377fab2. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run instructions

No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID benchbench-cloning-20261106-benchmark-construct-design.

Source locator: Section 3.2; Appendix A, Table A1

Related records

Suggest a correction