rewirebio.iobenchmarks
Benchmark

BenchBench-Cloning

Benchmark of 65 molecular cloning tasks that scores whether a language-model agent can work out which constructs a scientific objective needs and plan an executable construction route to them from supplied starting materials.

24 evaluations · 24 results2 benchmarks with further results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

24 recorded evaluations, 24 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

24 evaluations · 24 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
15.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 9.8 to 21.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'mid' effort 'high', column 'Aggregate % [95% CI]'
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
10.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 6.3 to 15.4. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, max reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
16% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 10.5 to 22.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 at max effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Mythos 5.1' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Claude Mythos 5.1', column 'Aggregate %'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
20% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 14.2 to 26.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'mid' effort 'high', column 'Aggregate % [95% CI]'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
12.3% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 7.7 to 17.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, max reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
20.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 13.7 to 27.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 at max effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Claude Opus 5.5' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Claude Opus 5.5', column 'Aggregate %'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
8.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 4.0 to 14.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'top' effort 'high', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 3.8 Flash', column 'Aggregate %'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
10.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 5.7 to 16.6. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, medium reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
9.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 4.5 to 14.6. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash at medium effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 3.8 Flash' tier 'mid' effort 'medium', column 'Aggregate % [95% CI]'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
18.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 11.5 to 26.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'top' effort 'high', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Gemini 4 Argon', column 'Aggregate %'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
15.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 10.4 to 21.7. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, medium reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
18.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 12.3 to 25.4. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon at medium effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Gemini 4 Argon' tier 'mid' effort 'medium', column 'Aggregate % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
21.7% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 15.7 to 28.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'mid' effort 'high', column 'Aggregate % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
17.1% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 11.2 to 23.5. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
22.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 16.3 to 28.5. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at max effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Aggregate %'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
26.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 19.4 to 34.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'mid' effort 'high', column 'Aggregate % [95% CI]'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
19.4% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 13.2 to 26.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
30.6% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 23.2 to 38.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra at max effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6 Astra' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6 Astra', column 'Aggregate %'
Configuration: Grok 4.7 in Grok Build 1.0.46, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
8.3% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 4.3 to 12.9. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'mid' effort 'high', column 'Aggregate % [95% CI]'
Configuration: Grok 4.7 in Grok Build 1.0.46, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
3.5% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 1.4 to 6.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: Grok 4.7 in Grok Build 1.0.46, xhigh reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
10.9% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 6.3 to 16.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 at xhigh effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Grok 4.7' tier 'top' effort 'xhigh', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Grok 4.7', column 'Aggregate %'
Configuration: Kimi K3 in Pi 1.0.3, high reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
8.8% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 4.9 to 13.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 at high effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'top' effort 'high', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'Kimi K3', column 'Aggregate %'
Configuration: Kimi K3 in Pi 1.0.3, low reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
6.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; low reasoning tier, the lowest of this system's three settings)
percent · higher

Uncertainty: 95% CI 2.5 to 10.6. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 at low effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'low' effort 'low', column 'Aggregate % [95% CI]'
Configuration: Kimi K3 in Pi 1.0.3, medium reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
11.1% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; mid reasoning tier, the middle of this system's three settings)
percent · higher

Uncertainty: 95% CI 6.6 to 15.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 at medium effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'Kimi K3' tier 'mid' effort 'medium', column 'Aggregate % [95% CI]'

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Further results on linked records

2 linked records have results that are not included above, because no reviewed claim yet ties the link to this benchmark. Each record keeps its own settings and evaluations, and its scores are on its own page.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Explore all linked results

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

Baseline status by linked protocol

Protocol coverage CSV (gzip) · Model evaluation matrix (gzip) · Source table (gzip) · Release and checksums (gzip)

Coverage is derived from release 2026-11-21-adc15377fab2. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run instructions

No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

3 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID benchbench-cloning-20261106-benchmark-suite.

Source locator: Abstract; Section 3; Table 1; Appendix A

Related records

Suggest a correction