rewirebio.iobenchmarks
Task

BenchBench-Cloning construct design: Reporter choice from data

Construct-design task 5 of BenchBench-Cloning, in which an agent must design the constructs a scientific objective calls for, built on Ghodke et al. 2016, Biophys..

8 evaluations · 8 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

8 recorded evaluations, 8 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

8 evaluations · 8 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Claude Mythos 5.1 in Claude Code 2.1.289, max reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
3/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Mythos 5.1 on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'Claude Mythos 5.1'
Configuration: Claude Opus 5.5 in Claude Code 2.1.289, max reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
5/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

Claude Opus 5.5 on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'Claude Opus 5.5'
Configuration: Gemini 3.8 Flash in Gemini CLI 0.63.0, high reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
5/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 3.8 Flash on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'Gemini 3.8 Flash'
Configuration: Gemini 4 Argon in Gemini CLI 0.63.0, high reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
0/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

Gemini 4 Argon on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'Gemini 4 Argon'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
2/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'GPT-6.1 Sol'
Configuration: GPT-6 Astra in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
3/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6 Astra on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'GPT-6 Astra'
Configuration: Grok 4.7 in Grok Build 1.0.46, xhigh reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
0/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

Grok 4.7 on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'Grok 4.7'
Configuration: Kimi K3 in Pi 1.0.3, high reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
3/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

Kimi K3 on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'Kimi K3'

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID benchbench-cloning-20261106-task-reporter-choice-from-data.

Source locator: Table A1, row 5 'Reporter choice from data'; Table G2, row 'Reporter choice from data'

Related records

Suggest a correction