rewirebio.iobenchmarks
Configuration

GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effort

GPT-6.1 Sol driven by Codex CLI 0.156.1 at max reasoning effort in a Modal sandbox with two vCPUs and 6 GiB of memory, a two-hour attempt limit and network access restricted to the model provider.

22 evaluations · 22 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Model Capabilities & Hardware Requirements

Deployment facts recorded for GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effort. Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluated Checkpoint: gpt-6.1-sol in Codex CLI 0.156.1, max reasoning effort

Evaluations and results

22 evaluations · 22 results. Different protocols are not a single leaderboard.

Sorted by Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetCount (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)Count (protocol-development tasks solved at least once in ten attempts, out of 50; a coverage count under repeated sampling, not a single-attempt performance measure; top reasoning tier, the highest of this system's three settings)Count (protocol-development tasks solved in every one of ten attempts, out of 50; a coverage count under repeated sampling, not a single-attempt performance measure; top reasoning tier, the highest of this system's three settings)Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)Success rate (protocol-development pass rate at a single attempt (pass@1), simulator-graded and binary per attempt; top reasoning tier, the highest of this system's three settings)Success rate (protocol-development pass@10: probability that at least one of 10 attempts passes; best-of-k, never comparable with single-attempt pass rate; top reasoning tier, the highest of this system's three settings)Success rate (protocol-development pass@5: probability that at least one of 5 attempts passes; best-of-k, never comparable with single-attempt pass rate; top reasoning tier, the highest of this system's three settings)
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: GFP into EcoFlex vector, BenchBench-Cloning construct-design tasks with a rubric model judge (10)5/5 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Insulin two-chain constructs, BenchBench-Cloning construct-design tasks with a rubric model judge (10)5/5 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Minimal-edit recoding, BenchBench-Cloning construct-design tasks with a rubric model judge (10)5/5 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Detector choice from antibody data, BenchBench-Cloning construct-design tasks with a rubric model judge (10)4/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Insulin intermediate construct, BenchBench-Cloning construct-design tasks with a rubric model judge (10)4/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: AG/AP1 chimera plasmid, BenchBench-Cloning construct-design tasks with a rubric model judge (10)2/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Alkaloid-pathway GoldenBraid set, BenchBench-Cloning construct-design tasks with a rubric model judge (10)1/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Prime-assembly donor family, BenchBench-Cloning construct-design tasks with a rubric model judge (10)1/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Tus/TerB HEK293 constructs, BenchBench-Cloning construct-design tasks with a rubric model judge (10)1/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Synthetic-chromosome locus edit, BenchBench-Cloning construct-design tasks with a rubric model judge (10)0/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning, BenchBench-Cloning protocol-development tasks (50)Not reportedNot reportedNot reportedNot reported22.2%Not reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct-design set, BenchBench-Cloning construct-design tasks (15)Not reportedNot reportedNot reportedNot reportedNot reported41.3%Not reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning protocol-development set, BenchBench-Cloning protocol-development tasks (50)Not reportedNot reportedNot reportedNot reportedNot reportedNot reported16.4%Not reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning protocol-development set, BenchBench-Cloning protocol-development tasks (50)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported66%Not reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning protocol-development set, BenchBench-Cloning protocol-development tasks (50)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported48.3%
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning protocol-development set, BenchBench-Cloning protocol-development tasks (50)Not reportedNot reportedNot reported0Not reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning protocol-development set, BenchBench-Cloning protocol-development tasks (50)Not reportedNot reported33Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Dual-luciferase frame panel, BenchBench-Cloning construct-design tasks graded deterministically only (5)Not reported0/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Matched promoter panel, BenchBench-Cloning construct-design tasks graded deterministically only (5)Not reported0/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: MPRA construct rebuild, BenchBench-Cloning construct-design tasks graded deterministically only (5)Not reported1/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Reporter choice from data, BenchBench-Cloning construct-design tasks graded deterministically only (5)Not reported2/5 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortEvaluationBenchBench-Cloning construct design: Sodium-channel promoter repair, BenchBench-Cloning construct-design tasks graded deterministically only (5)Not reported0/5Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
All 22 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
22.2% Success rate (aggregate single-attempt score over all 65 tasks, task-weighted 50/65 protocol development and 15/65 construct design; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 16.3 to 28.5. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 575/575 attempts scored (500 protocol-development attempts plus 75 construct-design attempts; the weights are over tasks, 50/65 and 15/65.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at max effort on BenchBench-Cloning aggregate score

benchbench-cloning-20261106-protocol-aggregate-score

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Aggregate % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Aggregate %'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning construct-design set
Dataset subset: BenchBench-Cloning construct-design tasks (15)
41.3% Success rate (construct-design pass rate at a single attempt, pass at a final score of at least 0.9, deterministic grading on five tasks and deterministic multiplied by a GPT-6 Astra rubric score on ten; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 22.7 to 61.3. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 75/75 attempts scored (15 tasks x 5 attempts. The Table G2 per-task solve counts for this system sum to 31, and 31/75 reproduces the printed rate.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at max effort on BenchBench-Cloning construct-design pass rate

benchbench-cloning-20261106-protocol-construct-design-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Construct design % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Construct design %'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning protocol-development set
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
16.4% Success rate (protocol-development pass rate at a single attempt (pass@1), simulator-graded and binary per attempt; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 11.4 to 22.2. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: 500/500 attempts scored (Table E1 prints 500 graded attempts and 82 passed; Table E2 prints 500 recorded. The printed pass rate equals 82/500.)

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol at max effort on BenchBench-Cloning protocol-development pass rate

benchbench-cloning-20261106-protocol-protocol-development-pass-rate

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max', column 'Protocol dev. % [95% CI]'; the same cell is printed in Table 2, row 'GPT-6.1 Sol', column 'Protocol dev. %'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning protocol-development set
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
66% Success rate (protocol-development pass@10: probability that at least one of 10 attempts passes; best-of-k, never comparable with single-attempt pass rate; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 52.0 to 78.0. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning protocol development, pass@10

benchbench-cloning-20261106-protocol-protocol-development-pass-at-10

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G1, row 'GPT-6.1 Sol', column 'pass@10 % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning protocol-development set
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
48.3% Success rate (protocol-development pass@5: probability that at least one of 5 attempts passes; best-of-k, never comparable with single-attempt pass rate; top reasoning tier, the highest of this system's three settings)
percent · higher

Uncertainty: 95% CI 37.7 to 58.8. 95% confidence intervals from 20,000 bootstrap resamples of the tasks, retaining all attempts of each sampled task (Section 3.4).

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning protocol development, pass@5

benchbench-cloning-20261106-protocol-protocol-development-pass-at-5

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G1, row 'GPT-6.1 Sol', column 'pass@5 % [95% CI]'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning protocol-development set
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
0 Count (protocol-development tasks solved in every one of ten attempts, out of 50; a coverage count under repeated sampling, not a single-attempt performance measure; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G1 prints no interval for the solved-task counts.

Coverage: 50/50 tasks scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning protocol development, tasks solved in every one of ten attempts

benchbench-cloning-20261106-protocol-protocol-development-tasks-solved-every-attempt

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G1, row 'GPT-6.1 Sol', column 'Solved all'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortBenchmark: BenchBench-Cloning protocol-development set
Dataset subset: BenchBench-Cloning protocol-development tasks (50)
33 Count (protocol-development tasks solved at least once in ten attempts, out of 50; a coverage count under repeated sampling, not a single-attempt performance measure; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G1 prints no interval for the solved-task counts.

Coverage: 50/50 tasks scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning protocol development, tasks solved at least once in ten attempts

benchbench-cloning-20261106-protocol-protocol-development-tasks-solved-once

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G1, row 'GPT-6.1 Sol', column 'Solved >=1'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: AG/AP1 chimera plasmid
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
2/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: AG/AP1 chimera plasmid

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'AG/AP1 chimera plasmid', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Alkaloid-pathway GoldenBraid set
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
1/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Alkaloid-pathway GoldenBraid set

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Alkaloid-pathway GoldenBraid set', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Detector choice from antibody data
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
4/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Detector choice from antibody data

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Detector choice from antibody data', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Dual-luciferase frame panel
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
0/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Dual-luciferase frame panel

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Dual-luciferase frame panel', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: GFP into EcoFlex vector
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
5/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: GFP into EcoFlex vector

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'GFP into EcoFlex vector', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Insulin intermediate construct
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
4/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Insulin intermediate construct

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Insulin intermediate construct', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Insulin two-chain constructs
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
5/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Insulin two-chain constructs

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Insulin two-chain constructs', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Matched promoter panel
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
0/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Matched promoter panel

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Matched promoter panel', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Minimal-edit recoding
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
5/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Minimal-edit recoding

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Minimal-edit recoding', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: MPRA construct rebuild
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
1/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: MPRA construct rebuild

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'MPRA construct rebuild', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Prime-assembly donor family
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
1/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Prime-assembly donor family

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Prime-assembly donor family', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Reporter choice from data
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
2/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Reporter choice from data

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Reporter choice from data', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Sodium-channel promoter repair
Dataset subset: BenchBench-Cloning construct-design tasks graded deterministically only (5)
0/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic only, no model judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Sodium-channel promoter repair

benchbench-cloning-20261106-protocol-construct-design-per-task-deterministic

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Sodium-channel promoter repair', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Synthetic-chromosome locus edit
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
0/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Synthetic-chromosome locus edit

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Synthetic-chromosome locus edit', column 'GPT-6.1 Sol'
Configuration: GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effortTask: BenchBench-Cloning construct design: Tus/TerB HEK293 constructs
Dataset subset: BenchBench-Cloning construct-design tasks with a rubric model judge (10)
1/5 Count (construct-design attempts passed out of 5 on one task at top reasoning effort, pass at a final score of at least 0.9; grading deterministic multiplied by a GPT-6 Astra rubric score, so the outcome depends on the judge; top reasoning tier, the highest of this system's three settings)
count · higher

Uncertainty: Not reported by the source: Table G2 prints no interval for the per-task counts.

Coverage: 5/5 attempts scored

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-6.1 Sol on BenchBench-Cloning construct design: Tus/TerB HEK293 constructs

benchbench-cloning-20261106-protocol-construct-design-per-task-rubric-judged

Aggregation: Not reported

BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development (arXiv:2610.33355v1) · Table G2, row 'Tus/TerB HEK293 constructs', column 'GPT-6.1 Sol'

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID benchbench-cloning-20261106-config-gpt-6-1-sol-max.

Source locator: Section 3.3; Table B1, row 'GPT-6.1 Sol'; Table D2, row 'GPT-6.1 Sol' tier 'top' effort 'max'

Related records

How to cite

GPT-6.1 Sol in Codex CLI 0.156.1, max reasoning effort. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/benchbench-cloning-20261106-config-gpt-6-1-sol-max/

Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction