| Configuration: Badge acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.042 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBadge on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Badge', column 'All' under 'CAR-T' |
|---|
| Configuration: Badge acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.038 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBadge on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Badge', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3.5 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.13 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3.5 Sonnet on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3.5 Sonnet', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3.5 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.133 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3.5 Sonnet on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3.5 Sonnet', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Haiku (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.116 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Haiku on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Haiku', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Haiku (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.119 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Haiku on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Haiku', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Opus (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.126 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Opus on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Opus', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Opus (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.129 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Opus on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Opus', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.115 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Sonnet on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Sonnet', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.118 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Sonnet on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Sonnet', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude v1 (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.11 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude v1 on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude v1', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude v1 (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.126 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude v1 on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude v1', column 'N/E' under 'CAR-T' |
|---|
| Configuration: Coreset acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.069 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCoreset on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Coreset', column 'All' under 'CAR-T' |
|---|
| Configuration: Coreset acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.059 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCoreset on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Coreset', column 'N/E' under 'CAR-T' |
|---|
| Configuration: DiscoBAX (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.047 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDiscoBax on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'DiscoBax', column 'All' under 'CAR-T' |
|---|
| Configuration: DiscoBAX (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.021 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDiscoBax on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'DiscoBax', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-3.5-Turbo (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.064 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-3.5-Turbo on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-3.5-Turbo', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-3.5-Turbo (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.066 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-3.5-Turbo on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-3.5-Turbo', column 'N/E' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-4o (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.116 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-4o on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-4o', column 'All' under 'CAR-T' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-4o (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.12 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-4o on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-4o', column 'N/E' under 'CAR-T' |
|---|
| Configuration: Human pathway-based selection (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.033 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceHuman on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Human', column 'All' under 'CAR-T' |
|---|
| Configuration: Human pathway-based selection (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.034 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceHuman on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Human', column 'N/E' under 'CAR-T' |
|---|
| Configuration: K-Means (D) acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.025 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceK-Means (D) on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'K-Means (D)', column 'All' under 'CAR-T' |
|---|
| Configuration: K-Means (D) acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.021 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceK-Means (D) on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'K-Means (D)', column 'N/E' under 'CAR-T' |
|---|
| Configuration: K-Means (E) acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: CAR-T proliferation screen (unpublished dataset used by Roohani et al. 2025) | 0.028 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceK-Means (E) on CAR-T (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'K-Means (E)', column 'All' under 'CAR-T' |
|---|