| Configuration: Badge acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.258 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBadge on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Badge', column 'All' under 'Scharen.' |
|---|
| Configuration: Badge acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.211 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBadge on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Badge', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3.5 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.326 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3.5 Sonnet on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3.5 Sonnet', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3.5 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.292 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3.5 Sonnet on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3.5 Sonnet', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Haiku (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.209 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Haiku on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Haiku', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Haiku (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.2 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Haiku on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Haiku', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Opus (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.247 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Opus on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Opus', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Opus (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.206 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Opus on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Opus', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.302 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Sonnet on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Sonnet', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude 3 Sonnet (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.265 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude 3 Sonnet on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude 3 Sonnet', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude v1 (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.292 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude v1 on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude v1', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), Claude v1 (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.222 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceClaude v1 on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Claude v1', column 'N/E' under 'Scharen.' |
|---|
| Configuration: Coreset acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.243 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCoreset on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Coreset', column 'All' under 'Scharen.' |
|---|
| Configuration: Coreset acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.197 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceCoreset on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Coreset', column 'N/E' under 'Scharen.' |
|---|
| Configuration: DiscoBAX (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.201 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDiscoBax on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'DiscoBax', column 'All' under 'Scharen.' |
|---|
| Configuration: DiscoBAX (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.2 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceDiscoBax on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'DiscoBax', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-3.5-Turbo (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.23 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-3.5-Turbo on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-3.5-Turbo', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-3.5-Turbo (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.188 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-3.5-Turbo on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-3.5-Turbo', column 'N/E' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-4o (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.311 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-4o on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-4o', column 'All' under 'Scharen.' |
|---|
| Configuration: BioDiscoveryAgent (No-Tools), GPT-4o (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.286 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceGPT-4o on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'GPT-4o', column 'N/E' under 'Scharen.' |
|---|
| Configuration: Human pathway-based selection (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.113 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceHuman on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Human', column 'All' under 'Scharen.' |
|---|
| Configuration: Human pathway-based selection (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.122 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceHuman on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'Human', column 'N/E' under 'Scharen.' |
|---|
| Configuration: K-Means (D) acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.281 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceK-Means (D) on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'K-Means (D)', column 'All' under 'Scharen.' |
|---|
| Configuration: K-Means (D) acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.24 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceK-Means (D) on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'K-Means (D)', column 'N/E' under 'Scharen.' |
|---|
| Configuration: K-Means (E) acquisition function on an MLP surrogate (Roohani et al. 2025) | Protocol: BioDiscoveryAgent 1-gene perturbation design: hit ratio after 5 rounds of 128 genes Dataset: Scharenberg et al. 2023 screen, lysosomal choline recycling in pancreatic cells | 0.17 recall fraction · higher Uncertainty: Not yet extracted: Appendix Table 7 prints one standard deviation over 10 runs for these values; not extracted in this pass. Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceK-Means (E) on Scharen. (Roohani et al. 2025) tgtval-20261009-protocol-roohani2025-hitratio-round5 Aggregation: Not reported BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments · Table 1, row 'K-Means (E)', column 'All' under 'Scharen.' |
|---|