| Configuration: BDA, llama-3-1-8b backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 43.6 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBDA (Llama-3.1-8B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Llama-3.1-8B backbone' block, row 'BDA', column 'Sanchez Down' |
|---|
| Configuration: BDA, qwen-2-7b backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 26 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBDA (Qwen-2-7B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Qwen-2-7B backbone' block, row 'BDA', column 'Sanchez Down' |
|---|
| Configuration: BDA-Rand, claude-3-5-sonnet backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 57.6 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBDA-Rand (Claude 3.5 Sonnet backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Claude 3.5 Sonnet backbone' block, row 'BDA-Rand', column 'Sanchez Down' |
|---|
| Configuration: BDA-Rand, llama-3-1-8b backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 45 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBDA-Rand (Llama-3.1-8B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Llama-3.1-8B backbone' block, row 'BDA-Rand', column 'Sanchez Down' |
|---|
| Configuration: BDA-Rand, qwen-2-7b backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 35.4 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBDA-Rand (Qwen-2-7B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Qwen-2-7B backbone' block, row 'BDA-Rand', column 'Sanchez Down' |
|---|
| Configuration: BDA (Replicated), claude-3-5-sonnet backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 51.8 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceBDA (Replicated) (Claude 3.5 Sonnet backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Claude 3.5 Sonnet backbone' block, row 'BDA (Replicated)', column 'Sanchez Down' |
|---|
| Configuration: BDA (Reported Numbers), claude-3-5-sonnet backbone (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | N/A true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Result quoted from another source · Source checkedMethods, coverage and sourceBDA (Reported Numbers) (Claude 3.5 Sonnet backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 1, 'Claude 3.5 Sonnet backbone' block, row 'BDA (Reported Numbers)', column 'Sanchez Down' |
|---|
| Configuration: GP over llama-3-1-8b embeddings (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 30 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGP (Llama-3.1-8B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 2, 'Llama-3.1-8B backbone' block, row 'GP', column 'Sanchez Down' |
|---|
| Configuration: GP over qwen-2-7b embeddings (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 30 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceGP (Qwen-2-7B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 2, 'Qwen-2-7B backbone' block, row 'GP', column 'Sanchez Down' |
|---|
| Configuration: Linear UCB over llama-3-1-8b embeddings (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 42 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceLinear UCB (Llama-3.1-8B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 2, 'Llama-3.1-8B backbone' block, row 'Linear UCB', column 'Sanchez Down' |
|---|
| Configuration: Linear UCB over qwen-2-7b embeddings (Gupta et al. 2025) | Protocol: Independent replication of 1-gene perturbation design: cumulative hits after 5 rounds of 128 genes Dataset: Sanchez et al. 2021 screen, decreased endogenous tau protein level in neurons | 41 true-positive-count count · higher Uncertainty: Not reported by the source Coverage: Not reported scored / Not reported eligible | Independent external evaluation · Source checkedMethods, coverage and sourceLinear UCB (Qwen-2-7B backbone) on Sanchez Down (Gupta et al. 2025) tgtval-20261009-protocol-gupta2025-cumulative-hits-round5 Aggregation: Not reported LLMs for Bayesian Optimization in Scientific Domains: Are We There Yet? · Table 2, 'Qwen-2-7B backbone' block, row 'Linear UCB', column 'Sanchez Down' |
|---|