| Configuration: Bacformer Large (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 50.84 ± 10.34 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 10.34 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer Large on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer Large', column 'Finetuned AUPRC' |
|---|
| Configuration: Bacformer Large (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 78.35 ± 2.40 AUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 2.40 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer Large on BacBench protein-protein interaction, linear probe AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer Large', column 'Finetuned AUROC' |
|---|
| Configuration: Bacformer Large (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 37.51 ± 15.20 AUPRC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 15.20 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer Large on BacBench protein-protein interaction, zero-shot AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer Large', column 'Zero-shot AUPRC' |
|---|
| Configuration: Bacformer Large (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 72.09 ± 6.44 AUROC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 6.44 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer Large on BacBench protein-protein interaction, zero-shot AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer Large', column 'Zero-shot AUROC' |
|---|
| Configuration: Bacformer (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 45.73 ± 9.29 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 9.29 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer', column 'Finetuned AUPRC' |
|---|
| Configuration: Bacformer (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 73.79 ± 4.69 AUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 4.69 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer on BacBench protein-protein interaction, linear probe AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer', column 'Finetuned AUROC' |
|---|
| Configuration: Bacformer (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 31.43 ± 12.61 AUPRC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 12.61 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer on BacBench protein-protein interaction, zero-shot AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer', column 'Zero-shot AUPRC' |
|---|
| Configuration: Bacformer (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 64.93 ± 4.96 AUROC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 4.96 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceBacformer on BacBench protein-protein interaction, zero-shot AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Bacformer', column 'Zero-shot AUROC' |
|---|
| Configuration: DNABERT-2 (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 28.30 ± 9.55 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 9.55 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'DNABERT-2', column 'Finetuned AUPRC' |
|---|
| Configuration: DNABERT-2 (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 61.64 ± 3.58 AUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 3.58 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on BacBench protein-protein interaction, linear probe AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'DNABERT-2', column 'Finetuned AUROC' |
|---|
| Configuration: DNABERT-2 (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 18.76 ± 8.84 AUPRC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 8.84 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on BacBench protein-protein interaction, zero-shot AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'DNABERT-2', column 'Zero-shot AUPRC' |
|---|
| Configuration: DNABERT-2 (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 53.25 ± 4.93 AUROC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 4.93 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceDNABERT-2 on BacBench protein-protein interaction, zero-shot AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'DNABERT-2', column 'Zero-shot AUROC' |
|---|
| Configuration: ESM-2 (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 44.24 ± 8.64 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 8.64 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-2 on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-2', column 'Finetuned AUPRC' |
|---|
| Configuration: ESM-2 (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 72.83 ± 4.53 AUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 4.53 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-2 on BacBench protein-protein interaction, linear probe AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-2', column 'Finetuned AUROC' |
|---|
| Configuration: ESM-2 (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 22.08 ± 9.15 AUPRC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 9.15 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-2 on BacBench protein-protein interaction, zero-shot AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-2', column 'Zero-shot AUPRC' |
|---|
| Configuration: ESM-2 (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 56.94 ± 2.44 AUROC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 2.44 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-2 on BacBench protein-protein interaction, zero-shot AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-2', column 'Zero-shot AUROC' |
|---|
| Configuration: ESM-C (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 44.75 ± 9.08 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 9.08 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-C on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-C', column 'Finetuned AUPRC' |
|---|
| Configuration: ESM-C (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 73.20 ± 4.29 AUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 4.29 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-C on BacBench protein-protein interaction, linear probe AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-C', column 'Finetuned AUROC' |
|---|
| Configuration: ESM-C (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 20.81 ± 9.24 AUPRC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 9.24 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-C on BacBench protein-protein interaction, zero-shot AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-C', column 'Zero-shot AUPRC' |
|---|
| Configuration: ESM-C (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 57.44 ± 3.13 AUROC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 3.13 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceESM-C on BacBench protein-protein interaction, zero-shot AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'ESM-C', column 'Zero-shot AUROC' |
|---|
| Configuration: Evo-2 (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 15.98 ± 7.37 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 7.37 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEvo-2 on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Evo-2', column 'Finetuned AUPRC' |
|---|
| Configuration: Evo-2 (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 50.00 ± 0.00 AUROC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 0.00 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEvo-2 on BacBench protein-protein interaction, linear probe AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Evo-2', column 'Finetuned AUROC' |
|---|
| Configuration: Evo-2 (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 17.80 ± 9.10 AUPRC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 9.10 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEvo-2 on BacBench protein-protein interaction, zero-shot AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Evo-2', column 'Zero-shot AUPRC' |
|---|
| Configuration: Evo-2 (frozen embeddings, no trained head) | Protocol: BacBench protein-protein interaction, zero-shot AUROC Dataset: BacBench protein-protein interaction dataset from STRING DB | 51.52 ± 3.16 AUROC (zero-shot pair scoring by embedding cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 3.16 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEvo-2 on BacBench protein-protein interaction, zero-shot AUROC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Evo-2', column 'Zero-shot AUROC' |
|---|
| Configuration: Evo (frozen embeddings with a trained linear head) | Protocol: BacBench protein-protein interaction, linear probe AUPRC Dataset: BacBench protein-protein interaction dataset from STRING DB | 20.93 ± 8.80 AUPRC (linear head on frozen pair embeddings plus their cosine similarity, genus-level split, mean over held-out test genomes) unitless · higher Uncertainty: SD 8.80 Coverage: Not reported scored / Not reported eligible | Author-reported evaluation · Source checkedMethods, coverage and sourceEvo on BacBench protein-protein interaction, linear probe AUPRC Zero-shot columns score each protein pair by the cosine similarity of the two embeddings. The finetuned columns train a single linear layer, preceded by layer normalisation and dropout of 0.2, on the average of the two frozen protein embeddings together with their cosine similarity, so the input is of dimension D plus one; binary cross-entropy loss, Adam with weight decay 0.01, at most 20 epochs with early stopping patience 5 on AUROC, and a learning-rate sweep per model. Metrics are computed per genome on the test split. Aggregation: Not reported Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 · Table S13, row 'Evo', column 'Finetuned AUPRC' |
|---|