| Comparison: adaptation No training; embeddings scored directly Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.adaptation Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: aggregation Mean and standard deviation over the five sequenced strains Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.aggregation Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: budget Under 5 minutes for all models on one NVIDIA H100 with 96 GB of memory and 72 CPU cores, excluding the cost of embedding the genomes Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.budget Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: dataset version As described in version 3 of the preprint and published on Hugging Face Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.dataset_version Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: inputs Mixed modality (DNA and protein sequence). Mixed-modality scaffolds up to 4,096 tokens with coding regions as amino acids and intergenic regions as nucleotides, last-layer hidden states mean-pooled, gene tasks masked to the gene's own tokens Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.inputs Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: metric implementation zero-shot operon boundary prediction scored by embedding cosine similarity times a same-strand indicator, mean over the five sequenced strains Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.metric_implementation Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: population Staphylococcus aureus RN450 (GCF_000013425.1), Mycobacterium tuberculosis H37Rv 102J23 leuD panCD deletion strain (GCF_000195955.2), Mycobacterium abscessus ATCC 19977 (GCF_000069185.1), Pseudomonas aeruginosa PAO1 (GCF_000006765.1) and Escherichia coli DH5a (GCF_002899475.1) Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.population Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: protocol id bacformer-20261115-protocol-operon-zero-shot-auprc Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.protocol_id Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
| Comparison: split No split; the whole dataset is the test set, because the evaluation is zero-shot. Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.split Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|
Limitations2 values- Reported by the authors of Bacformer, who also built BacBench and ran every benchmarked model on it.
- Not reproduced by Rewire; the exact splits, seeds and BacBench commit behind the runs are not published.
Context-only references | Bacformer preprint, bioRxiv 2025.07.20.665723 version 3 Original source ↗ Table S1, row 'gLM2', column 'AUPRC' Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19 Retrieved: 2026-11-15T22:55:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.limitations Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from. |
|---|