rewirebio.iobenchmarks
Source

Bacformer repository README at commit 61dca95

Commit 61dca9537429b95365d73d72a3e11c207df1ed6c · Project source

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Claims

Statements this source supports, each with where in the source it was checked.

  • Bacformer base parameter count printed in the repository README: Parameter count 26M (Bacformer README, 'Requirements': 'Bacformer (26M parameters) uses ESM-2 (esm2_t12_35M_UR50D)')
  • Bacformer Large embedding bug fixed on 2025-05-15: Known issue A bug in the Bacformer Large code on Hugging Face, announced on 2025-05-15, significantly degraded the output embeddings; the README says it is fixed and that anyone who downloaded or cached the model before that date must re-download the latest revision before running evaluations (Bacformer README 'News', entry dated 2025-05-15)
  • Bacformer Large parameter count printed in the repository README: Parameter count 300M (Bacformer README, 'News' entry of 2025-01-20 and 'Requirements': 'Bacformer Large (300M parameters) uses ESM-C')
  • Base protein language model of Bacformer: Base protein language model ESM-2 t12 35M (facebook/esm2_t12_35M_UR50D), whose 480-dimensional mean-pooled per-protein embeddings are the input tokens (Bacformer README 'Requirements'; model card 'Architecture'; preprint Table S9 and Methods 'Bacformer')
  • Base protein language model of Bacformer Large, as the README names it: Base protein language model ESM-C through the ESM++ reimplementation Synthyra/ESMplusplus_small, which the README calls a faithful implementation of ESM-C (Bacformer README 'Requirements': 'Bacformer Large (300M parameters) uses ESM-C (Synthyra/ESMplusplus_small)' and the note that follows it)
  • Checkpoint bacformer-causal-protein-family-modeling-complete-genomes was not retrievable: Access https://huggingface.co/macwiatrak/bacformer-causal-protein-family-modeling-complete-genomes and the Hugging Face model API both returned HTTP 401 to an anonymous request on 2026-11-15 (Bacformer README 'Pretrained model checkpoints' table, Row 'bacformer-causal-protein-family-modeling-complete-genom...; retrieval attempted 2026-11-15)
  • Checkpoint bacformer-for-essential-genes-prediction was not retrievable: Access https://huggingface.co/macwiatrak/bacformer-for-essential-genes-prediction and the Hugging Face model API both returned HTTP 401 to an anonymous request on 2026-11-15 (Bacformer README 'Pretrained model checkpoints' table, Row 'bacformer-for-essential-genes-prediction': 'A bacformer...; retrieval attempted 2026-11-15)
  • MAG and complete-genome checkpoints are distinct: Complete genome pretraining The complete-genome checkpoints are initialised from the corresponding MAG checkpoint and further pretrained on about 40,000 complete genomes from NCBI RefSeq, so the MAG and complete-genome checkpoints are different configurations of the same architecture (Hugging Face model cards for macwiatrak/bacformer-masked-complete-genomes and macwiatrak/bacformer-large-masked-complete-genomes: 'This model was initialised from ... and further pretrained on ~40 k complete genomes')
  • README checkpoint table conflicts with the model card on training data: Training data conflict The README checkpoint table describes bacformer-large-masked-complete-genomes as 'A 300M parameter model pretrained on the ~1.3 M metagenome-assembled genomes (MAG) with a masked objective', repeating the text of the MAG row, while its own model card says it was initialised from bacformer-large-masked-MAG and further pretrained on about 40,000 complete RefSeq genomes (Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body)
  • The base protein language model of Bacformer Large carries its own licence: Dependency licence The ESM++ implementation that the README names for Bacformer Large is governed by the EvolutionaryScale Cambrian Open License Agreement, not by Apache-2.0 (Bacformer README 'Requirements', note: 'ESM++ is a faithful implementation of ESM-C (license)' linking to evolutionaryscale.ai/policies/cambrian-open-license-agreement)
  • What Bacformer takes as input and returns: Inputs and outputs Inputs are the protein sequences encoded by a genome, embedded one by one with a base protein language model and ordered by their coordinates on the chromosome and plasmids; outputs are contextual protein embeddings, a mean-pooled genome embedding, and protein-family predictions from the pretraining head (Bacformer README opening paragraph and 'Usage'; model card 'Architecture'; preprint Methods 'Bacformer')

Models, benchmarks and other records

Models (10)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

27 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/macwiatrak/Bacformer/61dca9537429b95365d73d72a3e11c207df1ed6c/README.md
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code url
https://github.com/macwiatrak/Bacformer
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_url

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Limitations
2 values
  • The 'Pretrained model checkpoints' table repeats the MAG training description on the bacformer-large-masked-complete-genomes row, which its own model card contradicts.
  • The news list is not in date order and the dates of the Bacformer Large release entries precede the preprint entry they follow.
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Media type
text/markdown
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Publication status
official_project_source
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-11-15T23:09:36Z
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: artifact sha256
6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: method note
Independent review pass. Each source artifact was retrieved again at review time and its SHA-256 compared with the source record; the quoted statement was then read at the recorded locator and compared with the recorded value. Access states were rechecked rather than taken from notes.md.
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method_note

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review method
3 values
  • transcription
  • source-hash-verification
  • ai-assisted-source-review
Source metadata
Bacformer repository README at commit 61dca95

Original source ↗

No field-specific location recorded

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

The Bacformer repository README, which lists the released checkpoints, the base protein language model of each size and the installation requirements.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: bacformer-20261115-source-bacformer-readme

areas
microbes-communities
contexts
research
artifact sha256
6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235
artifact url
https://raw.githubusercontent.com/macwiatrak/Bacformer/61dca9537429b95365d73d72a3e11c207df1ed6c/README.md
code url
https://github.com/macwiatrak/Bacformer
limitations
The 'Pretrained model checkpoints' table repeats the MAG training description on the bacformer-large-masked-complete-genomes row, which its own model card contradicts.; The news list is not in date order and the dates of the Bacformer Large release entries precede the preprint entry they follow.
media type
text/markdown
publication status
official_project_source
retrieved at
2026-11-15T23:09:36Z
review
artifact sha256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235; method: transcription; source-hash-verification; ai-assisted-source-review; method note: Independent review pass. Each source artifact was retrieved again at review time and its SHA-256 compared with the source record; the quoted statement was then read at the recorded locator and compared with the recorded value. Access states were rechecked rather than taken from notes.md.; note: Statement re-read against the pinned artifact by a reviewer who did not extract this batch. Every artifact except the two preprint PDFs was downloaded again at review time and hashed to exactly the value its source record records, and is byte-identical to the copy kept in artifacts/.; retrieval url: https://raw.githubusercontent.com/macwiatrak/Bacformer/61dca9537429b95365d73d72a3e11c207df1ed6c/README.md; reviewed at: 2026-11-15T23:55:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent, independent of the agent that extracted this batch; no human review claimed. Transcription was checked against the pinned sources. Nothing was reproduced and no value was recomputed.
source locator
Sections 'News', 'Requirements', 'Pretrained model checkpoints' and 'Citation'
url
https://github.com/macwiatrak/Bacformer/blob/61dca9537429b95365d73d72a3e11c207df1ed6c/README.md
version
Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Related records

Suggest a correction