rewirebio.iobenchmarks
Evidence claim

README checkpoint table conflicts with the model card on training data

Training data conflict of bacformer-large-masked-complete-genomes

The README checkpoint table describes bacformer-large-masked-complete-genomes as 'A 300M parameter model pretrained on the ~1.3 M metagenome-assembled genomes (MAG) with a masked objective', repeating the text of the MAG row, while its own model card says it was initialised from bacformer-large-masked-MAG and further pretrained on about 40,000 complete RefSeq genomes

Two official sources describe the same checkpoint's training differently; the checkpoint record follows the model card and this claim keeps the README's wording on the record.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

14 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Claimed field
training_data_conflict
Context-only references
Bacformer repository README at commit 61dca95

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed field
training_data_conflict
Context-only references
Hugging Face model card for macwiatrak/bacformer-large-masked-complete-genomes

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Repository revision 84f85c37a05e55559142b842c1569e265183b554
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 19142e40c2aa69f1b3125fb7594cc8c6ea9f775e1878645583df21952c175596

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Rationale
Two official sources describe the same checkpoint's training differently; the checkpoint record follows the model card and this claim keeps the README's wording on the record.
Context-only references
Bacformer repository README at commit 61dca95

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Rationale
Two official sources describe the same checkpoint's training differently; the checkpoint record follows the model card and this claim keeps the README's wording on the record.
Context-only references
Hugging Face model card for macwiatrak/bacformer-large-masked-complete-genomes

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Repository revision 84f85c37a05e55559142b842c1569e265183b554
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: 19142e40c2aa69f1b3125fb7594cc8c6ea9f775e1878645583df21952c175596

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source location
Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body
Context-only references
Bacformer repository README at commit 61dca95

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source location
Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body
Context-only references
Hugging Face model card for macwiatrak/bacformer-large-masked-complete-genomes

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Repository revision 84f85c37a05e55559142b842c1569e265183b554
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 19142e40c2aa69f1b3125fb7594cc8c6ea9f775e1878645583df21952c175596

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed value
The README checkpoint table describes bacformer-large-masked-complete-genomes as 'A 300M parameter model pretrained on the ~1.3 M metagenome-assembled genomes (MAG) with a masked objective', repeating the text of the MAG row, while its own model card says it was initialised from bacformer-large-masked-MAG and further pretrained on about 40,000 complete RefSeq genomes
Context-only references
Bacformer repository README at commit 61dca95

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed value
The README checkpoint table describes bacformer-large-masked-complete-genomes as 'A 300M parameter model pretrained on the ~1.3 M metagenome-assembled genomes (MAG) with a masked objective', repeating the text of the MAG row, while its own model card says it was initialised from bacformer-large-masked-MAG and further pretrained on about 40,000 complete RefSeq genomes
Context-only references
Hugging Face model card for macwiatrak/bacformer-large-masked-complete-genomes

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Repository revision 84f85c37a05e55559142b842c1569e265183b554
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 19142e40c2aa69f1b3125fb7594cc8c6ea9f775e1878645583df21952c175596

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Two official sources describe the same checkpoint's training differently; the checkpoint record follows the model card and this claim keeps the README's wording on the record.
Context-only references
Bacformer repository README at commit 61dca95

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Commit 61dca9537429b95365d73d72a3e11c207df1ed6c
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Two official sources describe the same checkpoint's training differently; the checkpoint record follows the model card and this claim keeps the README's wording on the record.
Context-only references
Hugging Face model card for macwiatrak/bacformer-large-masked-complete-genomes

Original source ↗

Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Repository revision 84f85c37a05e55559142b842c1569e265183b554
Retrieved: 2026-11-15T23:09:36Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 19142e40c2aa69f1b3125fb7594cc8c6ea9f775e1878645583df21952c175596

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: bacformer-20261115-claim-bacformer-readme-checkpoint-table-conflict

areas
microbes-communities
contexts
research
field
training_data_conflict
rationale
Two official sources describe the same checkpoint's training differently; the checkpoint record follows the model card and this claim keeps the README's wording on the record.
review
artifact sha256: 6e4fdabbd05c93ff63b0eb583ce6a9309eaa13998087cc32ddeaa6928025b235; method: transcription; source-hash-verification; ai-assisted-source-review; method note: Independent review pass. Each source artifact was retrieved again at review time and its SHA-256 compared with the source record; the quoted statement was then read at the recorded locator and compared with the recorded value. Access states were rechecked rather than taken from notes.md.; note: Statement re-read against the pinned artifact by a reviewer who did not extract this batch. Every artifact except the two preprint PDFs was downloaded again at review time and hashed to exactly the value its source record records, and is byte-identical to the copy kept in artifacts/.; retrieval url: https://raw.githubusercontent.com/macwiatrak/Bacformer/61dca9537429b95365d73d72a3e11c207df1ed6c/README.md; reviewed at: 2026-11-15T23:55:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent, independent of the agent that extracted this batch; no human review claimed. Transcription was checked against the pinned sources. Nothing was reproduced and no value was recomputed.
source locator
Bacformer README 'Pretrained model checkpoints' table, row 'bacformer-large-masked-complete-genomes', against the model card body
value
The README checkpoint table describes bacformer-large-masked-complete-genomes as 'A 300M parameter model pretrained on the ~1.3 M metagenome-assembled genomes (MAG) with a masked objective', repeating the text of the MAG row, while its own model card says it was initialised from bacformer-large-masked-MAG and further pretrained on about 40,000 complete RefSeq genomes
Related records

Suggest a correction