Bacformer pretraining objective and protein-family vocabulary
Pretraining objective of Bacformer
Predict the protein family of masked proteins, or the next protein family, from the other proteins in the genome, over a vocabulary of 50,000 protein-family clusters obtained by unsupervised clustering of protein embeddings; 15% of proteins are masked, of which 87.5% are replaced by the mask token and 12.5% are left unchanged
The input is the exact protein sequence while the prediction target is a discrete protein family, which is what makes the model usable at amino-acid level while still allowing pretraining.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
7 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Claimed field pretraining_objective Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Rationale The input is the exact protein sequence while the prediction target is a discrete protein family, which is what makes the model usable at amino-acid level while still allowing pretraining. Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Source location Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Claimed value Predict the protein family of masked proteins, or the next protein family, from the other proteins in the genome, over a vocabulary of 50,000 protein-family clusters obtained by unsupervised clustering of protein embeddings; 15% of proteins are masked, of which 87.5% are replaced by the mask token and 12.5% are left unchanged Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Description The input is the exact protein sequence while the prediction target is a discrete protein family, which is what makes the model usable at amino-acid level while still allowing pretraining. Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Relationship: subject bacformer-20261115-model-bacformer Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Name Bacformer pretraining objective and protein-family vocabulary Context-only references | Hugging Face model card for macwiatrak/bacformer-masked-MAG Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head' Version: Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
1 source record and release history
- Hugging Face model card for macwiatrak/bacformer-masked-MAG · Original source · Repository revision 340a08cf5d5cd7d9f1ffac9075cde733d108a82b
Technical metadata and extraction receipts
Stable ID: bacformer-20261115-claim-bacformer-pretraining-objective
- areas
- microbes-communities
- contexts
- research
- field
- pretraining_objective
- rationale
- The input is the exact protein sequence while the prediction target is a discrete protein family, which is what makes the model usable at amino-acid level while still allowing pretraining.
- review
- artifact sha256: d735d1b2c8caa57a9f6abf990a457b2aa084f626070e555d6c01ca4a46b6bf7c; method: transcription; source-hash-verification; ai-assisted-source-review; method note: Independent review pass. Each source artifact was retrieved again at review time and its SHA-256 compared with the source record; the quoted statement was then read at the recorded locator and compared with the recorded value. Access states were rechecked rather than taken from notes.md.; note: Statement re-read against the pinned artifact by a reviewer who did not extract this batch. Every artifact except the two preprint PDFs was downloaded again at review time and hashed to exactly the value its source record records, and is byte-identical to the copy kept in artifacts/.; retrieval url: https://huggingface.co/macwiatrak/bacformer-masked-MAG/raw/340a08cf5d5cd7d9f1ffac9075cde733d108a82b/README.md; reviewed at: 2026-11-15T23:55:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent, independent of the agent that extracted this batch; no human review claimed. Transcription was checked against the pinned sources. Nothing was reproduced and no value was recomputed.
- source locator
- Hugging Face model card for macwiatrak/bacformer-masked-MAG, 'Pretraining' and 'Pretraining classification head'
- value
- Predict the protein family of masked proteins, or the next protein family, from the other proteins in the genome, over a vocabulary of 50,000 protein-family clusters obtained by unsupervised clustering of protein embeddings; 15% of proteins are masked, of which 87.5% are replaced by the mask token and 12.5% are left unchanged
Related records
- subject: Bacformer