rewirebio.iobenchmarks
Evidence claim

Preprint versions 2 and 3 print different values

Version differences of Bacformer preprint, bioRxiv 2025.07.20.665723 version 3

Version 3 (posted 17 August 2026) reports Bacformer Large, which version 2 (posted 13 August 2025) does not mention anywhere; the two versions are separate reports of the same study and their numbers must not be pooled. Where the two were compared, on the genus-level nearest-neighbour retrieval figure of almost 95% balanced accuracy and the 0.81 plus or minus 0.07 median essentiality AUROC, both versions print the same figures

The two versions are different reports of the same study, so their numbers must not be pooled; every value in this batch comes from version 3.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

16 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Claimed field
version_differences
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 2

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 2, posted 13 August 2025 according to the page banner
Retrieved: 2026-11-15T22:53:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: a842db88eabf2b83d4e0de861e8a6767a01ee3f72c62b6a177494ffafd6d9703

Hash scope: One download of 2026-11-15; the same caveat applies as for version 3, whose container bytes change between downloads.

Claimed field
version_differences
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19
Retrieved: 2026-11-15T22:55:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd

Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from.

Limitations
2 values
  • No systematic numeric comparison of version 2 against version 3 was made. Version 2's text layer mis-encodes digits, so only two of its pages were rendered and read; other figures may or may not differ.
  • No value in this batch comes from version 2.
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 2

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 2, posted 13 August 2025 according to the page banner
Retrieved: 2026-11-15T22:53:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: a842db88eabf2b83d4e0de861e8a6767a01ee3f72c62b6a177494ffafd6d9703

Hash scope: One download of 2026-11-15; the same caveat applies as for version 3, whose container bytes change between downloads.

Limitations
2 values
  • No systematic numeric comparison of version 2 against version 3 was made. Version 2's text layer mis-encodes digits, so only two of its pages were rendered and read; other figures may or may not differ.
  • No value in this batch comes from version 2.
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19
Retrieved: 2026-11-15T22:55:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd

Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from.

Rationale
The two versions are different reports of the same study, so their numbers must not be pooled; every value in this batch comes from version 3.
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 2

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 2, posted 13 August 2025 according to the page banner
Retrieved: 2026-11-15T22:53:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: a842db88eabf2b83d4e0de861e8a6767a01ee3f72c62b6a177494ffafd6d9703

Hash scope: One download of 2026-11-15; the same caveat applies as for version 3, whose container bytes change between downloads.

Rationale
The two versions are different reports of the same study, so their numbers must not be pooled; every value in this batch comes from version 3.
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19
Retrieved: 2026-11-15T22:55:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.rationale

Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd

Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from.

Source location
Version 3 Results sections against version 2 of the same preprint
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 2

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 2, posted 13 August 2025 according to the page banner
Retrieved: 2026-11-15T22:53:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: a842db88eabf2b83d4e0de861e8a6767a01ee3f72c62b6a177494ffafd6d9703

Hash scope: One download of 2026-11-15; the same caveat applies as for version 3, whose container bytes change between downloads.

Source location
Version 3 Results sections against version 2 of the same preprint
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19
Retrieved: 2026-11-15T22:55:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd

Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from.

Claimed value
Version 3 (posted 17 August 2026) reports Bacformer Large, which version 2 (posted 13 August 2025) does not mention anywhere; the two versions are separate reports of the same study and their numbers must not be pooled. Where the two were compared, on the genus-level nearest-neighbour retrieval figure of almost 95% balanced accuracy and the 0.81 plus or minus 0.07 median essentiality AUROC, both versions print the same figures
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 2

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 2, posted 13 August 2025 according to the page banner
Retrieved: 2026-11-15T22:53:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: a842db88eabf2b83d4e0de861e8a6767a01ee3f72c62b6a177494ffafd6d9703

Hash scope: One download of 2026-11-15; the same caveat applies as for version 3, whose container bytes change between downloads.

Claimed value
Version 3 (posted 17 August 2026) reports Bacformer Large, which version 2 (posted 13 August 2025) does not mention anywhere; the two versions are separate reports of the same study and their numbers must not be pooled. Where the two were compared, on the genus-level nearest-neighbour retrieval figure of almost 95% balanced accuracy and the 0.81 plus or minus 0.07 median essentiality AUROC, both versions print the same figures
Context-only references
Bacformer preprint, bioRxiv 2025.07.20.665723 version 3

Original source ↗

Version 3 Results sections against version 2 of the same preprint

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Version 3, posted 17 August 2026 according to the page banner; the bioRxiv API lists version 3 with date 2026-08-19
Retrieved: 2026-11-15T22:55:00Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: d86de3315063e038ec8d5bed60b7b1a916c137ee60973e55d9d5c82f078d8dfd

Hash scope: The hash is of one download. bioRxiv regenerates this PDF on request, so the container bytes differ between downloads: a second download minutes later gave 08fcc83af256845d942345fc6b63c64911878733acd028edab5e9307d63319db. The pdftotext -layout text layer of both downloads is byte-identical (SHA-256 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2), and that text layer, archived gzipped in artifacts/ with SHA-256 0afdefd78a410d036d1c4f17e33bdf481e8d76241ee02f4c84c7c4be91ee72aa, is what every extracted value was read from.

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: bacformer-20261115-claim-preprint-version-differences

areas
microbes-communities
contexts
research
field
version_differences
limitations
No systematic numeric comparison of version 2 against version 3 was made. Version 2's text layer mis-encodes digits, so only two of its pages were rendered and read; other figures may or may not differ.; No value in this batch comes from version 2.
rationale
The two versions are different reports of the same study, so their numbers must not be pooled; every value in this batch comes from version 3.
review
artifact sha256: 86636e89b167d7304b3a83ee7f159cad0a9bdbe97019588ce836087b8fe3b0b2; method: transcription; pdf-text-parse; source-hash-verification; ai-assisted-source-review; method note: Independent review pass. Each source artifact was retrieved again at review time and its SHA-256 compared with the source record; the quoted statement was then read at the recorded locator and compared with the recorded value. Access states were rechecked rather than taken from notes.md.; note: Statement re-read against the version 3 preprint. The PDF's container bytes differ on every download, so the artifact checked is its pdftotext -layout text layer, which two fresh downloads reproduce byte for byte and which the archived copy in artifacts/ decompresses to. Corrected by this review. The claim asserted that version 2 prints different values for the same analyses and gave two examples. Both examples are identical in the two versions: version 2 page 5 prints 'almost 95% balanced accuracy across diverse genera' and page 8 prints '0.81 +/- 0.07 median AUROC across diverse genomes', the same as version 3. They were read from renders of those two pages at 200 dpi, because version 2's text layer mis-encodes digits: the rendered '0.81 +/- 0.07' appears in the text layer as '+.)! +/- +.+(' and the rendered '95%' as '*'%'. That confirms the extractor's warning about the text layer and refutes the conclusion drawn from it. What the sources do support is kept: version 2 nowhere mentions Bacformer Large, zero occurrences of 'Bacformer Large' or 'Bacformer-L' in its text layer, where letters render correctly.; retrieval url: https://www.biorxiv.org/content/10.1101/2025.07.20.665723v3.full.pdf; reviewed at: 2026-11-15T23:55:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent, independent of the agent that extracted this batch; no human review claimed. Transcription was checked against the pinned sources. Nothing was reproduced and no value was recomputed.
source locator
Version 3 Results sections against version 2 of the same preprint
value
Version 3 (posted 17 August 2026) reports Bacformer Large, which version 2 (posted 13 August 2025) does not mention anywhere; the two versions are separate reports of the same study and their numbers must not be pooled. Where the two were compared, on the genus-level nearest-neighbour retrieval figure of almost 95% balanced accuracy and the 0.81 plus or minus 0.07 median essentiality AUROC, both versions print the same figures
Related records

Suggest a correction