rewirebio.iobenchmarks
Source

EditJumps repository scope and limitations note at the pinned commit

Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99 · Project source

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Claims

Statements this source supports, each with where in the source it was checked.

  • The edit budget holds in expectation, not per sequence: Edit budget The edit budget is calibrated on average rather than guaranteed per sequence. The paper states that clock normalisation has no closed-form mapping to realised edits, because jump rates vary with time and sequence context, so achieving a specific edit budget requires empirical calibration rather than deterministic control. The repository states the --edits parameter 'provides approximate guidance via clock calibration' and that realised counts vary per sequence, and the README states '--edits is a target, not a guarantee'. (Section 5 'Limitations'; docs/limitations.md, third bullet; README 'Quick Start' step 5)
  • The model does not score or rank the variants it proposes: Scope The editor generates variants without scoring their quality or confidence, and operates without target property conditioning, so the repository states that experimental assays or downstream property models are required to assess functional fitness. Its internal rate field distinguishes corrupted from natural sequences but gives no ranking signal among plausible variants. (docs/limitations.md, the first two bullets; docs/claims.md 'Target Property Scope')

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

28 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Access and reuse
The MIT grant covers this repository and the released weights. It says nothing about the pretrained ESM-2 checkpoints or the Observed Antibody Space data the editor is trained on, which carry their own terms.
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.access_and_reuse

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact SHA-256
e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/limitations.md
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code licence
MIT
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_licence

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code url
https://github.com/VisiumCH/editjumps/tree/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_url

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Media type
text/markdown
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Publication status
official_project_source
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-11-16T00:05:00Z
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: artifact sha256
e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: method note
Independent review pass. Every pinned artifact was re-downloaded from the URL in its source record and its SHA-256 recomputed: all nine match. The arXiv PDF's text layer was regenerated with pdftotext -layout from poppler 26.08.0 and matches the hash notes.md records. npm run batch -- check-values over the whole batch reproduced the extractor's figures exactly (8 in_cell, 164 in_row, 3 locator_not_parsed, no wrong_column and no overclaimed_in_row). Because 164 results sit at in_row only, column assignment was then checked separately by review/column_check.py, written for this pass and using neither extract/tables.py nor extract/check_tables.py. It builds two independent column models: the PDF text layer, where Tables 2 and 4 are assigned by clustering printed field right edges and Table 1 by ordinal position within the row, and the arXiv HTML rendering parsed as a cell grid from the table markup. The two models agree on every cell, and all 172 table-located results match their locator's column and block in both. Four negative controls, two columns exchanged within a row, a row shifted one column left, a Ty1 and HER2 sub-column exchanged, and the Table 1 upper and lower blocks exchanged for one row label, are rejected by both models.
Source metadata
EditJumps repository scope and limitations note at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method_note

Source artifact SHA-256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

The repository's statement of what the editor does not do: no variant scoring, no property conditioning and only approximate edit budgets.

1 source record and release history

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: editjumps-20261115-source-code-limitations

areas
protein-function; proteins-complexes
contexts
research
access and reuse
The MIT grant covers this repository and the released weights. It says nothing about the pretrained ESM-2 checkpoints or the Observed Antibody Space data the editor is trained on, which carry their own terms.
artifact sha256
e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8
artifact url
https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/limitations.md
code licence
MIT
code url
https://github.com/VisiumCH/editjumps/tree/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
media type
text/markdown
publication status
official_project_source
retrieved at
2026-11-16T00:05:00Z
review
artifact sha256: e11bb92210012e08e6a0bc0e6298d098818419f3d661bdae6082c71de9c0b6d8; method: ai-assisted-source-review; source-hash-verification; method note: Independent review pass. Every pinned artifact was re-downloaded from the URL in its source record and its SHA-256 recomputed: all nine match. The arXiv PDF's text layer was regenerated with pdftotext -layout from poppler 26.08.0 and matches the hash notes.md records. npm run batch -- check-values over the whole batch reproduced the extractor's figures exactly (8 in_cell, 164 in_row, 3 locator_not_parsed, no wrong_column and no overclaimed_in_row). Because 164 results sit at in_row only, column assignment was then checked separately by review/column_check.py, written for this pass and using neither extract/tables.py nor extract/check_tables.py. It builds two independent column models: the PDF text layer, where Tables 2 and 4 are assigned by clustering printed field right edges and Table 1 by ordinal position within the row, and the arXiv HTML rendering parsed as a cell grid from the table markup. The two models agree on every cell, and all 172 table-located results match their locator's column and block in both. Four negative controls, two columns exchanged within a row, a row shifted one column left, a Ty1 and HER2 sub-column exchanged, and the Table 1 upper and lower blocks exchanged for one row label, are rejected by both models.; note: Re-retrieved from the URL in this record and the SHA-256 recomputed; it matches. The repository files were also checked against a tarball of commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99, in which they are byte-identical.; retrieval url: https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/limitations.md; reviewed at: 2026-11-16T01:30:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent for issue #244, independent of the extraction agent; no human review claimed. All nine pinned artifacts were re-retrieved and their SHA-256 re-computed; no value was reproduced and no model was run.
source locator
'Scope and Limitations', the three bullets
url
https://github.com/VisiumCH/editjumps/blob/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/limitations.md
version
Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Related records

Suggest a correction