rewirebio.iobenchmarks
Source

EditJumps repository README at the pinned commit

Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99 · Project source

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Claims

Statements this source supports, each with where in the source it was checked.

  • About half the generated variants change length: Output behaviour Unlike infilling models that operate on fixed-length masks and only propose substitutions, this editor supports insertions and deletions: across 400 evaluated variants per family, roughly half showed length changes, 195 of 400 on Ty1 at 4.58 mean edits and 198 of 400 on HER2-VH at 4.08 mean edits. (README 'Comparison with Alternatives', first bullet)
  • The edit budget holds in expectation, not per sequence: Edit budget The edit budget is calibrated on average rather than guaranteed per sequence. The paper states that clock normalisation has no closed-form mapping to realised edits, because jump rates vary with time and sequence context, so achieving a specific edit budget requires empirical calibration rather than deterministic control. The repository states the --edits parameter 'provides approximate guidance via clock calibration' and that realised counts vary per sequence, and the README states '--edits is a target, not a guarantee'. (Section 5 'Limitations'; docs/limitations.md, third bullet; README 'Quick Start' step 5)

Models, benchmarks and other records

Methods (1)

Tasks (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

28 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Access and reuse
The MIT grant covers this repository and the released weights. It says nothing about the pretrained ESM-2 checkpoints or the Observed Antibody Space data the editor is trained on, which carry their own terms.
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.access_and_reuse

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact SHA-256
fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/README.md
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code licence
MIT
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_licence

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code url
https://github.com/VisiumCH/editjumps/tree/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_url

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Media type
text/markdown
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Publication status
official_project_source
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-11-16T00:05:00Z
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: artifact sha256
fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: method note
Independent review pass. Every pinned artifact was re-downloaded from the URL in its source record and its SHA-256 recomputed: all nine match. The arXiv PDF's text layer was regenerated with pdftotext -layout from poppler 26.08.0 and matches the hash notes.md records. npm run batch -- check-values over the whole batch reproduced the extractor's figures exactly (8 in_cell, 164 in_row, 3 locator_not_parsed, no wrong_column and no overclaimed_in_row). Because 164 results sit at in_row only, column assignment was then checked separately by review/column_check.py, written for this pass and using neither extract/tables.py nor extract/check_tables.py. It builds two independent column models: the PDF text layer, where Tables 2 and 4 are assigned by clustering printed field right edges and Table 1 by ordinal position within the row, and the arXiv HTML rendering parsed as a cell grid from the table markup. The two models agree on every cell, and all 172 table-located results match their locator's column and block in both. Four negative controls, two columns exchanged within a row, a row shifted one column left, a Ty1 and HER2 sub-column exchanged, and the Table 1 upper and lower blocks exchanged for one row label, are rejected by both models.
Source metadata
EditJumps repository README at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method_note

Source artifact SHA-256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

The repository front page, which states what the editor takes and returns, how the edit budget behaves and the frame of the replication evaluation.

1 source record and release history

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: editjumps-20261115-source-code-readme

areas
protein-function; proteins-complexes
contexts
research
access and reuse
The MIT grant covers this repository and the released weights. It says nothing about the pretrained ESM-2 checkpoints or the Observed Antibody Space data the editor is trained on, which carry their own terms.
artifact sha256
fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05
artifact url
https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/README.md
code licence
MIT
code url
https://github.com/VisiumCH/editjumps/tree/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
media type
text/markdown
publication status
official_project_source
retrieved at
2026-11-16T00:05:00Z
review
artifact sha256: fbf05022b8140519c13bf60db99276df3edcbaeac57f091f54a0dc3921716c05; method: ai-assisted-source-review; source-hash-verification; method note: Independent review pass. Every pinned artifact was re-downloaded from the URL in its source record and its SHA-256 recomputed: all nine match. The arXiv PDF's text layer was regenerated with pdftotext -layout from poppler 26.08.0 and matches the hash notes.md records. npm run batch -- check-values over the whole batch reproduced the extractor's figures exactly (8 in_cell, 164 in_row, 3 locator_not_parsed, no wrong_column and no overclaimed_in_row). Because 164 results sit at in_row only, column assignment was then checked separately by review/column_check.py, written for this pass and using neither extract/tables.py nor extract/check_tables.py. It builds two independent column models: the PDF text layer, where Tables 2 and 4 are assigned by clustering printed field right edges and Table 1 by ordinal position within the row, and the arXiv HTML rendering parsed as a cell grid from the table markup. The two models agree on every cell, and all 172 table-located results match their locator's column and block in both. Four negative controls, two columns exchanged within a row, a row shifted one column left, a Ty1 and HER2 sub-column exchanged, and the Table 1 upper and lower blocks exchanged for one row label, are rejected by both models.; note: Re-retrieved from the URL in this record and the SHA-256 recomputed; it matches. The repository files were also checked against a tarball of commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99, in which they are byte-identical.; retrieval url: https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/README.md; reviewed at: 2026-11-16T01:30:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent for issue #244, independent of the extraction agent; no human review claimed. All nine pinned artifacts were re-retrieved and their SHA-256 re-computed; no value was reproduced and no model was run.
source locator
'Overview', 'Comparison with Alternatives', 'Replication Scope', 'Quick Start' step 5 and 'Ranking Candidates'
url
https://github.com/VisiumCH/editjumps/blob/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/README.md
version
Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Related records

Suggest a correction