rewirebio.iobenchmarks
Source

EditJumps repository performance notes at the pinned commit

Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99 · Project source

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Claims

Statements this source supports, each with where in the source it was checked.

  • Training runtime as the repository states it: Runtime The repository's performance notes give the 35M edit-flow editor about 1.05 s/step on an L4 and about 5.8 h for 20,000 steps, and separately record 20,000-step editor runs on an A100 at 3 h 0 m 43 s and 0.54 s/step for the linear schedule and about 3 h 31 m at about 0.63 s/step for the cubic. (docs/performance.md, 'ESM-2 35M Edit-Flow Editor (L4)' and '20,000-Step Editor Runs (A100)')

Models, benchmarks and other records

Configurations (2)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

29 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Access and reuse
The MIT grant covers this repository and the released weights. It says nothing about the pretrained ESM-2 checkpoints or the Observed Antibody Space data the editor is trained on, which carry their own terms.
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.access_and_reuse

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact SHA-256
01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Artifact url
https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/performance.md
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code licence
MIT
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_licence

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Code url
https://github.com/VisiumCH/editjumps/tree/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.code_url

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Limitations
1 values
  • Its L4 figures for the 20,000-step run, about 1.05 s/step and about 5.8 h, agree with the model card and differ from the paper's Appendix D, which gives 6 h 29 m at 1.09 s/step for the same run.
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Media type
text/markdown
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Publication status
official_project_source
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.publication_status

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Retrieved at
2026-11-16T00:05:00Z
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Review: artifact sha256
01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3
Source metadata
EditJumps repository performance notes at the pinned commit

Original source ↗

No field-specific location recorded

Version: Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Retrieved: 2026-11-16T00:05:00Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.artifact_sha256

Source artifact SHA-256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

The repository's hardware and throughput notes for the training, evaluation and data-build stages.

1 source record and release history

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: editjumps-20261115-source-code-performance

areas
protein-function; proteins-complexes
contexts
research
access and reuse
The MIT grant covers this repository and the released weights. It says nothing about the pretrained ESM-2 checkpoints or the Observed Antibody Space data the editor is trained on, which carry their own terms.
artifact sha256
01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3
artifact url
https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/performance.md
code licence
MIT
code url
https://github.com/VisiumCH/editjumps/tree/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
limitations
Its L4 figures for the 20,000-step run, about 1.05 s/step and about 5.8 h, agree with the model card and differ from the paper's Appendix D, which gives 6 h 29 m at 1.09 s/step for the same run.
media type
text/markdown
publication status
official_project_source
retrieved at
2026-11-16T00:05:00Z
review
artifact sha256: 01e59ef27b2e93b118b15239e57c6500045c99facd72f0b956e78ecf161217e3; method: ai-assisted-source-review; source-hash-verification; method note: Independent review pass. Every pinned artifact was re-downloaded from the URL in its source record and its SHA-256 recomputed: all nine match. The arXiv PDF's text layer was regenerated with pdftotext -layout from poppler 26.08.0 and matches the hash notes.md records. npm run batch -- check-values over the whole batch reproduced the extractor's figures exactly (8 in_cell, 164 in_row, 3 locator_not_parsed, no wrong_column and no overclaimed_in_row). Because 164 results sit at in_row only, column assignment was then checked separately by review/column_check.py, written for this pass and using neither extract/tables.py nor extract/check_tables.py. It builds two independent column models: the PDF text layer, where Tables 2 and 4 are assigned by clustering printed field right edges and Table 1 by ordinal position within the row, and the arXiv HTML rendering parsed as a cell grid from the table markup. The two models agree on every cell, and all 172 table-located results match their locator's column and block in both. Four negative controls, two columns exchanged within a row, a row shifted one column left, a Ty1 and HER2 sub-column exchanged, and the Table 1 upper and lower blocks exchanged for one row label, are rejected by both models.; note: Re-retrieved from the URL in this record and the SHA-256 recomputed; it matches. The repository files were also checked against a tarball of commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99, in which they are byte-identical.; retrieval url: https://raw.githubusercontent.com/VisiumCH/editjumps/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/performance.md; reviewed at: 2026-11-16T01:30:00Z; reviewer: claude; reviewer note: Claude (Opus 5) review agent for issue #244, independent of the extraction agent; no human review claimed. All nine pinned artifacts were re-retrieved and their SHA-256 re-computed; no value was reproduced and no model was run.
source locator
'Hardware in use'; 'Training', ESM-2 35M Edit-Flow Editor (L4) and 20,000-Step Editor Runs (A100); 'Evaluation and baselines', Generation Evaluation
url
https://github.com/VisiumCH/editjumps/blob/d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99/docs/performance.md
version
Commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99
Related records

Suggest a correction