| Comparison: adaptation None; a control Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.adaptation Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: aggregation Pooled over the 400 generated sequences of the family Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.aggregation Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: budget Matched to the realised edit budget of the learned arms Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.budget Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: dataset version Ty1 homolog family mined from the paired Observed Antibody Space corpus at repository commit d827d47c3bcd29e0f4c15a15f9ac92a6cd859e99 Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.dataset_version Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: inputs One template sequence and an edit budget Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.inputs Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: metric implementation residue covariance agreement against a 300-sequence natural homolog ceiling Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.metric_implementation Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: population One held-out antibody family, Ty1 Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.population Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: protocol id editjumps-20261115-protocol-ours-200-covariance-agreement Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.protocol_id Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
| Comparison: split 20 templates and 20 variants per template, 400 generated sequences, scored against 200 held-out Ty1 homologs; agreement ceiling 300 real Ty1 homologs Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.comparison.split Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|
Limitations9 values- Computational distribution comparison only. The value measures how similar generated sequences are to a reference set of natural sequences; it is not a measured binding affinity, specificity, stability or retained function.
- Scores depend on the size of the reference set. Expanding the reference alignment from 200 to 800 homologs alters the normalised spectrum MMD ratio by 50% on Ty1 and 26% on HER2-VH, which the paper states is large enough to invert method rankings, so the ordering of methods is not stable across reference-set sizes.
- 113 of Ty1's and 103 of HER2-VH's 200 reference sequences were present in the training set. Re-evaluating with strictly disjoint reference sets shifted spectrum MMD by -36.7% on Ty1 and -12.6% on HER2-VH and increased covariance agreement by 12 to 17 points.
- The two held-out targets are single-chain constructs, the camelid VHH Ty1 and the isolated heavy chain HER2-VH, while the training pairs are concatenated two-chain VH.VL sequences. The paper names this as a domain shift.
- Aggregate similarity is substantially driven by conserved framework scaffolds. 76% of residues are framework and 24% are complementarity-determining regions, and within those regions the model closes under 25% of the gap between random mutation and natural homologs, so a high aggregate score is not evidence of a better antigen-binding loop.
- Seed values are not printed. Table 1's caption says it reports individual runs and intervals across three seeds; Table 2 prints one value per cell with no interval.
- The paper states that its computed values and the published EvoFlows values are not comparable and that it could not recover the original experimental conditions from the EvoFlows paper. Table 1's caption adds that the two blocks are not comparable and that each row compares only against its own block's floor and ceiling.
- The EvoFlows paper specifies the covariance matrix but omits the scalar reduction, so the reduction scored here is the EditJumps authors' own choice.
- The paper reports that this score moves with the reference partition alone, from 83.6% to 85.1%, and with the reference set size, from 0.790 at 20 references to 0.985 at 800.
Context-only references | When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) Original source ↗ Table 2, family block "ty1", row "rand. mut.", column "cov. agr." Version: arXiv:2609.18745v1, 16 September 2026 Retrieved: 2026-11-16T00:03:00Z | not individually reviewed No individual claim review recorded author reported Source has a recorded evidence concern. Consult its source page before using the claim. Audit detailsField: attributes.limitations Source artifact SHA-256: 4211d8ef46c55efe8d89ba4ee6c0b4e57cca1e78d0856e9cdfbde37046a7f4e1 Hash scope: Hash scope not separately documented; inspect source record Inspected artifact |
|---|