rewirebio.iobenchmarks
Configuration

EditJumps editor, clock normalisation 40

The EditJumps editor at the setting whose scores the paper reports: an unfrozen pretrained ESM-2 35M trunk with three linear per-position rate heads and two token heads modulated by a sinusoidal time embedding, a linear interpolation schedule, clock normalisation 40 and Euler tau-leaping over 50 steps.

24 evaluations · 24 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Model Capabilities & Hardware Requirements

Deployment facts recorded for EditJumps editor, clock normalisation 40. Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluated Checkpoint: As scored in version 1 of the paper

Evaluations and results

24 evaluations · 24 results. Different protocols are not a single leaderboard.

Sorted by Covariance agreement (residue covariance agreement against a 300-sequence natural homolog ceiling) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetCovariance agreement (residue covariance agreement against a 300-sequence natural homolog ceiling)Jensen shannon divergence (per-position formulation chosen by the EditJumps authors, against a 200-sequence natural holdout)Kullback leibler divergence (per-position amino-acid composition against a 200-sequence natural holdout)Kullback leibler divergence (pooled amino-acid composition against a 200-sequence natural holdout)Log likelihood (profile log-likelihood of the generated sequences under the family alignment profile)Maximum mean discrepancy (k-mer spectrum MMD between the generated set and a 200-sequence natural holdout, unnormalised)Mutual information product agreement (mutual information product agreement against a 300-sequence natural homolog ceiling)Covariance agreement (percent of the natural homolog ceiling)Jensen shannon divergence (positional formulation chosen by the EditJumps authors, expressed as a multiple of the floor)Mutual information product agreement (percent of the natural homolog ceiling)Edit count (mean realised edits per generated sequence, 400 generated sequences per family)Entropy delta (positional entropy difference from the natural holdout; the target value is zero)Levenshtein distance (mean pairwise Levenshtein distance within the generated set, pooled over templates)Levenshtein distance (pooled reduction, expressed as a ratio to natural homologs)
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: cov. agr., HER2-VH reference holdout, 200 homologs0.93 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: cov. agr., Ty1 reference holdout, 200 homologs0.91Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationCeiling-normalised comparison, EditJumps, two families, 200 references: Covariance (% of ceiling), Two-family reference sets, 200 homologs eachNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported84.3%Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationCeiling-normalised comparison, EditJumps, two families, 200 references: Positional JS† (× floor), Two-family reference sets, 200 homologs eachNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported2.68 ± 0.10Not reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationCeiling-normalised comparison, EditJumps, two families, 200 references: MIP (% of ceiling), Two-family reference sets, 200 homologs eachNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported78.8%Not reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationCeiling-normalised comparison, EditJumps, two families, 200 references: Pairwise Distance‡, Two-family reference sets, 200 homologs eachNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported1.070 ± 0.011
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: edits, HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported4.08Not reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: edits, Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported4.58Not reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: ΔH, HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.08Not reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: ΔH, Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.07Not reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: JS pos., HER2-VH reference holdout, 200 homologsNot reported1.03 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: JS pos., Ty1 reference holdout, 200 homologsNot reported1.26Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: KL pool., HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reported0.63Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: KL pool., Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reported0.5 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: KL pos., HER2-VH reference holdout, 200 homologsNot reportedNot reported0.05 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: KL pos., Ty1 reference holdout, 200 homologsNot reportedNot reported0.07Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: MIP agr., HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.87 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: MIP agr., Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.83Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: pairw. Lev., HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported24.7Not reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: pairw. Lev., Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported24.5Not reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: prof. LL, HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reported-59 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: prof. LL, Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reported-64Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: MMD, HER2-VH reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reported1.02Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
EditJumps editor, clock normalisation 40EvaluationEditJumps section 4.2 frame, 200 references: MMD, Ty1 reference holdout, 200 homologsNot reportedNot reportedNot reportedNot reportedNot reported0.98 (best in column)Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
All 24 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: EditJumps editor, clock normalisation 40Protocol: Ceiling-normalised comparison, EditJumps, two families, 200 references: Covariance (% of ceiling)
Dataset subset: Two-family reference sets, 200 homologs each
84.3% Covariance agreement (percent of the natural homolog ceiling)
percent · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps (Ours), Covariance (% of ceiling), ceiling-normalised

Metrics normalised against the attainable ceiling computed on held-out natural homologs.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 4, row "Covariance (% of ceiling)", column "EditJumps (Ours)"
Configuration: EditJumps editor, clock normalisation 40Protocol: Ceiling-normalised comparison, EditJumps, two families, 200 references: Positional JS† (× floor)
Dataset subset: Two-family reference sets, 200 homologs each
2.68 ± 0.10 Jensen shannon divergence (positional formulation chosen by the EditJumps authors, expressed as a multiple of the floor)
unitless · lower

Uncertainty: ± 0.10 (type not stated). The paper does not say what the spread is; Table 1's caption mentions intervals across three seeds.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps (Ours), Positional JS† (× floor), ceiling-normalised

Metrics normalised against the attainable ceiling computed on held-out natural homologs.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 4, row "Positional JS† (× floor)", column "EditJumps (Ours)"
Configuration: EditJumps editor, clock normalisation 40Protocol: Ceiling-normalised comparison, EditJumps, two families, 200 references: MIP (% of ceiling)
Dataset subset: Two-family reference sets, 200 homologs each
78.8% Mutual information product agreement (percent of the natural homolog ceiling)
percent · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps (Ours), MIP (% of ceiling), ceiling-normalised

Metrics normalised against the attainable ceiling computed on held-out natural homologs.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 4, row "MIP (% of ceiling)", column "EditJumps (Ours)"
Configuration: EditJumps editor, clock normalisation 40Protocol: Ceiling-normalised comparison, EditJumps, two families, 200 references: Pairwise Distance‡
Dataset subset: Two-family reference sets, 200 homologs each
1.070 ± 0.011 Levenshtein distance (pooled reduction, expressed as a ratio to natural homologs)
unitless · unknown

Uncertainty: ± 0.011 (type not stated). The paper does not say what the spread is; Table 1's caption mentions intervals across three seeds.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps (Ours), Pairwise Distance‡, ceiling-normalised

Metrics normalised against the attainable ceiling computed on held-out natural homologs.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 4, row "Pairwise Distance‡", column "EditJumps (Ours)"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: cov. agr.
Dataset subset: HER2-VH reference holdout, 200 homologs
0.93 Covariance agreement (residue covariance agreement against a 300-sequence natural homolog ceiling)
unitless · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, cov. agr., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "cov. agr."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: cov. agr.
Dataset subset: Ty1 reference holdout, 200 homologs
0.91 Covariance agreement (residue covariance agreement against a 300-sequence natural homolog ceiling)
unitless · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, cov. agr., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "cov. agr."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: edits
Dataset subset: HER2-VH reference holdout, 200 homologs
4.08 Edit count (mean realised edits per generated sequence, 400 generated sequences per family)
count · unknown

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, edits, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "edits"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: edits
Dataset subset: Ty1 reference holdout, 200 homologs
4.58 Edit count (mean realised edits per generated sequence, 400 generated sequences per family)
count · unknown

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, edits, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "edits"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: ΔH
Dataset subset: HER2-VH reference holdout, 200 homologs
0.08 Entropy delta (positional entropy difference from the natural holdout; the target value is zero)
unitless · unknown

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, ΔH, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "ΔH"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: ΔH
Dataset subset: Ty1 reference holdout, 200 homologs
0.07 Entropy delta (positional entropy difference from the natural holdout; the target value is zero)
unitless · unknown

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, ΔH, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "ΔH"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: JS pos.
Dataset subset: HER2-VH reference holdout, 200 homologs
1.03 Jensen shannon divergence (per-position formulation chosen by the EditJumps authors, against a 200-sequence natural holdout)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, JS pos., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "JS pos."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: JS pos.
Dataset subset: Ty1 reference holdout, 200 homologs
1.26 Jensen shannon divergence (per-position formulation chosen by the EditJumps authors, against a 200-sequence natural holdout)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, JS pos., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "JS pos."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: KL pool.
Dataset subset: HER2-VH reference holdout, 200 homologs
0.63 Kullback leibler divergence (pooled amino-acid composition against a 200-sequence natural holdout)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, KL pool., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "KL pool."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: KL pool.
Dataset subset: Ty1 reference holdout, 200 homologs
0.5 Kullback leibler divergence (pooled amino-acid composition against a 200-sequence natural holdout)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, KL pool., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "KL pool."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: KL pos.
Dataset subset: HER2-VH reference holdout, 200 homologs
0.05 Kullback leibler divergence (per-position amino-acid composition against a 200-sequence natural holdout)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, KL pos., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "KL pos."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: KL pos.
Dataset subset: Ty1 reference holdout, 200 homologs
0.07 Kullback leibler divergence (per-position amino-acid composition against a 200-sequence natural holdout)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, KL pos., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "KL pos."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: MIP agr.
Dataset subset: HER2-VH reference holdout, 200 homologs
0.87 Mutual information product agreement (mutual information product agreement against a 300-sequence natural homolog ceiling)
unitless · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, MIP agr., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "MIP agr."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: MIP agr.
Dataset subset: Ty1 reference holdout, 200 homologs
0.83 Mutual information product agreement (mutual information product agreement against a 300-sequence natural homolog ceiling)
unitless · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, MIP agr., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "MIP agr."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: pairw. Lev.
Dataset subset: HER2-VH reference holdout, 200 homologs
24.7 Levenshtein distance (mean pairwise Levenshtein distance within the generated set, pooled over templates)
count · unknown

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, pairw. Lev., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "pairw. Lev."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: pairw. Lev.
Dataset subset: Ty1 reference holdout, 200 homologs
24.5 Levenshtein distance (mean pairwise Levenshtein distance within the generated set, pooled over templates)
count · unknown

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, pairw. Lev., 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "pairw. Lev."
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: prof. LL
Dataset subset: HER2-VH reference holdout, 200 homologs
-59 Log likelihood (profile log-likelihood of the generated sequences under the family alignment profile)
unitless · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, prof. LL, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "prof. LL"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: prof. LL
Dataset subset: Ty1 reference holdout, 200 homologs
-64 Log likelihood (profile log-likelihood of the generated sequences under the family alignment profile)
unitless · higher

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, prof. LL, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "prof. LL"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: MMD
Dataset subset: HER2-VH reference holdout, 200 homologs
1.02 Maximum mean discrepancy (k-mer spectrum MMD between the generated set and a 200-sequence natural holdout, unnormalised)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on HER2-VH, MMD, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "her2vh", row "EditJumps", column "MMD"
Configuration: EditJumps editor, clock normalisation 40Protocol: EditJumps section 4.2 frame, 200 references: MMD
Dataset subset: Ty1 reference holdout, 200 homologs
0.98 Maximum mean discrepancy (k-mer spectrum MMD between the generated set and a 200-sequence natural holdout, unnormalised)
unitless · lower

Uncertainty: Not reported by the source: The table prints a single value with no interval.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

EditJumps on Ty1, MMD, 200 references

One frame for every arm and both families: 20 templates per family and 20 variants per template, so 400 generated sequences, scored against a 200-sequence held-out natural homolog set, with the agreement ceiling computed on 300 real homologs. Sampling runs Euler tau-leaping over 50 steps. Every arm is held to a matched realised edit budget of about 4 to 5 edits per sequence.

Aggregation: Not reported

When Edit Flows are Edit Jumps: replicating Edit Flows and EvoFlows (arXiv v1) · Table 2, family block "ty1", row "EditJumps", column "MMD"

Source checking is not independent reproduction. Release 2026-11-21-c8bea25e5abb.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID editjumps-20261115-config-editjumps-clock-40.

Source locator: Section 3 'Architecture and training protocol' and 'Supervision discrepancies and deviations'; Figure 2 ('ours: 40'); Appendix B item 1; Appendix D 'Training Protocol and Compute Resources'

Related records

How to cite

EditJumps editor, clock normalisation 40. Rewire biological model benchmark database, release 2026-11-21-c8bea25e5abb. https://benchmarks.rewirebio.io/database/configuration/editjumps-20261115-config-editjumps-clock-40/

Release 2026-11-21-c8bea25e5abb. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction