| Comparison: adaptation None; the pretrained model is scored directly Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.adaptation Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: aggregation Not reported Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | missing or unspecified No individual claim review recorded author reported Audit detailsField: attributes.comparison.aggregation Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: budget Not reported Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | missing or unspecified No individual claim review recorded author reported Audit detailsField: attributes.comparison.budget Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: dataset version TAIR10.1 (GCF_000001735.4) chromosome 5 Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.dataset_version Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: inputs Reference DNA sequence in 512 bp windows; 15% of positions masked during training, the scored position masked at inference Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.inputs Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: metric implementation Exponentiation of the cross-entropy loss, as stated in the SI Appendix Table S2 caption Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.metric_implementation Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: population Positions of chromosome 5 outside repetitive elements Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.population Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: protocol id gpn-paper-20261116-protocol-test-perplexity-non-repeat Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.protocol_id Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
| Comparison: split Held-out test chromosome; chromosome 4 was the validation chromosome Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.comparison.split Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|
Limitations2 values- Reported by the authors of the model, on an evaluation they designed and ran.
- Printed in Materials and Methods, not in SI Appendix Table S2. The text says 'test perplexity of 3.13 (3.17 on nonrepeat regions)' without naming the Table S2 columns, so that these two values sit in the same two protocols as the Table S2 cells is the extractor's reading of the text, not something the paper states.
Context-only references | DNA language models are powerful predictors of genome-wide variant effects (PNAS 2023) Original source ↗ No field-specific location recorded Version: PNAS 120(44) e2311219120, published 26 October 2023; Europe PMC full text JATS XML of PMC10622914 Retrieved: 2026-11-16T00:29:00Z | not individually reviewed No individual claim review recorded author reported Audit detailsField: attributes.limitations Source artifact SHA-256: 8ff2184c07f5e6807af0b9d5103d669e1920e735ab5a4b1ea856c070077ae1e0 Hash scope: Hash scope not separately documented; inspect source record Format: JATS XML |
|---|