rewirebio.iobenchmarks
Evidence claim

use-case-diagnostic-genomics-model-execution: attributes.decision

Decision of Select an execution workflow for large-scale diagnostic genomics

Compare published per-sample runtime and cost of CPU, GPU and DRAGEN server execution set-ups that resemble the team's hardware and sequencing type when budgeting a workflow; most are conventional variant-calling pipelines, the two active foundation-model benchmarks (inference on microbial genomes; fine-tuning and test-set scoring on human eQTL variants) are outside any diagnostic workflow, and none measures run-to-run concordance of variant calls.

Updated for the Hegde et al. 2025 judgements that became active in PR #169, which make a second linked foundation-model study, and for the newly linked withheld and outside-scope studies. Historical releases retain the previous value.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

7 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-22-1b7cf027e4f6
Property and statementOriginal source and locationReview and provenance
Claimed field
attributes.decision
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.field

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Previous value
Compare published per-sample runtime and cost of CPU, GPU and DRAGEN server execution set-ups that resemble the team's hardware and sequencing type when budgeting a workflow; most are conventional variant-calling pipelines, the one active foundation-model inference benchmark is outside any diagnostic workflow, and none measures run-to-run concordance of variant calls.
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.previous_value

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Source location
Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Claimed value
Compare published per-sample runtime and cost of CPU, GPU and DRAGEN server execution set-ups that resemble the team's hardware and sequencing type when budgeting a workflow; most are conventional variant-calling pipelines, the two active foundation-model benchmarks (inference on microbial genomes; fine-tuning and test-set scoring on human eQTL variants) are outside any diagnostic workflow, and none measures run-to-run concordance of variant calls.
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.value

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Description
Updated for the Hegde et al. 2025 judgements that became active in PR #169, which make a second linked foundation-model study, and for the newly linked withheld and outside-scope studies. Historical releases retain the previous value.
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Relationship: subject
use-case-diagnostic-genomics-model-execution
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: links:subject:use-case-diagnostic-genomics-model-execution

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Name
use-case-diagnostic-genomics-model-execution: attributes.decision
Context-only references
Reaping the Fruits of LLM Pruning: Towards Small Language Models for Efficient Non-Coding Variant Effect Prediction

Original source ↗

Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope

Version: Genes 16(11):1358, 2025; PMC12652071 full-text XML
Retrieved: 2026-10-14T12:48:26Z

not individually reviewed

No individual claim review recorded

Audit details

Field: name

Source artifact SHA-256: 9ea68b688637b40f0aeced7c905822f6b14c352a3a935c61c407945f3d66ef47

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-22-1b7cf027e4f6 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: metadata-correction-gfm-guide-20261014-execution-decision

field
attributes.decision
previous value
Compare published per-sample runtime and cost of CPU, GPU and DRAGEN server execution set-ups that resemble the team's hardware and sequencing type when budgeting a workflow; most are conventional variant-calling pipelines, the one active foundation-model inference benchmark is outside any diagnostic workflow, and none measures run-to-run concordance of variant calls.
value
Compare published per-sample runtime and cost of CPU, GPU and DRAGEN server execution set-ups that resemble the team's hardware and sequencing type when budgeting a workflow; most are conventional variant-calling pipelines, the two active foundation-model benchmarks (inference on microbial genomes; fine-tuning and test-set scoring on human eQTL variants) are outside any diagnostic workflow, and none measures run-to-run concordance of variant calls.
source locator
Store: reviewed judgements use-case-mapping-gfm-guide-20261014-hegde2025-eqtl-5-epochs and -eqtl-convergence become active; the EVEE and Nucleotide Transformer IA3 judgements are reviewed and withheld; the NTv3 and HyenaDNA judgements are outside scope
review
method: source-hash-verification; scope-review; reviewer: claude; reviewer note: Claude (Opus 5.5) review agent review-169, independent of the agent that drafted these judgements for issue #162; no human review claimed; date: 2026-10-14; note: Applied by the independent reviewer of PR #169. See docs/reviews/use-cases/diagnostic-genomics-model-execution-judgements-2026-10-14.md.
Related records

Suggest a correction