rewirebio.iobenchmarks
Configuration

Caduceus-PS 131k, 256 model dimensions, 16 layers

The parameter-shared Caduceus checkpoint with a 131 kb sequence length, 256 model dimensions and 16 layers, scored by its bidirectional likelihoods without transformation.

12 evaluations · 12 results5 open disagreements between studies involve its model

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Model Capabilities & Hardware Requirements

Deployment facts recorded for Caduceus-PS 131k, 256 model dimensions, 16 layers. Fields the record does not carry are marked not recorded.

ParametersNot recorded
Minimum VRAMNot recorded
Inference LatencyNot recorded
Context WindowNot recorded
AccessNot recorded
LicenseNot recorded

Evaluated Checkpoint: caduceus-ps_seqlen-131k_d_model-256_n_layer-16

Evaluations and results

12 evaluations · 12 results. Different protocols are not a single leaderboard.

Protocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class

Sorted by AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class 3’ UTR) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class 3’ UTR)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class 5’ UTR)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Downstream of Transcript)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Intronic)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Missense)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Noncoding)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Splice Acceptor)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Splice Donor)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Start Codon)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Stop Lost)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Synonymous)AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Upstream of Transcript)
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar 3’ UTR variants, at least one review star0.63Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Downstream of Transcript variants, at least one review starNot reportedNot reported0.72Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Intronic variants, at least one review starNot reportedNot reportedNot reported0.64Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Missense variants, at least one review starNot reportedNot reportedNot reportedNot reported0.55Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Noncoding variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reported0.59Not reportedNot reportedNot reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Splice Acceptor variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.61Not reportedNot reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Splice Donor variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.68Not reportedNot reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Start Codon variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.41Not reportedNot reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Stop Lost variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.43Not reportedNot reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Synonymous variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.55Not reported
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar Upstream of Transcript variants, at least one review starNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported0.4
Caduceus-PS 131k, 256 model dimensions, 16 layersEvaluationClinVar 5’ UTR variants, at least one review starNot reported0.61Not reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reportedNot reported
All 12 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Downstream of Transcript variants, at least one review star
0.72 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Downstream of Transcript)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Downstream of Transcript variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Downstream of Transcript', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Intronic variants, at least one review star
0.64 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Intronic)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Intronic variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Intronic', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Missense variants, at least one review star
0.55 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Missense)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Missense variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Missense', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Noncoding variants, at least one review star
0.59 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Noncoding)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Noncoding variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Noncoding', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Splice Acceptor variants, at least one review star
0.61 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Splice Acceptor)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Splice Acceptor variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Splice Acceptor', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Splice Donor variants, at least one review star
0.68 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Splice Donor)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Splice Donor variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Splice Donor', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Start Codon variants, at least one review star
0.41 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Start Codon)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Start Codon variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Start Codon', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Stop Lost variants, at least one review star
0.43 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Stop Lost)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Stop Lost variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Stop Lost', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Synonymous variants, at least one review star
0.55 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Synonymous)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Synonymous variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Synonymous', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar Upstream of Transcript variants, at least one review star
0.4 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class Upstream of Transcript)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar Upstream of Transcript variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row 'Upstream of Transcript', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar 3’ UTR variants, at least one review star
0.63 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class 3’ UTR)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar 3’ UTR variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row '3’ UTR', column 'Caduceus'
Configuration: Caduceus-PS 131k, 256 model dimensions, 16 layersProtocol: ClinVar pathogenic versus benign classification from likelihood ratios, AUROC by variant class
Dataset subset: ClinVar 5’ UTR variants, at least one review star
0.61 AUROC (ClinVar pathogenic or likely pathogenic versus benign or likely benign, zero-shot allele log likelihood ratio, class 5’ UTR)
unitless · higher

Uncertainty: Not reported by the source: Table 1 prints no interval or spread.

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

Caduceus on ClinVar 5’ UTR variants, likelihood-ratio scoring

phylogpn-20261116-protocol-clinvar-llr-auroc

Aggregation: Not reported

A Phylogenetic Approach to Genomic Language Modeling · Table 1, row '5’ UTR', column 'Caduceus'

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID phylogpn-20261116-config-caduceus-ps-131k.

Source locator: Appendix A.2, Computation of Log Likelihood Ratios (paragraph 4)

Related records

How to cite

Caduceus-PS 131k, 256 model dimensions, 16 layers. Rewire biological model benchmark database, release 2026-11-21-adc15377fab2. https://benchmarks.rewirebio.io/database/configuration/phylogpn-20261116-config-caduceus-ps-131k/

Release 2026-11-21-adc15377fab2. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.

The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence

Suggest a correction