Model type
Frozen DNA encoder plus fitted logistic-regression pipeline
This MFASS pipeline uses a frozen DNABERT-2 encoder with an assay-specific logistic-regression head. It is distinct from the base encoder and from end-to-end fine-tuning.
Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family.
Frozen DNA encoder plus fitted logistic-regression pipeline
Validated 170-bp assay-oriented reference/mutant pairs
MFASS splice-disruption probabilities from the fitted logistic head
Pinned public runner; model and tokenizer identities are validated against recorded artifact hashes.
Source reviewed · Automated source review, 2026-09-16. All specifications and missing details
Deployment facts recorded for DNABERT-2 117M · frozen pair embeddings. Fields the record does not carry are marked not recorded.
Evaluated Checkpoint: bee9133b83f3aedaf2bbb9013f1875515845607e
1 evaluation · 3 results. Different protocols are not a single leaderboard.
Protocol: MFASS v2 · Dataset: MFASS v2 eligible assay cohort
Sorted by AUROC (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.
| Tested configuration | AUROC | Average precision | Precision at 100 |
|---|---|---|---|
| DNABERT-2 117M · frozen pair embeddingsEvaluation | 0.55 | 0.0451 | 0.03 |
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Pipeline: DNABERT-2 117M · frozen pair embeddings | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.55 AUROC unitless · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored | Rewire evaluation · Rerun recordedMethods, coverage and sourceDNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: auroc |
| Pipeline: DNABERT-2 117M · frozen pair embeddings | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.0451 Average precision fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored | Rewire evaluation · Rerun recordedMethods, coverage and sourceDNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: average_precision |
| Pipeline: DNABERT-2 117M · frozen pair embeddings | Protocol: MFASS v2 Dataset: MFASS v2 eligible assay cohort | 0.03 Precision at 100 fraction · higher Uncertainty: Not reported by the source: Point estimate; see paired-comparison artifacts. Coverage: 8324/8324 scored | Rewire evaluation · Rerun recordedMethods, coverage and sourceDNABERT-2 117M · frozen pair embeddings on MFASS v2 Masked mean of frozen last hidden states for 170 bp reference and mutant sequences; concatenate reference and mutant-minus-reference embeddings; fixed balanced L2 logistic head trained only on the MFASS training split. Aggregation: Not reported MFASS v2 pinned rewire artifacts · benchmarks/mfass/results/dnabert2-117m-frozen-pair-logreg.json :: precision_at_100 |
Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.
Underlying model: DNABERT-2. Results on this page belong to this pipeline and its evaluated settings.
Validated 170-base reference and mutant sequences are embedded separately. Attention-mask means of final hidden states are combined as reference plus mutant-minus-reference. Standardisation and balanced L2 logistic regression are fitted only on the training arm.
Pinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed.
Stable record: rewire-model-dnabert2-117m-frozen-pair-logregExplanatory profile: source reviewed · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Model type | Frozen DNA encoder plus fitted logistic-regression pipelineSourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Architecture / procedure | Attention-mask mean pooling of last hidden states for reference and mutant sequences; concatenate reference embedding with mutant-minus-reference, scale features and fit balanced L2 logistic regression with C=0.1 on train rows only.SourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Biological inputs | Validated 170-bp assay-oriented reference/mutant pairsSourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Outputs | MFASS splice-disruption probabilities from the fitted logistic headSourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Parameters | 117M frozen DNABERT-2 encoder; the logistic head is a separate fitted component.SourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Training data / fitting | The encoder remains frozen; StandardScaler and logistic regression fit split-v2 training variants without test tuning.SourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Context limits | 170 bases per sequence; tokenizer truncation disabled.SourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Known versions / configuration | zhihan1996/DNABERT-2-117M; runner revision bee9133b83f3aedaf2bbb9013f1875515845607eSourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Access | Pinned public runner; model and tokenizer identities are validated against recorded artifact hashes.SourcesMFASS v2 run_dnabert2.py · run_dnabert2.py; module documentation, main() configuration and scoring procedure |
| Code licence | MIT for the Rewire runner at the reviewed revision. Upstream DNABERT-2: Apache 2.0. These are separate component licences.Sources (2)Rewire benchmark runner licence; MAGICS-LAB/DNABERT_2 LICENSE · LICENSE; complete MIT grant; upstream LICENSE |
| Weights licence | The official DNABERT-2-117M checkpoint repository carries Apache 2.0. The separately fitted logistic-regression artifact is not assigned an additional inferred licence.Sourceshuggingface.co/zhihan1996/DNABERT-2-117M LICENSE · LICENSE in official checkpoint repository |
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
21 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family. Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, DNABERT-2 protocol; results/dnabert2-117m-frozen-pair-logreg.json, config at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
Diagram steps
| MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, DNABERT-2 protocol; results/dnabert2-117m-frozen-pair-logreg.json, config at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Diagram title Evaluated pipeline Individual claims | MFASS v2 pinned rewire artifacts benchmarks/mfass/README.md, DNABERT-2 protocol; results/dnabert2-117m-frozen-pair-logreg.json, config at bee9133b83f3aedaf2bbb9013f1875515845607e Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Local imported data/benchmark-runs/mfass-v2.json; not the upstream repository or result-file hash |
| Model type Frozen DNA encoder plus fitted logistic-regression pipeline Individual claims | MFASS v2 run_dnabert2.py run_dnabert2.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Architecture / procedure Attention-mask mean pooling of last hidden states for reference and mutant sequences; concatenate reference embedding with mutant-minus-reference, scale features and fit balanced L2 logistic regression with C=0.1 on train rows only. Individual claims | MFASS v2 run_dnabert2.py run_dnabert2.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Weights licence The official DNABERT-2-117M checkpoint repository carries Apache 2.0. The separately fitted logistic-regression artifact is not assigned an additional inferred licence. Individual claims | huggingface.co/zhihan1996/DNABERT-2-117M LICENSE LICENSE in official checkpoint repository Version: 7bce263b15377fc15361f52cfab88f8b586abda0 | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Biological inputs Validated 170-bp assay-oriented reference/mutant pairs Individual claims | MFASS v2 run_dnabert2.py run_dnabert2.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Outputs MFASS splice-disruption probabilities from the fitted logistic head Individual claims | MFASS v2 run_dnabert2.py run_dnabert2.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Parameters 117M frozen DNABERT-2 encoder; the logistic head is a separate fitted component. Individual claims | MFASS v2 run_dnabert2.py run_dnabert2.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Training data / fitting The encoder remains frozen; StandardScaler and logistic regression fit split-v2 training variants without test tuning. Individual claims | MFASS v2 run_dnabert2.py run_dnabert2.py; module documentation, main() configuration and scoring procedure Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsPinned MFASS runner source rechecked at bee9133b83f3aedaf2bbb9013f1875515845607e. Existing numerical records and historical artifacts remain unchanged; no new run was performed. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Release 2026-11-21-adc15377fab2 · Record review: source checked
Technical metadata for this record is tracked under stable ID rewire-model-dnabert2-117m-frozen-pair-logreg.
DNABERT-2 117M · frozen pair embeddings. Rewire biological model benchmark database, release 2026-11-21-adc15377fab2. https://benchmarks.rewirebio.io/database/pipeline/rewire-model-dnabert2-117m-frozen-pair-logreg/
Release 2026-11-21-adc15377fab2. Rankings and values change between releases, so keep the release id in the citation. Cite the original publication as well for any value you reuse: each result links its source.
The compilation and annotations made by Rewire in this release are offered under CC BY 4.0; values and text taken from cited sources stay under the terms of those sources and are not covered by this licence. Data licence