rewirebio.iobenchmarks
Task

Multi-species prokaryotic promoter detection

Multi-species promoter classification uses curated positives and genomic-background negatives.

SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

2 evaluations · 2 results

Overview

Datasets

Promoter annotations from PPD and species-matched negative sequence collections.

Metrics

Sensitivity, specificity, accuracy, MCC and ROC-AUC.

Allowed inputs

DNA sequence windows.

SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
Evaluation procedure diagram
How it worksComputational evaluation flow
Computational evaluation flow1. Input: DNA sequence windows.. Then: 2. Evaluation: Supervised promoter classification with cross-validation and an independent collection.. Then: 3. Readout: Sensitivity, specificity, accuracy, MCC and ROC-AUC.Computational evaluation flow1. Input: DNA sequence windows.. Then: 2. Evaluation: Supervised promoter classification with cross-validation and an independent collection.. Then: 3. Readout: Sensitivity, specificity, accuracy, MCC and ROC-AUC.Computational evaluation flow1. Input: DNA sequence windows.. Then: 2. Evaluation: Supervised promoter classification with cross-validation and an independent collection.. Then: 3. Readout: Sensitivity, specificity, accuracy, MCC and ROC-AUC.

Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.

SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

2 recorded evaluations, 2 metric rows. A comparison chart has not yet been validated for these results. The table retains the individual findings and their sources.

View coverage and remaining gaps across all benchmarks

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

2 evaluations · 2 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: iPro-MPTask: Multi-species prokaryotic promoter detection
Dataset: 23 independent prokaryotic promoter test sets
0.935 AUROC (mean over 23 test sets)
unitless · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

iPro-MP: Multi-species prokaryotic promoter detection

Average over independent testing sets.

Aggregation: Not reported

iPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Table 2, iPro-MP row, AUC column
Configuration: PromptTask: Multi-species prokaryotic promoter detection
Dataset: 23 independent prokaryotic promoter test sets
0.835 AUROC (mean over 23 test sets)
unitless · unknown

Uncertainty: Not yet extracted

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

Prompt: Multi-species prokaryotic promoter detection

Average over the same independent testing sets.

Aggregation: Not reported

iPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Table 2, Prompt row, AUC column

Source checking is not independent reproduction. Release 2026-11-21-adc15377fab2.

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

Promoter annotations from PPD and species-matched negative sequence collections. Five-fold cross-validation is used for fitting and an independent collection for comparison. Sensitivity, specificity, accuracy, MCC and ROC-AUC. The source describes CD-HIT redundancy filtering for both classes. The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.

SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Strengths and limitations

Strengths and considerations

No source-reviewed explanatory claims are recorded here yet.

Limitations and conditions

Profile review details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Stable record: reported-task-a1151e386a3d3f

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
PropertyDescription and evidence
DatasetsPromoter annotations from PPD and species-matched negative sequence collections.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
SplitsFive-fold cross-validation is used for fitting and an independent collection for comparison.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
MetricsSensitivity, specificity, accuracy, MCC and ROC-AUC.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
BaselinesGeneric classifiers are random forest, XGBoost, logistic regression and LSTM, trained with five-fold cross-validation. Tool comparisons use Prompt, PromoterLCNN and iPro-WAEL on the same species-specific independent tests; a separate repeat uses their official five-fold training protocols.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Results: Tables 1–2; comparison with baseline classifiers and existing tools; cached paragraphs 29–37
Leakage controlsThe source describes CD-HIT redundancy filtering for both classes.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
UncertaintyThe cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim. · Not reported in inspected sources
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
Entity typePaper-specific computational evaluation protocol.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
OrganismsMultiple prokaryotic species in PPD.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
AssaysPromoter annotations and species-matched negatives.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
Allowed inputsDNA sequence windows.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72
AdaptationSupervised promoter classification with cross-validation and an independent collection.
SourcesiPro-MP: a BERT-based model to predict multiple prokaryotic promoters · Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Primary-paper discovery and source inspection. Source-checked results are not independently reproduced experiments.

Paper or primary resourceVersionReference
iPro-MP: a BERT-based model to predict multiple prokaryotic promotersversion of recordRead source
DOI: 10.1186/s13059-025-03819-9
Historical gaps recorded on 2026-09-17

The catalogue now holds 2 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

  • iPro-MP's first four scores duplicate across Tables 1–2; one result with two source occurrences.
  • Species-averaged accuracy/AUROC/AUPRC/MCC differ from pooled sample scores; retain source aggregation.
  • Runtime is seconds, lower-is-better, and hardware-dependent.
Search and extraction details

primary comparison table screened

Searches

  • "PMC12516880"

Evidence locations

  • Tables 1–3
  • Methods: Data collection and preprocessing; Performance evaluation

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

17 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-adc15377fab2
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • Input: DNA sequence windows.
  • Evaluation: Supervised promoter classification with cross-validation and an independent collection.
  • Readout: Sensitivity, specificity, accuracy, MCC and ROC-AUC.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Computational evaluation flow
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.diagram.title

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Datasets
Promoter annotations from PPD and species-matched negative sequence collections.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Splits
Five-fold cross-validation is used for fitting and an independent collection for comparison.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Adaptation
Supervised promoter classification with cross-validation and an independent collection.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Metrics
Sensitivity, specificity, accuracy, MCC and ROC-AUC.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Baselines
Generic classifiers are random forest, XGBoost, logistic regression and LSTM, trained with five-fold cross-validation. Tool comparisons use Prompt, PromoterLCNN and iPro-WAEL on the same species-specific independent tests; a separate repeat uses their official five-fold training protocols.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Results: Tables 1–2; comparison with baseline classifiers and existing tools; cached paragraphs 29–37

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Leakage controls
The source describes CD-HIT redundancy filtering for both classes.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Uncertainty
The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.
Individual claims
iPro-MP: a BERT-based model to predict multiple prokaryotic promoters

Original source ↗

Methods: Data collection and preprocessing; Performance evaluation; cached text lines 54–56, 69–72

Version: version of record
Retrieved: 2026-09-16T10:33:55.361Z

unreported

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: d21541ee1f7a168da8e4a7c0f0e133c970cbe7bc41118f43a929f08b2fd2afd1

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-adc15377fab2 · Record review: needs review

2 source records and release historyDownload this release (gzip)
Technical metadata and record identifiers

Technical metadata for this record is tracked under stable ID reported-task-a1151e386a3d3f.

Related records

Suggest a correction