rewire.itbenchmarks
Task

DNA-binding residue prediction

DNA-binding residue prediction uses published protein-sequence training and independent test collections.

SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

1 evaluation · 1 result

Overview

Datasets

DNA-573_Train, DNA-129_Test and DNA-181_Test from prior binding-site benchmarks.

Metrics

AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.

Allowed inputs

Protein representations for residue-level prediction.

SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
Evaluation procedure diagram
How it worksComputational evaluation flow
Computational evaluation flow1. Input: Protein representations for residue-level prediction.. Then: 2. Evaluation: Supervised binding-site prediction on the published training set.. Then: 3. Readout: AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.Computational evaluation flow1. Input: Protein representations for residue-level prediction.. Then: 2. Evaluation: Supervised binding-site prediction on the published training set.. Then: 3. Readout: AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.Computational evaluation flow1. Input: Protein representations for residue-level prediction.. Then: 2. Evaluation: Supervised binding-site prediction on the published training set.. Then: 3. Readout: AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.

Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.

SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Pipeline: MegSite + ESM3Task: DNA-binding residue prediction
Dataset: DNA-129_Test
0.948 AUC
fraction · unknown

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

MegSite + ESM3: DNA-binding residue prediction

ESM3 multimodal embedding ablation in MegSite

Aggregation: Not reported

MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Table 2, DNA-129_Test / ESM3 row, AUC column

Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

DNA-573_Train, DNA-129_Test and DNA-181_Test from prior binding-site benchmarks. Published training/test collections are maintained and similarity filtering is applied. AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported. ESM2, ProtTrans, ProteinBERT and ESM3 embedding variants evaluated on the same named residue-label test collections. The source describes a 30% sequence-identity clustering cutoff between training and test sequences. The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.

SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Strengths and limitations

Strengths and considerations

No source-reviewed explanatory claims are recorded here yet.

Profile review details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Stable record: reported-task-9917a0e69f33e7

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
PropertyDescription and evidence
DatasetsDNA-573_Train, DNA-129_Test and DNA-181_Test from prior binding-site benchmarks.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
SplitsPublished training/test collections are maintained and similarity filtering is applied.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
MetricsAUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
BaselinesESM2, ProtTrans, ProteinBERT and ESM3 embedding variants evaluated on the same named residue-label test collections.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
Leakage controlsThe source describes a 30% sequence-identity clustering cutoff between training and test sequences.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
UncertaintyThe cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim. · Not reported in inspected sources
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
Entity typePaper-specific computational evaluation protocol.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
OrganismsThe DNA-binding test uses the GraphBind/GraphSite DNA protein collections. The benchmark-data section and Table 1 describe proteins and residue labels without a species inventory; the separate RNA-binding collections do not define this task’s taxa. · Not reported in inspected sources
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Benchmark datasets and Table 1
AssaysCurated DNA-binding residue labels.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
Allowed inputsProtein representations for residue-level prediction.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions
AdaptationSupervised binding-site prediction on the published training set.
SourcesMegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model · Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Primary-source discovery and table/protocol screening; source checked is not independently reproduced. Raw acquisitions not automatically numerical publication approval.

Paper or primary resourceVersionReference
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language modeljournal full text in PMCRead source
DOI: 10.1093/bib/bbaf524
Historical gaps recorded on 2026-09-17

The catalogue now holds 1 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

  • Complete raw table acquired. Assigned benchmark is DNA-binding; RNA cohorts need distinct protocols. PCC-to-MegSite agreement and associatedPvalues are not predictive performance. Structured extraction pending.
Search and extraction details

source found structured extraction pending

Searches

  • MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model primary paper benchmark results

Evidence locations

  • Table3 DNA129/DNA181/RNA117/RNA285 comparison

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

17 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • Input: Protein representations for residue-level prediction.
  • Evaluation: Supervised binding-site prediction on the published training set.
  • Readout: AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Computational evaluation flow
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.diagram.title

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Datasets
DNA-573_Train, DNA-129_Test and DNA-181_Test from prior binding-site benchmarks.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Splits
Published training/test collections are maintained and similarity filtering is applied.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Adaptation
Supervised binding-site prediction on the published training set.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Metrics
AUC, average precision and MCC are central comparison metrics; specificity and precision are also reported.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Baselines
ESM2, ProtTrans, ProteinBERT and ESM3 embedding variants evaluated on the same named residue-label test collections.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Leakage controls
The source describes a 30% sequence-identity clustering cutoff between training and test sequences.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

source checked

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Uncertainty
The cited text-accessible evaluation sections give no confidence-interval, resampling or repeat-run error-bar specification. Image-only tables and uninspected supplements are outside this absence claim.
Individual claims
MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model

Original source ↗

Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions

Version: journal full text in PMC
Retrieved: 2026-09-16T10:38:57.558213+00:00

unreported

automated source review · 2026-09-16

Audit details

Relevant full-paper computational evaluation sections, tables/captions and cited supplementary task passages were reviewed. Reporting omissions are scoped to the inspected sources. Original numerical results are unchanged.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: 10d13122331813243d83b84fe6f9294eac7e7c03cde082ebed276191ac41089c

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: needs review

2 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: reported-task-9917a0e69f33e7

areas
proteins-complexes
tasks
DNA-binding residue prediction
entity level
task
version
Not reported
task
DNA-binding residue prediction
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
benchmark research
review date: 2026-09-17; status: source_found_structured_extraction_pending; primary sources: evidence-expansion-p2-megsite-2025-10d131223318; inspected locators: Table3 DNA129/DNA181/RNA117/RNA285 comparison; searched queries: MegSite: an accurate nucleic acid-binding residue prediction method based on multimodal protein language model primary paper benchmark results; gaps: Complete raw table acquired. Assigned benchmark is DNA-binding; RNA cohorts need distinct protocols. PCC-to-MegSite agreement and associatedPvalues are not predictive performance. Structured extraction pending.; claim scope: Primary-source discovery and table/protocol screening; source checked is not independently reproduced. Raw acquisitions not automatically numerical publication approval.
historical missing metadata
protocol version: not_reported_in_legacy_extract
metadata review scope
historical_missing_metadata preserves the original discovery state. Current descriptive evidence and missingness are recorded in profile.facts; numerical-result review is separate.
legacy kinds
benchmark
entity classification
review date: 2026-09-17; rationale: This source-scoped record identifies the biological prediction task and holds its paper context. Preserve the existing task identity; exact split, model adaptation and scoring remain in linked evaluations or separate protocol records.; source ids: megsite-2025; source locator: Methods: Benchmark datasets; Results; cached text lines 9–10, 63; matching task comparison table/ablation captions; ambiguities: A paper- or suite-specific task may constrain some inputs or metrics; that alone does not make it interchangeable with a complete versioned protocol. No protocol equivalence is inferred.; Some legacy profile Entity type facts use the generic phrase computational evaluation protocol. That boilerplate is not sufficient to establish a single fixed protocol identity or to merge this task with another protocol record.
Related records

Suggest a correction