rewire.itbenchmarks
Task

A-to-I RNA editing site prediction

An RNA editing-site classifier is compared with sequence-model baselines on held-out human liver annotations.

SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

1 evaluation · 1 result

Overview

Datasets

GTEx liver RNA-seq annotations in Alu-associated regions; labels distinguish editing levels.

Metrics

Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.

Allowed inputs

RNA sequence around candidate editing sites.

SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
Evaluation procedure diagram
How it worksComputational evaluation flow
Computational evaluation flow1. Input: RNA sequence around candidate editing sites.. Then: 2. Evaluation: Task fine-tuning is compared with pretrained and fine-tuned RNA baselines.. Then: 3. Readout: Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.Computational evaluation flow1. Input: RNA sequence around candidate editing sites.. Then: 2. Evaluation: Task fine-tuning is compared with pretrained and fine-tuned RNA baselines.. Then: 3. Readout: Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.Computational evaluation flow1. Input: RNA sequence around candidate editing sites.. Then: 2. Evaluation: Task fine-tuning is compared with pretrained and fine-tuned RNA baselines.. Then: 3. Readout: Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.

Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.

SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

limited source coverage · Automated source review, 2026-09-16. All specifications and missing details

Results

Results are available, but no reviewed comparison panel is linked in this release.

All evaluations

1 evaluation · 1 result. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: ADAR-GPT continualTask: A-to-I RNA editing site prediction
Dataset: liver editing sites
0.763 F1
fraction · unknown

Uncertainty: Not reported

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

ADAR-GPT continual: A-to-I RNA editing site prediction

Curriculum plus 15% fine-tuning; 201-nt sequence windows; decision threshold 0.5

Aggregation: Not reported

ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Table 2, Adar-GPT (continual) row, F1 column

Source checking is not independent reproduction. Release 2026-09-29-06401fd5b220.

Methods and evaluation design

Procedure, tasks and evaluated configurations

How it works

Evaluation methodology

GTEx liver RNA-seq annotations in Alu-associated regions; labels distinguish editing levels. Random 80:20 splits within disjoint site groups; final comparisons use the held-out highest-threshold validation group. Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC. Static fine-tuning, pretrained and fine-tuned EditPredict, and fine-tuned RNA-FM. Editing sites are assigned to nonoverlapping groups. Independence of overlapping sequence windows or donors was not established in this review. Five inference repeats quantify prediction variability; they do not measure variability across retraining or independent cohorts.

SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Strengths, limitations and unresolved questions

Strengths and limitations

Strengths and considerations

No source-reviewed explanatory claims are recorded here yet.

Profile review details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Stable record: reported-task-d635fc6c281a27

Specifications

Inputs, training, access and other details

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.

Data, procedure and scoring
PropertyDescription and evidence
DatasetsGTEx liver RNA-seq annotations in Alu-associated regions; labels distinguish editing levels.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
SplitsRandom 80:20 splits within disjoint site groups; final comparisons use the held-out highest-threshold validation group.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
MetricsAccuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
BaselinesStatic fine-tuning, pretrained and fine-tuned EditPredict, and fine-tuned RNA-FM.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
Leakage controlsEditing sites are assigned to nonoverlapping groups. Independence of overlapping sequence windows or donors was not established in this review.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
UncertaintyFive inference repeats quantify prediction variability; they do not measure variability across retraining or independent cohorts.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
Entity typePaper-specific computational evaluation protocol.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
OrganismsHuman liver.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
AssaysRNA-seq editing annotations in Alu-associated regions.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
Allowed inputsRNA sequence around candidate editing sites.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110
AdaptationTask fine-tuning is compared with pretrained and fine-tuned RNA baselines.
SourcesADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites · Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Papers and result coverage

Last literature check: 2026-09-17. Primary-paper discovery and source inspection. Source-checked results are not independently reproduced experiments.

Paper or primary resourceVersionReference
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sitesversion of recordRead source
DOI: 10.1073/pnas.2529073123
Historical gaps recorded on 2026-09-17

The catalogue now holds 1 result rows for this benchmark. A note below about pending extraction describes the state on 2026-09-17 and may since have been answered by a later batch. The result rows and their sources are the current record.

  • This is validation-set reporting, not a cleanly identified untouched test set.
  • Table 2 calls it the '15% liver validation set', while methods describe held-out 20% validation; retain wording and resolve data partition before external ranking.
  • No uncertainty in the table.
Search and extraction details

primary comparison table screened

Searches

  • "PMC12798952"

Evidence locations

  • Table 2 and caption
  • Methods: Evaluation and Reproducibility

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

17 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Diagram caption
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.caption

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram steps
  • Input: RNA sequence around candidate editing sites.
  • Evaluation: Task fine-tuning is compared with pretrained and fine-tuned RNA baselines.
  • Readout: Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.steps

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Diagram title
Computational evaluation flow
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.diagram.title

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Datasets
GTEx liver RNA-seq annotations in Alu-associated regions; labels distinguish editing levels.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.0.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Splits
Random 80:20 splits within disjoint site groups; final comparisons use the held-out highest-threshold validation group.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.1.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Adaptation
Task fine-tuning is compared with pretrained and fine-tuned RNA baselines.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.10.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Metrics
Accuracy, precision, recall, specificity and F1; probability-based AUROC and AUPRC.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.2.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Baselines
Static fine-tuning, pretrained and fine-tuned EditPredict, and fine-tuned RNA-FM.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.3.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Leakage controls
Editing sites are assigned to nonoverlapping groups. Independence of overlapping sequence windows or donors was not established in this review.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.4.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Uncertainty
Five inference repeats quantify prediction variability; they do not measure variability across retraining or independent cohorts.
Individual claims
ADAR-GPT: A continually fine-tuned language model for predicting A-to-I RNA editing sites

Original source ↗

Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110

Version: version of record
Retrieved: 2026-09-16T10:41:06Z

source checked

automated source review · 2026-09-16

Audit details

Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced.

Field: attributes.profile.facts.5.value

Source artifact SHA-256: cc8c7eb928f246f1f347a8822f614cd3475381c35eef6d579032ce441580198e

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: needs review

2 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: reported-task-d635fc6c281a27

areas
rna-transcriptomes
tasks
A-to-I RNA editing site prediction
entity level
task
version
Not reported
task
A-to-I RNA editing site prediction
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
benchmark research
review date: 2026-09-17; status: primary_comparison_table_screened; primary sources: expansion-p3-adar-gpt-editing-2026; inspected locators: Table 2 and caption; Methods: Evaluation and Reproducibility; searched queries: "PMC12798952"; gaps: This is validation-set reporting, not a cleanly identified untouched test set.; Table 2 calls it the '15% liver validation set', while methods describe held-out 20% validation; retain wording and resolve data partition before external ranking.; No uncertainty in the table.; claim scope: Primary-paper discovery and source inspection. Source-checked results are not independently reproduced experiments.
historical missing metadata
protocol version: not_reported_in_legacy_extract
metadata review scope
historical_missing_metadata preserves the original discovery state. Current descriptive evidence and missingness are recorded in profile.facts; numerical-result review is separate.
legacy kinds
benchmark
entity classification
review date: 2026-09-17; rationale: This source-scoped record identifies the biological prediction task and holds its paper context. Preserve the existing task identity; exact split, model adaptation and scoring remain in linked evaluations or separate protocol records.; source ids: adar-gpt-editing-2026; source locator: Methods: Dataset Construction and Annotation; Dataset Design and Labeling; Evaluation and Reproducibility; Table 2; cached text lines 91–110; ambiguities: A paper- or suite-specific task may constrain some inputs or metrics; that alone does not make it interchangeable with a complete versioned protocol. No protocol equivalence is inferred.; Some legacy profile Entity type facts use the generic phrase computational evaluation protocol. That boilerplate is not sufficient to establish a single fixed protocol identity or to merge this task with another protocol record.
Related records

Suggest a correction