rewirebio.iobenchmarks
Result

Top-50 accuracy (retrieval) of MIST contrastive on MIST CANOPUS benchmark test set used in DreaMS Extended Data Table 1 (MIST CANOPUS retrieval split)

81.3% Top-50 accuracy (retrieval)

Methods

Tested configuration
MIST contrastive
Protocol
MIST CANOPUS retrieval Top 50: MIST CANOPUS fingerprint retrieval: Top 50
Dataset subset
MIST CANOPUS benchmark test set used in DreaMS Extended Data Table 1 (MIST CANOPUS retrieval split)
Procedure
MIST CANOPUS PubChem candidate retrieval; candidate positives share true molecule InChIKey first14 characters, negatives share molecular formula; rank cosine similarity of predicted and candidate fingerprints; accuracy@k is fraction of spectra with positive candidate in top k, printed as percent. Full test set named in Extended Data Table 1; exact split version/hash unextracted; 8000 spectra/7000 molecules describes total benchmark, not confirmed test denominator.
Evaluation
MIST contrastive on MIST CANOPUS retrieval Top 50: MIST CANOPUS fingerprint retrieval: Top 50
Coverage
Not reported scored / Not reported eligible
Uncertainty
Not yet extracted
Evidence
Source does not say who ran the evaluation · source checkeddreams: Journal full-text XML · Extended Data Table 1 (XML Tab1), row MIST contrastive, column Top 50

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split
Not reported
Adaptation
Not reported
Scoring implementation
Retrieval accuracy@50

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Reported result
81.255
Individual claims
dreams: Journal full-text XML

Original source ↗

Extended Data Table 1 (XML Tab1), row MIST contrastive, column Top 50

Version: Retrieved page snapshot; no immutable publisher revision supplied
Retrieved: 2026-09-16T19:53:03.200000+00:00

source checked

["deterministic-table-parse","independent-cell-check"] · 2026-09-23

unreported

Audit details

Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.

Field: attributes.printed_value

Source artifact SHA-256: 4bbe2ecff0ad75944b3aec5131369c1b2f75ff6f4b5dc257487a274fdd7b0fef

Hash scope: SHA-256 of retrieved original artifact bytes

Format: original_artifact

Inspected artifact

Extraction artifact SHA-256: 4bbe2ecff0ad75944b3aec5131369c1b2f75ff6f4b5dc257487a274fdd7b0fef

Extraction artifact

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: dreams-mist-retrieval-result-mist-contrastive-top-50-accuracy-at-50

areas
metabolomics
tasks
MIST CANOPUS fingerprint retrieval: Top 50
metric
top-50-accuracy
metric direction
higher
unit
percent
printed value
81.255
numeric value
81.255
source locator
Extended Data Table 1 (XML Tab1), row MIST contrastive, column Top 50
missing metadata
denominator: reason: unextracted; seeds: reason: unreported; uncertainty: reason: unextracted
review
method: deterministic-table-parse; independent-cell-check; reviewer: unidentified-automated-reviewer; date: 2026-09-23; artifact sha256: 4bbe2ecff0ad75944b3aec5131369c1b2f75ff6f4b5dc257487a274fdd7b0fef; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13090125/fullTextXML; method note: XML table; independent row/column count and exact-string verification against the pinned primary article; not model execution; reviewer note: automated-source-review; note: Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.
metric qualifier
retrieval
Related records

Suggest a correction