rewirebio.iobenchmarks
Source

MassSpecGym: A benchmark for the discovery and identification of molecules

2410.23326v1

Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
DeepSets (formula)Top-1 accuracy (retrieval)4.42 (3.92-4.97) percentMassSpecGym · formulaDeepSets (formula): MassSpecGym · formula
DeepSets (formula)Top-1 MCES (retrieval)15.04 (14.89-15.19) unitlessMassSpecGym · formulaDeepSets (formula): MassSpecGym · formula
DeepSets (formula)Top-5 accuracy (retrieval)14.46 (13.58-15.36) percentMassSpecGym · formulaDeepSets (formula): MassSpecGym · formula
DeepSets (formula)Top-20 accuracy (retrieval)30.76 (29.67-31.93) percentMassSpecGym · formulaDeepSets (formula): MassSpecGym · formula
DeepSets (main)Top-1 accuracy (retrieval)1.47 (1.18-1.77) percentMassSpecGym · mainDeepSets (main): MassSpecGym · main
DeepSets (main)Top-1 MCES (retrieval)25.11 (24.84-25.39) unitlessMassSpecGym · mainDeepSets (main): MassSpecGym · main
DeepSets (main)Top-5 accuracy (retrieval)6.21 (5.64-6.82) percentMassSpecGym · mainDeepSets (main): MassSpecGym · main
DeepSets (main)Top-20 accuracy (retrieval)19.23 (18.24-20.26) percentMassSpecGym · mainDeepSets (main): MassSpecGym · main
DeepSets + Fourier features (formula)Top-1 accuracy (retrieval)6.56 (5.95-7.16) percentMassSpecGym · formulaDeepSets + Fourier features (formula): MassSpecGym · formula
DeepSets + Fourier features (formula)Top-1 MCES (retrieval)14.14 (13.98-14.31) unitlessMassSpecGym · formulaDeepSets + Fourier features (formula): MassSpecGym · formula
DeepSets + Fourier features (formula)Top-5 accuracy (retrieval)16.46 (15.58-17.35) percentMassSpecGym · formulaDeepSets + Fourier features (formula): MassSpecGym · formula
DeepSets + Fourier features (formula)Top-20 accuracy (retrieval)33.46 (32.39-34.59) percentMassSpecGym · formulaDeepSets + Fourier features (formula): MassSpecGym · formula
DeepSets + Fourier features (main)Top-1 accuracy (retrieval)5.24 (4.71-5.83) percentMassSpecGym · mainDeepSets + Fourier features (main): MassSpecGym · main
DeepSets + Fourier features (main)Top-1 MCES (retrieval)22.13 (21.85-22.43) unitlessMassSpecGym · mainDeepSets + Fourier features (main): MassSpecGym · main
DeepSets + Fourier features (main)Top-5 accuracy (retrieval)12.58 (11.80-13.42) percentMassSpecGym · mainDeepSets + Fourier features (main): MassSpecGym · main
DeepSets + Fourier features (main)Top-20 accuracy (retrieval)28.21 (27.10-29.36) percentMassSpecGym · mainDeepSets + Fourier features (main): MassSpecGym · main
FFN Fingerprint (formula)Jensen shannon similarity- unitlessMassSpecGym · formulaFFN Fingerprint (formula): MassSpecGym · formula
FFN Fingerprint (formula)Spectrum cosine similarity- unitlessMassSpecGym · formulaFFN Fingerprint (formula): MassSpecGym · formula
FFN Fingerprint (formula)Top-1 accuracy (retrieval; candidates ranked by simulated spectra)7.62 (6.77-8.54) percentMassSpecGym · formulaFFN Fingerprint (formula): MassSpecGym · formula
FFN Fingerprint (formula)Top-5 accuracy (retrieval; candidates ranked by simulated spectra)22.70 (21.32-24.12) percentMassSpecGym · formulaFFN Fingerprint (formula): MassSpecGym · formula
FFN Fingerprint (formula)Top-20 accuracy (retrieval; candidates ranked by simulated spectra)44.12 (42.51-45.75) percentMassSpecGym · formulaFFN Fingerprint (formula): MassSpecGym · formula
FFN Fingerprint (main)Jensen shannon similarity0.48 (0.47-0.48) unitlessMassSpecGym · mainFFN Fingerprint (main): MassSpecGym · main
FFN Fingerprint (main)Spectrum cosine similarity0.25 (0.24-0.26) unitlessMassSpecGym · mainFFN Fingerprint (main): MassSpecGym · main
FFN Fingerprint (main)Top-1 accuracy (retrieval; candidates ranked by simulated spectra)8.44 (7.56-9.34) percentMassSpecGym · mainFFN Fingerprint (main): MassSpecGym · main
FFN Fingerprint (main)Top-5 accuracy (retrieval; candidates ranked by simulated spectra)21.43 (20.10-22.79) percentMassSpecGym · mainFFN Fingerprint (main): MassSpecGym · main
FFN Fingerprint (main)Top-20 accuracy (retrieval; candidates ranked by simulated spectra)38.57 (36.99-40.23) percentMassSpecGym · mainFFN Fingerprint (main): MassSpecGym · main
Fingerprint FFN (formula)Top-1 accuracy (retrieval)5.09 (4.57-5.66) percentMassSpecGym · formulaFingerprint FFN (formula): MassSpecGym · formula
Fingerprint FFN (formula)Top-1 MCES (retrieval)14.94 (14.79-15.09) unitlessMassSpecGym · formulaFingerprint FFN (formula): MassSpecGym · formula
Fingerprint FFN (formula)Top-5 accuracy (retrieval)14.69 (13.83-15.56) percentMassSpecGym · formulaFingerprint FFN (formula): MassSpecGym · formula
Fingerprint FFN (formula)Top-20 accuracy (retrieval)31.97 (30.86-33.10) percentMassSpecGym · formulaFingerprint FFN (formula): MassSpecGym · formula
Fingerprint FFN (main)Top-1 accuracy (retrieval)2.54 (2.17-2.99) percentMassSpecGym · mainFingerprint FFN (main): MassSpecGym · main
Fingerprint FFN (main)Top-1 MCES (retrieval)24.66 (24.38-24.94) unitlessMassSpecGym · mainFingerprint FFN (main): MassSpecGym · main
Fingerprint FFN (main)Top-5 accuracy (retrieval)7.59 (6.96-8.28) percentMassSpecGym · mainFingerprint FFN (main): MassSpecGym · main
Fingerprint FFN (main)Top-20 accuracy (retrieval)20.00 (19.01-20.98) percentMassSpecGym · mainFingerprint FFN (main): MassSpecGym · main
FraGNNet (formula)Jensen shannon similarity- unitlessMassSpecGym · formulaFraGNNet (formula): MassSpecGym · formula
FraGNNet (formula)Spectrum cosine similarity- unitlessMassSpecGym · formulaFraGNNet (formula): MassSpecGym · formula
FraGNNet (formula)Top-1 accuracy (retrieval; candidates ranked by simulated spectra)31.93 (30.40-33.50) percentMassSpecGym · formulaFraGNNet (formula): MassSpecGym · formula
FraGNNet (formula)Top-5 accuracy (retrieval; candidates ranked by simulated spectra)63.20 (61.64-64.76) percentMassSpecGym · formulaFraGNNet (formula): MassSpecGym · formula
FraGNNet (formula)Top-20 accuracy (retrieval; candidates ranked by simulated spectra)82.70 (81.45-83.93) percentMassSpecGym · formulaFraGNNet (formula): MassSpecGym · formula
FraGNNet (main)Jensen shannon similarity0.63 (0.63-0.64) unitlessMassSpecGym · mainFraGNNet (main): MassSpecGym · main
FraGNNet (main)Spectrum cosine similarity0.52 (0.51-0.53) unitlessMassSpecGym · mainFraGNNet (main): MassSpecGym · main
FraGNNet (main)Top-1 accuracy (retrieval; candidates ranked by simulated spectra)46.64 (44.98-48.26) percentMassSpecGym · mainFraGNNet (main): MassSpecGym · main
FraGNNet (main)Top-5 accuracy (retrieval; candidates ranked by simulated spectra)72.56 (71.18-74.00) percentMassSpecGym · mainFraGNNet (main): MassSpecGym · main
FraGNNet (main)Top-20 accuracy (retrieval; candidates ranked by simulated spectra)83.58 (82.34-84.75) percentMassSpecGym · mainFraGNNet (main): MassSpecGym · main
GNN (formula)Jensen shannon similarity- unitlessMassSpecGym · formulaGNN (formula): MassSpecGym · formula
GNN (formula)Spectrum cosine similarity- unitlessMassSpecGym · formulaGNN (formula): MassSpecGym · formula
GNN (formula)Top-1 accuracy (retrieval; candidates ranked by simulated spectra)3.63 (3.05-4.29) percentMassSpecGym · formulaGNN (formula): MassSpecGym · formula
GNN (formula)Top-5 accuracy (retrieval; candidates ranked by simulated spectra)13.55 (12.46-14.68) percentMassSpecGym · formulaGNN (formula): MassSpecGym · formula
GNN (formula)Top-20 accuracy (retrieval; candidates ranked by simulated spectra)33.77 (32.26-35.37) percentMassSpecGym · formulaGNN (formula): MassSpecGym · formula
GNN (main)Jensen shannon similarity0.44 (0.44-0.45) unitlessMassSpecGym · mainGNN (main): MassSpecGym · main

Claims

Statements this source supports, each with where in the source it was checked.

Models, benchmarks and other records

Configurations (24)

Benchmarks (1)

Tasks (3)

Protocols (6)

Datasets (6)

Evaluations (24)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

15 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Artifact SHA-256
82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Artifact url
https://arxiv.org/pdf/2410.23326v1
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Hash scope
Exact retrieved primary paper artifact bytes.
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Retrieved at
2026-09-17T07:56:11.146650+00:00
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.retrieved_at

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review method
1 values
  • automated-source-review
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.method

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Review: scope
Source identification and table transcription; no independent experimental reproduction.
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.review.scope

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Url
https://arxiv.org/pdf/2410.23326v1
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.url

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Version
2410.23326v1
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Description
Primary reference; inspect retrieval status and review scope.
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: description

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

Search facets
None recorded
Source metadata
MassSpecGym: A benchmark for the discovery and identification of molecules

Original source ↗

No field-specific location recorded

Version: 2410.23326v1
Retrieved: 2026-09-17T07:56:11.146650+00:00

catalogued

No individual claim review recorded

Audit details

Field: facets

Source artifact SHA-256: 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c

Hash scope: Exact retrieved primary paper artifact bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Primary reference; inspect retrieval status and review scope.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: part2-massspecgym-arxiv-v1

url
https://arxiv.org/pdf/2410.23326v1
version
2410.23326v1
retrieved at
2026-09-17T07:56:11.146650+00:00
artifact sha256
82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c
artifact url
https://arxiv.org/pdf/2410.23326v1
hash scope
Exact retrieved primary paper artifact bytes.
review
scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review
Related records

    Suggest a correction