MassSpecGym: A benchmark for the discovery and identification of molecules
2410.23326v1
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
Claims
Statements this source supports, each with where in the source it was checked.
- Baseline: Shortlist molecular identities from tandem mass spectra: Baseline MassSpecGym DeepSets fingerprint baseline (part2-massspecgym-arxiv-v1: Section 4.1 (Random and DeepSets retrieval baselines), Supplementary (DeepSets architecture) and Table 3; uc20260930-source-msalign-v2: results tables (DeepSets rows on the MassSpecGym and SpectraVerse formula-free protocols))
- DeepSet [MSAlign v2]: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- DeepSets: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- Emb-Cos [MSAlign v2]: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- Emb-Cos: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- FFN: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- JESTR [MSAlign v2]: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- JESTR: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
- MassSpecGym · formula (MassSpecGym De novo molecule generation): links:evaluates_task:discovery-benchmark-massspecgym-de-novo-molecule-generation: Evaluates task MassSpecGym De novo molecule generation (Table 2: Top-1 accuracy, formula)
- MassSpecGym · formula (MassSpecGym De novo molecule generation): links:part_of:discovery-benchmark-massspecgym: Part of MassSpecGym (Table 2: Top-1 accuracy, formula)
- MassSpecGym · formula (MassSpecGym Molecule retrieval): links:evaluates_task:discovery-benchmark-massspecgym-molecule-retrieval: Evaluates task MassSpecGym Molecule retrieval (Table 3: Hit rate @1, formula)
- MassSpecGym · formula (MassSpecGym Molecule retrieval): links:part_of:discovery-benchmark-massspecgym: Part of MassSpecGym (Table 3: Hit rate @1, formula)
- MassSpecGym · formula (MassSpecGym Spectrum simulation): links:evaluates_task:discovery-benchmark-massspecgym-spectrum-simulation: Evaluates task MassSpecGym Spectrum simulation (Table 4: Cosine similarity, formula)
- MassSpecGym · formula (MassSpecGym Spectrum simulation): links:part_of:discovery-benchmark-massspecgym: Part of MassSpecGym (Table 4: Cosine similarity, formula)
- MassSpecGym · main (MassSpecGym De novo molecule generation): links:evaluates_task:discovery-benchmark-massspecgym-de-novo-molecule-generation: Evaluates task MassSpecGym De novo molecule generation (Table 2: Top-1 accuracy, main)
- MassSpecGym · main (MassSpecGym De novo molecule generation): links:part_of:discovery-benchmark-massspecgym: Part of MassSpecGym (Table 2: Top-1 accuracy, main)
- MassSpecGym · main (MassSpecGym Molecule retrieval): links:evaluates_task:discovery-benchmark-massspecgym-molecule-retrieval: Evaluates task MassSpecGym Molecule retrieval (Table 3: Hit rate @1, main)
- MassSpecGym · main (MassSpecGym Molecule retrieval): links:part_of:discovery-benchmark-massspecgym: Part of MassSpecGym (Table 3: Hit rate @1, main)
- MassSpecGym · main (MassSpecGym Spectrum simulation): links:evaluates_task:discovery-benchmark-massspecgym-spectrum-simulation: Evaluates task MassSpecGym Spectrum simulation (Table 4: Cosine similarity, main)
- MassSpecGym · main (MassSpecGym Spectrum simulation): links:part_of:discovery-benchmark-massspecgym: Part of MassSpecGym (Table 4: Cosine similarity, main)
- SAIL: facets.method_types: Facets: method types ["supervised_machine_learning"] (MassSpecGym Section 4.1: Fingerprint FFN "employs a feedforward neural network to predict the Morgan fingerprint", and DeepSets; MSAlign arXiv 2605.19752 Table 1 and "Baselines" (v1 and v2): JESTR "pretrains with batch InfoNCE", Emb-Cos "uses candidates InfoNCE to learn a shared space", SAIL is trained with the batch loss)
Models, benchmarks and other records
Configurations (24)
- DeepSets (formula)
- DeepSets (main)
- DeepSets + Fourier features (formula)
- DeepSets + Fourier features (main)
- FFN Fingerprint (formula)
- FFN Fingerprint (main)
- Fingerprint FFN (formula)
- Fingerprint FFN (main)
- FraGNNet (formula)
- FraGNNet (main)
- GNN (formula)
- GNN (main)
- MIST (formula)
- MIST (main)
- Precursor m/z (formula)
- Precursor m/z (main)
- Random (formula)
- Random (main)
- Random chemical generation (formula)
- Random chemical generation (main)
- SELFIES Transformer (formula)
- SELFIES Transformer (main)
- SMILES Transformer (formula)
- SMILES Transformer (main)
Benchmarks (1)
Tasks (3)
Protocols (6)
- MassSpecGym · formula (MassSpecGym De novo molecule generation)
- MassSpecGym · formula (MassSpecGym Molecule retrieval)
- MassSpecGym · formula (MassSpecGym Spectrum simulation)
- MassSpecGym · main (MassSpecGym De novo molecule generation)
- MassSpecGym · main (MassSpecGym Molecule retrieval)
- MassSpecGym · main (MassSpecGym Spectrum simulation)
Datasets (6)
Evaluations (24)
- DeepSets (formula): MassSpecGym · formula
- DeepSets (main): MassSpecGym · main
- DeepSets + Fourier features (formula): MassSpecGym · formula
- DeepSets + Fourier features (main): MassSpecGym · main
- FFN Fingerprint (formula): MassSpecGym · formula
- FFN Fingerprint (main): MassSpecGym · main
- Fingerprint FFN (formula): MassSpecGym · formula
- Fingerprint FFN (main): MassSpecGym · main
- FraGNNet (formula): MassSpecGym · formula
- FraGNNet (main): MassSpecGym · main
- GNN (formula): MassSpecGym · formula
- GNN (main): MassSpecGym · main
- MIST (formula): MassSpecGym · formula
- MIST (main): MassSpecGym · main
- Precursor m/z (formula): MassSpecGym · formula
- Precursor m/z (main): MassSpecGym · main
- Random (formula): MassSpecGym · formula
- Random (main): MassSpecGym · main
- Random chemical generation (formula): MassSpecGym · formula
- Random chemical generation (main): MassSpecGym · main
- SELFIES Transformer (formula): MassSpecGym · formula
- SELFIES Transformer (main): MassSpecGym · main
- SMILES Transformer (formula): MassSpecGym · formula
- SMILES Transformer (main): MassSpecGym · main
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
15 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Artifact SHA-256 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Artifact url https://arxiv.org/pdf/2410.23326v1 Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Hash scope Exact retrieved primary paper artifact bytes. Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Retrieved at 2026-09-17T07:56:11.146650+00:00 Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Review method1 values
| MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Review: scope Source identification and table transcription; no independent experimental reproduction. Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Url https://arxiv.org/pdf/2410.23326v1 Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Version 2410.23326v1 Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Description Primary reference; inspect retrieval status and review scope. Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Search facets None recorded Source metadata | MassSpecGym: A benchmark for the discovery and identification of molecules No field-specific location recorded Version: 2410.23326v1 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
Primary reference; inspect retrieval status and review scope.
Technical metadata and extraction receipts
Stable ID: part2-massspecgym-arxiv-v1
- url
- https://arxiv.org/pdf/2410.23326v1
- version
- 2410.23326v1
- retrieved at
- 2026-09-17T07:56:11.146650+00:00
- artifact sha256
- 82176d50e8947c8b9baa2a0d91493f5680c0e4c7e25a2266ff7879f48a58c40c
- artifact url
- https://arxiv.org/pdf/2410.23326v1
- hash scope
- Exact retrieved primary paper artifact bytes.
- review
- scope: Source identification and table transcription; no independent experimental reproduction.; method: automated-source-review