PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)
2nd ICML Workshop on Foundation Models for Structured Data (FMSD 2026), Seoul (page 1 footer; arXiv comments field) · 2026 · arXiv v1, submitted 2026-07-26 · Preprint
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
| Model or configuration | Metric | Value | Dataset | Evaluation |
|---|---|---|---|---|
| CondOT (PICNN, PerturbPFN Table 2) | Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.7401 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| CondOT (PICNN, PerturbPFN Table 2) | Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.8014 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| CondOT (PICNN, PerturbPFN Table 2) | Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.9323 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| CondOT (PICNN, PerturbPFN Table 2) | Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | (#3) unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| CondOT (PICNN, PerturbPFN Table 2) | Runtime (Mean wall-clock seconds per Sci-Plex highest-dose protocol on one NVIDIA RTX 4090 worker, without any one-time pretraining cost) | 7266.4 second | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| CondOT (PICNN, PerturbPFN Table 2) | Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | 0.8246 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GIM (Sci-Plex configuration, PerturbPFN Table 2) | Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.2934 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GIM (Sci-Plex configuration, PerturbPFN Table 2) | Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.6909 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GIM (Sci-Plex configuration, PerturbPFN Table 2) | Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.8611 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GIM (Sci-Plex configuration, PerturbPFN Table 2) | Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | (#5) unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GIM (Sci-Plex configuration, PerturbPFN Table 2) | Runtime (Mean wall-clock seconds per Sci-Plex highest-dose protocol on one NVIDIA RTX 4090 worker, without any one-time pretraining cost) | 4495.6 second | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GIM (Sci-Plex configuration, PerturbPFN Table 2) | Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | 0.6151 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| GRNBoost2 | F1 (GeneRNIB gene-set F1: pathways enriched among predicted TF targets against pathways active in held-out expression, averaged across gene-set collections; 300BCG, at most 50,000 links) | 0.5566 unitless | GeneRNIB 300BCG | GRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3) |
| GRNBoost2 | F1 (GeneRNIB TF-binding F1: normalised agreement and coverage against UniBind, ChIP-Atlas and ReMap TF-binding references; 300BCG, at most 50,000 links) | 0.1129 unitless | GeneRNIB 300BCG | GRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3) |
| GRNBoost2 | Genernib regression precision (GeneRNIB regression precision with ridge regression, conservative regulator budget; 300BCG, at most 50,000 links) | 0.6082 unitless | GeneRNIB 300BCG | GRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3) |
| GRNBoost2 | Genernib regression recall (GeneRNIB regression recall with ridge regression, broader regulator budget; 300BCG, at most 50,000 links) | 0.3752 unitless | GeneRNIB 300BCG | GRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3) |
| GRNBoost2 | Genernib virtual cell score (GeneRNIB virtual-cell score: prediction of held-out perturbed expression by a model constrained by the inferred network; 300BCG, at most 50,000 links) | 0.1576 unitless | GeneRNIB 300BCG | GRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3) |
| MLP shift regression (GIM codebase, PerturbPFN Table 2) | Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.7582 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| MLP shift regression (GIM codebase, PerturbPFN Table 2) | Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.7823 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| MLP shift regression (GIM codebase, PerturbPFN Table 2) | Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.9216 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| MLP shift regression (GIM codebase, PerturbPFN Table 2) | Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | (#4) unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| MLP shift regression (GIM codebase, PerturbPFN Table 2) | Runtime (Mean wall-clock seconds per Sci-Plex highest-dose protocol on one NVIDIA RTX 4090 worker, without any one-time pretraining cost) | 0.82 second | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| MLP shift regression (GIM codebase, PerturbPFN Table 2) | Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | 0.8207 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| Naive nearest-lower-dose baseline | Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.6299 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| Naive nearest-lower-dose baseline | Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.5435 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| Naive nearest-lower-dose baseline | Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.6293 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| Naive nearest-lower-dose baseline | Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | (#6) unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| Naive nearest-lower-dose baseline | Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | 0.6009 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| No change baseline | Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.0698 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| No change baseline | Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.0000 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| No change baseline | Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols) | 0.0000 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| No change baseline | Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | (#7) unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| No change baseline | Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols) | 0.0233 unitless | Sci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing) | Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2) |
| Pearson correlation network | F1 (GeneRNIB gene-set F1: pathways enriched among predicted TF targets against pathways active in held-out expression, averaged across gene-set collections; 300BCG, at most 50,000 links) | 0.4693 unitless | GeneRNIB 300BCG | Pearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3) |
| Pearson correlation network | F1 (GeneRNIB TF-binding F1: normalised agreement and coverage against UniBind, ChIP-Atlas and ReMap TF-binding references; 300BCG, at most 50,000 links) | 0.1102 unitless | GeneRNIB 300BCG | Pearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3) |
| Pearson correlation network | Genernib regression precision (GeneRNIB regression precision with ridge regression, conservative regulator budget; 300BCG, at most 50,000 links) | 0.6154 unitless | GeneRNIB 300BCG | Pearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3) |
| Pearson correlation network | Genernib regression recall (GeneRNIB regression recall with ridge regression, broader regulator budget; 300BCG, at most 50,000 links) | 0.2742 unitless | GeneRNIB 300BCG | Pearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3) |
| Pearson correlation network | Genernib virtual cell score (GeneRNIB virtual-cell score: prediction of held-out perturbed expression by a model constrained by the inferred network; 300BCG, at most 50,000 links) | 0.1882 unitless | GeneRNIB 300BCG | Pearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3) |
| PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregation | F1 (GeneRNIB gene-set F1: pathways enriched among predicted TF targets against pathways active in held-out expression, averaged across gene-set collections; 300BCG, at most 50,000 links) | 0.6410 unitless | GeneRNIB 300BCG | PerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3) |
| PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregation | F1 (GeneRNIB TF-binding F1: normalised agreement and coverage against UniBind, ChIP-Atlas and ReMap TF-binding references; 300BCG, at most 50,000 links) | 0.1146 unitless | GeneRNIB 300BCG | PerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3) |
| PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregation | Genernib regression precision (GeneRNIB regression precision with ridge regression, conservative regulator budget; 300BCG, at most 50,000 links) | 0.2250 unitless | GeneRNIB 300BCG | PerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3) |
| PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregation | Genernib regression recall (GeneRNIB regression recall with ridge regression, broader regulator budget; 300BCG, at most 50,000 links) | 0.1977 unitless | GeneRNIB 300BCG | PerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3) |
| PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregation | Genernib virtual cell score (GeneRNIB virtual-cell score: prediction of held-out perturbed expression by a model constrained by the inferred network; 300BCG, at most 50,000 links) | 0.0731 unitless | GeneRNIB 300BCG | PerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | AUPRC (Intervention targets: node-wise target probabilities; PerturbPFN in-prior synthetic episodes) | 0.7860 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | AUPRC (Latent graph: all directed non-self edges ranked by predicted edge probability, edge prevalence 0.0363; PerturbPFN in-prior synthetic episodes) | 0.2980 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | AUROC (Intervention targets: node-wise target probabilities; PerturbPFN in-prior synthetic episodes) | 0.9330 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | AUROC (Latent graph: all directed non-self edges ranked by predicted edge probability; PerturbPFN in-prior synthetic episodes) | 0.8133 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | Cosine similarity (Predicted against true mean response shift relative to control, both centred across genes; PerturbPFN in-prior synthetic episodes) | 0.7437 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | F1 (Intervention targets: node-wise probabilities thresholded at 0.5; PerturbPFN in-prior synthetic episodes) | 0.7649 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
| PerturbPFN step-3100 checkpoint, in-context forward pass | F1 (Intervention targets: straight-through top-k gate used in the decoder rollout (k = 3, Table 6); PerturbPFN in-prior synthetic episodes) | 0.6287 unitless | PerturbPFN synthetic prior, 1,024 held-out episodes | PerturbPFN on in-prior latent recovery (PerturbPFN Table 1) |
Claims
Statements this source supports, each with where in the source it was checked.
- GeneRNIB 300BCG Table 3: baseline provenance: Baseline provenance "Baseline results are taken from the official GeneRNIB score archive for the same 300BCG dataset and 50,000-link budget." (Appendix E.3, last paragraph)
- GeneRNIB 300BCG: PerturbPFN graph export: Submission semantics The GeneRNIB submission uses PerturbPFN's continuous, unthresholded edge probabilities rather than the projected DAG, so the exported network may contain cycles. (Appendix E.2, last paragraph)
- GRNBOOST2 in BEELINE (0c21015c): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the GRNBoost2 method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-grnboost2; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
- GRNBOOST2 in BEELINE (9ef0d0be): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the GRNBoost2 method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-grnboost2; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
- GRNBOOST2 in BEELINE (20bd9426): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the GRNBoost2 method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-grnboost2; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
- links:configuration_of:perturbpfn-20261115-method-grnboost2: GRNBOOST2 in BEELINE (0c21015c): Configuration of GRNBoost2 (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
- links:configuration_of:perturbpfn-20261115-method-grnboost2: GRNBOOST2 in BEELINE (9ef0d0be): Configuration of GRNBoost2 (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
- links:configuration_of:perturbpfn-20261115-method-grnboost2: GRNBOOST2 in BEELINE (20bd9426): Configuration of GRNBoost2 (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
- links:configuration_of:perturbpfn-20261115-method-ppcor: PPCOR in BEELINE (4bcb697c): Configuration of PPCOR (partial Pearson correlation) (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
- links:configuration_of:perturbpfn-20261115-method-ppcor: PPCOR in BEELINE (7b1b949b): Configuration of PPCOR (partial Pearson correlation) (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
- links:configuration_of:perturbpfn-20261115-method-ppcor: PPCOR in BEELINE (89290921): Configuration of PPCOR (partial Pearson correlation) (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
- Perturbation response: attributes.scope_note: Scope note Predict expression changes under a held-out perturbation condition. The held-out condition need not be an agent the model has never seen: a protocol under this task may hold out a dose, a time point or a cell context of an agent whose other conditions are available in training or in context, and each protocol record states which. A result under this task is therefore not evidence of prediction for an unseen perturbing agent unless its protocol says the agent itself was held out. (arXiv:2607.23447v1 Appendix D.2, sentence "The held-out drug is not completely unseen, since lower-dose responses are available"; data/entities/tasks.jsonl, record catalog-task-cell-perturbation)
- PerturbPFN v1: auxiliary graph-ranking values without a described protocol: Unextracted values Section 4.3 reports edge AUROC 0.9168 and edge average precision 0.7570 for PerturbPFN 'in the auxiliary graph-ranking evaluation (Appendix E)', but Appendix E of v1 describes only the GeneRNIB protocol and gives no auxiliary evaluation, reference network or edge set. The two values were not extracted. (Section 4.3, last paragraph before Section 5; Appendix E)
- PerturbPFN: access as stated in the preprint: Access The preprint gives no code repository, weights or checkpoint download, and states no code or model licence; the article itself is CC BY 4.0. (Whole text of arXiv:2607.23447v1; licence from the arXiv abstract page)
- PerturbPFN: gene panel size: Input scale One forward pass supports at most 60 nodes (genes); training graphs have 40 to 60 genes, and the GeneRNIB run splits 1,600 genes into 190 panels of at most 60 genes. (Table 6 'Maximum nodes'; Table 4 'Number of genes'; Appendix E.2)
- PerturbPFN: inputs and outputs: Inputs outputs Inputs are context pairs of a regime descriptor (drug embedding, dose and control indicator) and an observed response, plus a query regime descriptor; target propensities and target identities are not inputs. Outputs are point estimates of an episode-level graph, sparse query targets and strengths, and the location, variance and zero probability of a zero-inflated log-normal predictive distribution. (Section 2.2; Section 2.4 'Intervention heads and SCM rollout'; Appendix A 'Highest-dose episodic protocol')
- PerturbPFN: size and training compute: Model size and compute The selected step-3100 checkpoint has 14.98M parameters; the complete 3,500-step run took about 1.44 GPU-hours on one NVIDIA RTX 4090 with batch size 8. (Appendix B 'Compute resources'; Tables 6 and 7)
- PerturbPFN: stated limitations: Limitations The authors state that the latent variables' meaning is set by the synthetic prior and recovering them in-prior does not show they are identifiable biological mechanisms; graphs, targets and strengths are point estimates; the system is assumed sparse and acyclic; and gene panels are much smaller than a transcriptome. (Section 5 'Limitations and Outlook')
- PerturbPFN: synthetic-only training: Training data PerturbPFN is trained entirely on prior-predictive synthetic episodes in which the graph, intervention targets, strengths and outcomes are known by construction; no real perturbation responses are used for training. (Section 2.3, last sentence of the first paragraph; Section 2.5)
- PPCOR in BEELINE (4bcb697c): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the PPCOR partial-correlation method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-ppcor; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
- PPCOR in BEELINE (7b1b949b): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the PPCOR partial-correlation method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-ppcor; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
- PPCOR in BEELINE (89290921): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the PPCOR partial-correlation method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-ppcor; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
- Sci-Plex highest-dose holdout: not unseen-drug prediction: Split semantics "This protocol tests dose extrapolation under unknown perturbation targets. The held-out drug is not completely unseen, since lower-dose responses are available, but the target and mechanism at the highest dose are not provided to the model." (Appendix D.2, second paragraph)
- Sci-Plex Table 2: baseline metric recomputation: Metric implementation note "All baselines are evaluated on the same held-out protocols, and all reported metrics are recomputed using the same metric code as PerturbPFN whenever prediction arrays are available." The paper does not say whether any baseline lacked prediction arrays. (Appendix D.4, first paragraph)
- Sci-Plex Table 2: runtime accounting: Runtime accounting For PerturbPFN, the ICL-only time measures applying the pretrained checkpoint (1.11 s per protocol); the amortized time adds the one-time pretraining cost divided across the 12 protocols (432.8 s per protocol). All runtimes were measured on one compute worker with a single NVIDIA RTX 4090. (Section 4.2 'Metrics', second paragraph; Table 2 caption)
Models, benchmarks and other records
Models (1)
Methods (10)
Configurations (6)
- CondOT (PICNN, PerturbPFN Table 2)
- GIM (Sci-Plex configuration, PerturbPFN Table 2)
- MLP shift regression (GIM codebase, PerturbPFN Table 2)
- PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregation
- PerturbPFN step-3100 checkpoint, in-context forward pass
- RF X-Learner (100-tree random forest, PerturbPFN Table 2)
Benchmarks (2)
Protocols (3)
Datasets (2)
Dataset subsets (1)
Evaluations (14)
- CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- GRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3)
- MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- Pearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3)
- PerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3)
- PerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
- PerturbPFN on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- PORTIA on GeneRNIB 300BCG (PerturbPFN Table 3)
- PPCOR on GeneRNIB 300BCG (PerturbPFN Table 3)
- RF X-Learner on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
- SCENIC on GeneRNIB 300BCG (PerturbPFN Table 3)
Sources (1)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
33 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Archive note artifacts/arxiv-2607.23447v1.pdftotext-layout.txt.gz is the gzipped (gzip -n -9) pdftotext -layout text layer (poppler 26.08.0) every table value was parsed from. The PDF is refetchable at the versioned URL and is not archived. Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Archive sha256 bb23dabbced4f8a40a42d8d0f74c10a0b27b1c54dddbbb53d314bff9c04221c6 Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Artifact SHA-256 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1 Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Artifact url https://arxiv.org/pdf/2607.23447v1 Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Doi 10.48550/arXiv.2607.23447 Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Hash scope Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Licence CC-BY-4.0 Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
Limitations1 values
| PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Media type application/pdf Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
| Missing metadata: code url: note The paper links no code repository, weights or checkpoint. On 2026-11-15 a GitHub repository search for 'perturbpfn' returned 0 repositories, the first author's and Prior Labs' public repositories hold no PerturbPFN code, and Hugging Face model searches for 'perturbpfn' and 'perturb-pfn' returned nothing. Code and weights access is unknown, not open. Source metadata | PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1) No field-specific location recorded Version: arXiv v1, submitted 2026-07-26 | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes. |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
Workshop paper by Yuche Gao, José Miguel Hernández-Lobato and Siyuan Guo introducing PerturbPFN and evaluating it on synthetic episodes, Sci-Plex and GeneRNIB 300BCG.
Technical metadata and extraction receipts
Stable ID: perturbpfn-20261115-source-arxiv-v1
- areas
- single-cell; cells-tissues; biological-networks
- contexts
- research
- archive note
- artifacts/arxiv-2607.23447v1.pdftotext-layout.txt.gz is the gzipped (gzip -n -9) pdftotext -layout text layer (poppler 26.08.0) every table value was parsed from. The PDF is refetchable at the versioned URL and is not archived.
- archive sha256
- bb23dabbced4f8a40a42d8d0f74c10a0b27b1c54dddbbb53d314bff9c04221c6
- artifact sha256
- 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1
- artifact url
- https://arxiv.org/pdf/2607.23447v1
- doi
- 10.48550/arXiv.2607.23447
- hash scope
- Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.
- licence
- CC-BY-4.0
- limitations
- arXiv preprint of a workshop paper; the evaluations are run and reported by the model's authors.
- media type
- application/pdf
- missing metadata
- code url: note: The paper links no code repository, weights or checkpoint. On 2026-11-15 a GitHub repository search for 'perturbpfn' returned 0 repositories, the first author's and Prior Labs' public repositories hold no PerturbPFN code, and Hugging Face model searches for 'perturbpfn' and 'perturb-pfn' returned nothing. Code and weights access is unknown, not open.; reason: unavailable
- publication status
- preprint
- retrieved at
- 2026-11-15T20:27:40Z
- review
- artifact sha256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1; method: independent-cell-check; deterministic-table-parse; pdf-text-parse; source-hash-verification; method note: Independent review pass. Both pinned artifacts were re-downloaded and their SHA-256 checked against the source records, the mutable abstract page included, and both matched. A pdftotext -layout run (poppler 26.08.0) on the refetched PDF is byte for byte the contents of the archived gzipped text layer, so the archive is provably derived from the pinned bytes. npm run batch -- check-values reproduced the extractor's figures exactly (64 in_cell, 11 in_row, 6 locator_not_parsed, no wrong_column and no overclaimed_in_row) and wrote the same value-check.tsv. All 81 results were then re-read by review/recheck_tables.py, written for this pass and using neither extract/parse_tables.py nor extract/check_tables.py: it takes each table's column spans from the character offsets of that table's own printed header line, assigns every numeric token on a body line to the column whose header centre is nearest, and matches cells to records through each result's source_locator text rather than its ID, checking printed_value, numeric_value, the printed spread and the system the result's evaluation names. Two negative controls confirmed it fails on a swapped pair of values and on a cell shifted into the neighbouring column. A manual check of 16 cells covered column assignment in all three tables, including Table 2's unlabelled PerturbPFN score line, Table 1's third label and value pair on each of its three rows, and Table 3's middle columns. The printed overall score was re-derived as the equal-weight mean of each row's three normalised columns. The 54 descriptive records were read against Sections 2 to 5, Appendices A to E and Tables 4 to 8 of the pinned PDF.; retrieval url: https://arxiv.org/pdf/2607.23447v1; reviewed at: 2026-11-15T00:00:00Z; reviewer: claude; reviewer note: Claude review agent (independent of the extractor); no human review claimed. Transcription was checked against the pinned source; nothing was reproduced and no value was recomputed.
- source locator
- Whole paper, 19 pages: Sections 1 to 5 and Appendices A to E
- url
- https://arxiv.org/pdf/2607.23447v1
- venue
- 2nd ICML Workshop on Foundation Models for Structured Data (FMSD 2026), Seoul (page 1 footer; arXiv comments field)
- version
- arXiv v1, submitted 2026-07-26
- year
- 2026