rewirebio.iobenchmarks
Source

PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

2nd ICML Workshop on Foundation Models for Structured Data (FMSD 2026), Seoul (page 1 footer; arXiv comments field) · 2026 · arXiv v1, submitted 2026-07-26 · Preprint

DOI: 10.48550/arXiv.2607.23447Original source

What this source contributed

Records in this release that cite this source. A record can cite several sources.

Results

Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.

Model or configurationMetricValueDatasetEvaluation
CondOT (PICNN, PerturbPFN Table 2)Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.7401 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
CondOT (PICNN, PerturbPFN Table 2)Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.8014 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
CondOT (PICNN, PerturbPFN Table 2)Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.9323 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
CondOT (PICNN, PerturbPFN Table 2)Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)(#3) unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
CondOT (PICNN, PerturbPFN Table 2)Runtime (Mean wall-clock seconds per Sci-Plex highest-dose protocol on one NVIDIA RTX 4090 worker, without any one-time pretraining cost)7266.4 secondSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
CondOT (PICNN, PerturbPFN Table 2)Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)0.8246 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)CondOT on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GIM (Sci-Plex configuration, PerturbPFN Table 2)Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.2934 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GIM (Sci-Plex configuration, PerturbPFN Table 2)Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.6909 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GIM (Sci-Plex configuration, PerturbPFN Table 2)Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.8611 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GIM (Sci-Plex configuration, PerturbPFN Table 2)Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)(#5) unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GIM (Sci-Plex configuration, PerturbPFN Table 2)Runtime (Mean wall-clock seconds per Sci-Plex highest-dose protocol on one NVIDIA RTX 4090 worker, without any one-time pretraining cost)4495.6 secondSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GIM (Sci-Plex configuration, PerturbPFN Table 2)Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)0.6151 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)GIM on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
GRNBoost2F1 (GeneRNIB gene-set F1: pathways enriched among predicted TF targets against pathways active in held-out expression, averaged across gene-set collections; 300BCG, at most 50,000 links)0.5566 unitlessGeneRNIB 300BCGGRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3)
GRNBoost2F1 (GeneRNIB TF-binding F1: normalised agreement and coverage against UniBind, ChIP-Atlas and ReMap TF-binding references; 300BCG, at most 50,000 links)0.1129 unitlessGeneRNIB 300BCGGRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3)
GRNBoost2Genernib regression precision (GeneRNIB regression precision with ridge regression, conservative regulator budget; 300BCG, at most 50,000 links)0.6082 unitlessGeneRNIB 300BCGGRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3)
GRNBoost2Genernib regression recall (GeneRNIB regression recall with ridge regression, broader regulator budget; 300BCG, at most 50,000 links)0.3752 unitlessGeneRNIB 300BCGGRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3)
GRNBoost2Genernib virtual cell score (GeneRNIB virtual-cell score: prediction of held-out perturbed expression by a model constrained by the inferred network; 300BCG, at most 50,000 links)0.1576 unitlessGeneRNIB 300BCGGRNBoost2 on GeneRNIB 300BCG (PerturbPFN Table 3)
MLP shift regression (GIM codebase, PerturbPFN Table 2)Min max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.7582 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
MLP shift regression (GIM codebase, PerturbPFN Table 2)Min max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.7823 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
MLP shift regression (GIM codebase, PerturbPFN Table 2)Min max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.9216 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
MLP shift regression (GIM codebase, PerturbPFN Table 2)Rank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)(#4) unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
MLP shift regression (GIM codebase, PerturbPFN Table 2)Runtime (Mean wall-clock seconds per Sci-Plex highest-dose protocol on one NVIDIA RTX 4090 worker, without any one-time pretraining cost)0.82 secondSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
MLP shift regression (GIM codebase, PerturbPFN Table 2)Weighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)0.8207 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)MLP on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
Naive nearest-lower-dose baselineMin max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.6299 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
Naive nearest-lower-dose baselineMin max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.5435 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
Naive nearest-lower-dose baselineMin max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.6293 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
Naive nearest-lower-dose baselineRank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)(#6) unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
Naive nearest-lower-dose baselineWeighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)0.6009 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Naive on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
No change baselineMin max normalised score (Debiased Sinkhorn 2-Wasserstein distance between predicted and observed cell sets (epsilon 0.1), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.0698 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
No change baselineMin max normalised score (Mean distance (L2 distance between predicted and observed mean expression over the 50 marker genes), negated, then min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.0000 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
No change baselineMin max normalised score (Pearson correlation between predicted and observed mean expression over the 50 marker genes, min-max normalised across the seven Table 2 rows within each of 12 Sci-Plex highest-dose protocols and averaged over protocols)0.0000 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
No change baselineRank (Rank of the overall normalised score among the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)(#7) unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
No change baselineWeighted composite score (Equal-weight mean of the three protocol-averaged min-max normalised scores (mean distance, Pearson r, Sinkhorn W2) across the seven Table 2 rows on 12 Sci-Plex highest-dose protocols)0.0233 unitlessSci-Plex HDAC-inhibitor subset, 3 cell lines by 4 drugs (GIM preprocessing)Observational on the Sci-Plex highest-dose holdout (PerturbPFN Table 2)
Pearson correlation networkF1 (GeneRNIB gene-set F1: pathways enriched among predicted TF targets against pathways active in held-out expression, averaged across gene-set collections; 300BCG, at most 50,000 links)0.4693 unitlessGeneRNIB 300BCGPearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3)
Pearson correlation networkF1 (GeneRNIB TF-binding F1: normalised agreement and coverage against UniBind, ChIP-Atlas and ReMap TF-binding references; 300BCG, at most 50,000 links)0.1102 unitlessGeneRNIB 300BCGPearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3)
Pearson correlation networkGenernib regression precision (GeneRNIB regression precision with ridge regression, conservative regulator budget; 300BCG, at most 50,000 links)0.6154 unitlessGeneRNIB 300BCGPearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3)
Pearson correlation networkGenernib regression recall (GeneRNIB regression recall with ridge regression, broader regulator budget; 300BCG, at most 50,000 links)0.2742 unitlessGeneRNIB 300BCGPearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3)
Pearson correlation networkGenernib virtual cell score (GeneRNIB virtual-cell score: prediction of held-out perturbed expression by a model constrained by the inferred network; 300BCG, at most 50,000 links)0.1882 unitlessGeneRNIB 300BCGPearson corr. on GeneRNIB 300BCG (PerturbPFN Table 3)
PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregationF1 (GeneRNIB gene-set F1: pathways enriched among predicted TF targets against pathways active in held-out expression, averaged across gene-set collections; 300BCG, at most 50,000 links)0.6410 unitlessGeneRNIB 300BCGPerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3)
PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregationF1 (GeneRNIB TF-binding F1: normalised agreement and coverage against UniBind, ChIP-Atlas and ReMap TF-binding references; 300BCG, at most 50,000 links)0.1146 unitlessGeneRNIB 300BCGPerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3)
PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregationGenernib regression precision (GeneRNIB regression precision with ridge regression, conservative regulator budget; 300BCG, at most 50,000 links)0.2250 unitlessGeneRNIB 300BCGPerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3)
PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregationGenernib regression recall (GeneRNIB regression recall with ridge regression, broader regulator budget; 300BCG, at most 50,000 links)0.1977 unitlessGeneRNIB 300BCGPerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3)
PerturbPFN step-3100 checkpoint, GeneRNIB panel aggregationGenernib virtual cell score (GeneRNIB virtual-cell score: prediction of held-out perturbed expression by a model constrained by the inferred network; 300BCG, at most 50,000 links)0.0731 unitlessGeneRNIB 300BCGPerturbPFN on GeneRNIB 300BCG (PerturbPFN Table 3)
PerturbPFN step-3100 checkpoint, in-context forward passAUPRC (Intervention targets: node-wise target probabilities; PerturbPFN in-prior synthetic episodes)0.7860 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
PerturbPFN step-3100 checkpoint, in-context forward passAUPRC (Latent graph: all directed non-self edges ranked by predicted edge probability, edge prevalence 0.0363; PerturbPFN in-prior synthetic episodes)0.2980 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
PerturbPFN step-3100 checkpoint, in-context forward passAUROC (Intervention targets: node-wise target probabilities; PerturbPFN in-prior synthetic episodes)0.9330 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
PerturbPFN step-3100 checkpoint, in-context forward passAUROC (Latent graph: all directed non-self edges ranked by predicted edge probability; PerturbPFN in-prior synthetic episodes)0.8133 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
PerturbPFN step-3100 checkpoint, in-context forward passCosine similarity (Predicted against true mean response shift relative to control, both centred across genes; PerturbPFN in-prior synthetic episodes)0.7437 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
PerturbPFN step-3100 checkpoint, in-context forward passF1 (Intervention targets: node-wise probabilities thresholded at 0.5; PerturbPFN in-prior synthetic episodes)0.7649 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)
PerturbPFN step-3100 checkpoint, in-context forward passF1 (Intervention targets: straight-through top-k gate used in the decoder rollout (k = 3, Table 6); PerturbPFN in-prior synthetic episodes)0.6287 unitlessPerturbPFN synthetic prior, 1,024 held-out episodesPerturbPFN on in-prior latent recovery (PerturbPFN Table 1)

Claims

Statements this source supports, each with where in the source it was checked.

  • GeneRNIB 300BCG Table 3: baseline provenance: Baseline provenance "Baseline results are taken from the official GeneRNIB score archive for the same 300BCG dataset and 50,000-link budget." (Appendix E.3, last paragraph)
  • GeneRNIB 300BCG: PerturbPFN graph export: Submission semantics The GeneRNIB submission uses PerturbPFN's continuous, unthresholded edge probabilities rather than the projected DAG, so the exported network may contain cycles. (Appendix E.2, last paragraph)
  • GRNBOOST2 in BEELINE (0c21015c): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the GRNBoost2 method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-grnboost2; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
  • GRNBOOST2 in BEELINE (9ef0d0be): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the GRNBoost2 method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-grnboost2; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
  • GRNBOOST2 in BEELINE (20bd9426): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the GRNBoost2 method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-grnboost2; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
  • links:configuration_of:perturbpfn-20261115-method-grnboost2: GRNBOOST2 in BEELINE (0c21015c): Configuration of GRNBoost2 (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
  • links:configuration_of:perturbpfn-20261115-method-grnboost2: GRNBOOST2 in BEELINE (9ef0d0be): Configuration of GRNBoost2 (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
  • links:configuration_of:perturbpfn-20261115-method-grnboost2: GRNBOOST2 in BEELINE (20bd9426): Configuration of GRNBoost2 (Methods, paragraph headed "GRNBoost2": "GRNBoost2 is a fast alternative for GENIE3 ... Like GENIE3, GRNBoost2 trains a regression model to select the most important regulators for each gene in the dataset. GRNBoost2 achieves its efficiency by using stochastic Gradient Boosting Machine regression with early-stopping regularization"; reference 8, Moerman et al., "GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks")
  • links:configuration_of:perturbpfn-20261115-method-ppcor: PPCOR in BEELINE (4bcb697c): Configuration of PPCOR (partial Pearson correlation) (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
  • links:configuration_of:perturbpfn-20261115-method-ppcor: PPCOR in BEELINE (7b1b949b): Configuration of PPCOR (partial Pearson correlation) (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
  • links:configuration_of:perturbpfn-20261115-method-ppcor: PPCOR in BEELINE (89290921): Configuration of PPCOR (partial Pearson correlation) (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
  • Perturbation response: attributes.scope_note: Scope note Predict expression changes under a held-out perturbation condition. The held-out condition need not be an agent the model has never seen: a protocol under this task may hold out a dose, a time point or a cell context of an agent whose other conditions are available in training or in context, and each protocol record states which. A result under this task is therefore not evidence of prediction for an unseen perturbing agent unless its protocol says the agent itself was held out. (arXiv:2607.23447v1 Appendix D.2, sentence "The held-out drug is not completely unseen, since lower-dose responses are available"; data/entities/tasks.jsonl, record catalog-task-cell-perturbation)
  • PerturbPFN v1: auxiliary graph-ranking values without a described protocol: Unextracted values Section 4.3 reports edge AUROC 0.9168 and edge average precision 0.7570 for PerturbPFN 'in the auxiliary graph-ranking evaluation (Appendix E)', but Appendix E of v1 describes only the GeneRNIB protocol and gives no auxiliary evaluation, reference network or edge set. The two values were not extracted. (Section 4.3, last paragraph before Section 5; Appendix E)
  • PerturbPFN: access as stated in the preprint: Access The preprint gives no code repository, weights or checkpoint download, and states no code or model licence; the article itself is CC BY 4.0. (Whole text of arXiv:2607.23447v1; licence from the arXiv abstract page)
  • PerturbPFN: gene panel size: Input scale One forward pass supports at most 60 nodes (genes); training graphs have 40 to 60 genes, and the GeneRNIB run splits 1,600 genes into 190 panels of at most 60 genes. (Table 6 'Maximum nodes'; Table 4 'Number of genes'; Appendix E.2)
  • PerturbPFN: inputs and outputs: Inputs outputs Inputs are context pairs of a regime descriptor (drug embedding, dose and control indicator) and an observed response, plus a query regime descriptor; target propensities and target identities are not inputs. Outputs are point estimates of an episode-level graph, sparse query targets and strengths, and the location, variance and zero probability of a zero-inflated log-normal predictive distribution. (Section 2.2; Section 2.4 'Intervention heads and SCM rollout'; Appendix A 'Highest-dose episodic protocol')
  • PerturbPFN: size and training compute: Model size and compute The selected step-3100 checkpoint has 14.98M parameters; the complete 3,500-step run took about 1.44 GPU-hours on one NVIDIA RTX 4090 with batch size 8. (Appendix B 'Compute resources'; Tables 6 and 7)
  • PerturbPFN: stated limitations: Limitations The authors state that the latent variables' meaning is set by the synthetic prior and recovering them in-prior does not show they are identifiable biological mechanisms; graphs, targets and strengths are point estimates; the system is assumed sparse and acyclic; and gene panels are much smaller than a transcriptome. (Section 5 'Limitations and Outlook')
  • PerturbPFN: synthetic-only training: Training data PerturbPFN is trained entirely on prior-predictive synthetic episodes in which the graph, intervention targets, strengths and outcomes are known by construction; no real perturbation responses are used for training. (Section 2.3, last sentence of the first paragraph; Section 2.5)
  • PPCOR in BEELINE (4bcb697c): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the PPCOR partial-correlation method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-ppcor; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
  • PPCOR in BEELINE (7b1b949b): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the PPCOR partial-correlation method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-ppcor; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
  • PPCOR in BEELINE (89290921): description and attributes.provenance_note: Description and attributes: provenance note description: Entry in BEELINE for the PPCOR partial-correlation method; the entry gives its label only, so no run settings are recorded. | attributes.provenance_note: Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred. The method this entry configures was established from the BEELINE paper's own Methods and is recorded as a configuration_of link to perturbpfn-20261115-method-ppcor; the run settings, checkpoint identity and aliases behind the label are still not inferred. (Methods, paragraph headed "PPCOR": "This R package computes the partial and semi-partial correlation coefficients for every pair of variables (genes, in our case) with respect to all the other variables ... We use this package to compute the partial correlation coefficients"; reference 7, Kim, "ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients")
  • Sci-Plex highest-dose holdout: not unseen-drug prediction: Split semantics "This protocol tests dose extrapolation under unknown perturbation targets. The held-out drug is not completely unseen, since lower-dose responses are available, but the target and mechanism at the highest dose are not provided to the model." (Appendix D.2, second paragraph)
  • Sci-Plex Table 2: baseline metric recomputation: Metric implementation note "All baselines are evaluated on the same held-out protocols, and all reported metrics are recomputed using the same metric code as PerturbPFN whenever prediction arrays are available." The paper does not say whether any baseline lacked prediction arrays. (Appendix D.4, first paragraph)
  • Sci-Plex Table 2: runtime accounting: Runtime accounting For PerturbPFN, the ICL-only time measures applying the pretrained checkpoint (1.11 s per protocol); the amortized time adds the one-time pretraining cost divided across the 12 protocols (432.8 s per protocol). All runtimes were measured on one compute worker with a single NVIDIA RTX 4090. (Section 4.2 'Metrics', second paragraph; Table 2 caption)

Models, benchmarks and other records

Models (1)

Methods (10)

Configurations (6)

Benchmarks (2)

Protocols (3)

Datasets (2)

Dataset subsets (1)

Evaluations (14)

Sources (1)

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

33 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-21-c8bea25e5abb
Property and statementOriginal source and locationReview and provenance
Archive note
artifacts/arxiv-2607.23447v1.pdftotext-layout.txt.gz is the gzipped (gzip -n -9) pdftotext -layout text layer (poppler 26.08.0) every table value was parsed from. The PDF is refetchable at the versioned URL and is not archived.
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.archive_note

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Archive sha256
bb23dabbced4f8a40a42d8d0f74c10a0b27b1c54dddbbb53d314bff9c04221c6
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.archive_sha256

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Artifact SHA-256
42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_sha256

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Artifact url
https://arxiv.org/pdf/2607.23447v1
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.artifact_url

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Doi
10.48550/arXiv.2607.23447
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.doi

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Hash scope
Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.hash_scope

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Licence
CC-BY-4.0
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.licence

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Limitations
1 values
  • arXiv preprint of a workshop paper; the evaluations are run and reported by the model's authors.
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.limitations

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Media type
application/pdf
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.media_type

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

Missing metadata: code url: note
The paper links no code repository, weights or checkpoint. On 2026-11-15 a GitHub repository search for 'perturbpfn' returned 0 repositories, the first author's and Prior Labs' public repositories hold no PerturbPFN code, and Hugging Face model searches for 'perturbpfn' and 'perturb-pfn' returned nothing. Code and weights access is unknown, not open.
Source metadata
PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling (arXiv:2607.23447v1)

Original source ↗

No field-specific location recorded

Version: arXiv v1, submitted 2026-07-26
Retrieved: 2026-11-15T20:27:40Z

catalogued

No individual claim review recorded

Audit details

Field: attributes.missing_metadata.code_url.note

Source artifact SHA-256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1

Hash scope: Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.

Inspected artifact

How to read the evidence

Sources and history

Release 2026-11-21-c8bea25e5abb · Record review: source checked

Workshop paper by Yuche Gao, José Miguel Hernández-Lobato and Siyuan Guo introducing PerturbPFN and evaluating it on synthetic episodes, Sci-Plex and GeneRNIB 300BCG.

Release history

No supporting source is linked yet.

Read original source

Download this release (gzip)
Technical metadata and extraction receipts

Stable ID: perturbpfn-20261115-source-arxiv-v1

areas
single-cell; cells-tissues; biological-networks
contexts
research
archive note
artifacts/arxiv-2607.23447v1.pdftotext-layout.txt.gz is the gzipped (gzip -n -9) pdftotext -layout text layer (poppler 26.08.0) every table value was parsed from. The PDF is refetchable at the versioned URL and is not archived.
archive sha256
bb23dabbced4f8a40a42d8d0f74c10a0b27b1c54dddbbb53d314bff9c04221c6
artifact sha256
42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1
artifact url
https://arxiv.org/pdf/2607.23447v1
doi
10.48550/arXiv.2607.23447
hash scope
Exact bytes of the PDF. Three downloads on 2026-11-15 (20:22Z to 20:27Z) gave identical bytes.
licence
CC-BY-4.0
limitations
arXiv preprint of a workshop paper; the evaluations are run and reported by the model's authors.
media type
application/pdf
missing metadata
code url: note: The paper links no code repository, weights or checkpoint. On 2026-11-15 a GitHub repository search for 'perturbpfn' returned 0 repositories, the first author's and Prior Labs' public repositories hold no PerturbPFN code, and Hugging Face model searches for 'perturbpfn' and 'perturb-pfn' returned nothing. Code and weights access is unknown, not open.; reason: unavailable
publication status
preprint
retrieved at
2026-11-15T20:27:40Z
review
artifact sha256: 42191efa04b45ca04b2be38b51ea374cd9bf891efe2399d331fec9eaeab200b1; method: independent-cell-check; deterministic-table-parse; pdf-text-parse; source-hash-verification; method note: Independent review pass. Both pinned artifacts were re-downloaded and their SHA-256 checked against the source records, the mutable abstract page included, and both matched. A pdftotext -layout run (poppler 26.08.0) on the refetched PDF is byte for byte the contents of the archived gzipped text layer, so the archive is provably derived from the pinned bytes. npm run batch -- check-values reproduced the extractor's figures exactly (64 in_cell, 11 in_row, 6 locator_not_parsed, no wrong_column and no overclaimed_in_row) and wrote the same value-check.tsv. All 81 results were then re-read by review/recheck_tables.py, written for this pass and using neither extract/parse_tables.py nor extract/check_tables.py: it takes each table's column spans from the character offsets of that table's own printed header line, assigns every numeric token on a body line to the column whose header centre is nearest, and matches cells to records through each result's source_locator text rather than its ID, checking printed_value, numeric_value, the printed spread and the system the result's evaluation names. Two negative controls confirmed it fails on a swapped pair of values and on a cell shifted into the neighbouring column. A manual check of 16 cells covered column assignment in all three tables, including Table 2's unlabelled PerturbPFN score line, Table 1's third label and value pair on each of its three rows, and Table 3's middle columns. The printed overall score was re-derived as the equal-weight mean of each row's three normalised columns. The 54 descriptive records were read against Sections 2 to 5, Appendices A to E and Tables 4 to 8 of the pinned PDF.; retrieval url: https://arxiv.org/pdf/2607.23447v1; reviewed at: 2026-11-15T00:00:00Z; reviewer: claude; reviewer note: Claude review agent (independent of the extractor); no human review claimed. Transcription was checked against the pinned source; nothing was reproduced and no value was recomputed.
source locator
Whole paper, 19 pages: Sections 1 to 5 and Appendices A to E
url
https://arxiv.org/pdf/2607.23447v1
venue
2nd ICML Workshop on Foundation Models for Structured Data (FMSD 2026), Seoul (page 1 footer; arXiv comments field)
version
arXiv v1, submitted 2026-07-26
year
2026
Related records

Suggest a correction