rewirebio.iobenchmarks
Configuration

GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)

GPT-4 (gpt-4-1106-preview), zero-shot prompt: Zero-shot gene-ranking prompt.

3 evaluations · 60 results

Overview

An explanatory profile has not yet been reviewed for this record.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

3 evaluations · 60 results. Different protocols are not a single leaderboard.

Sorted by AUPRC (candidate gene set of 100 genes including the causative gene) (higher is better). The best value in each column is highlighted. Decimals are rounded for display; each value links to the printed value and its source.

Tested configurationProtocol and datasetAUPRC (candidate gene set of 100 genes including the causative gene)AUPRC (candidate gene set of 25 genes including the causative gene)AUPRC (candidate gene set of 5 genes including the causative gene)AUPRC (candidate gene set of 50 genes including the causative gene)AUPRC (candidate gene set of 75 genes including the causative gene)AUROC (candidate gene set of 100 genes including the causative gene)AUROC (candidate gene set of 25 genes including the causative gene)AUROC (candidate gene set of 5 genes including the causative gene)AUROC (candidate gene set of 50 genes including the causative gene)AUROC (candidate gene set of 75 genes including the causative gene)Top-1 accuracy (candidate gene set of 100 genes including the causative gene)Top-1 accuracy (candidate gene set of 25 genes including the causative gene)Top-1 accuracy (candidate gene set of 5 genes including the causative gene)Top-1 accuracy (candidate gene set of 50 genes including the causative gene)Top-1 accuracy (candidate gene set of 75 genes including the causative gene)Top-10 accuracy (candidate gene set of 100 genes including the causative gene)Top-10 accuracy (candidate gene set of 25 genes including the causative gene)Top-10 accuracy (candidate gene set of 5 genes including the causative gene)Top-10 accuracy (candidate gene set of 50 genes including the causative gene)Top-10 accuracy (candidate gene set of 75 genes including the causative gene)
GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)EvaluationRanking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3), ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)0.622 (best in column)0.802 (best in column)0.9440.806 (best in column)0.663 (best in column)0.9110.9640.9910.971 (best in column)0.92568% (best in column)82% (best in column)93%81% (best in column)71% (best in column)81%94%100% (best in column)96% (best in column)82%
GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)EvaluationRanking the causative gene within synthetic candidate sets of 5 to 100 genes, PAVS (Kafkas et al. 2025 Table 3), PAVS Saudi phenotype-associated variants, 500 genes (Kafkas et al. 2025)0.50.7530.9430.6390.5530.8950.97 (best in column)0.9890.9490.992 (best in column)56.4%75.4%93%66.4%59.8%77.2%97.8%100% (best in column)91%83.4%
GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)EvaluationRanking the causative gene within synthetic candidate sets of 5 to 100 genes, GPCards (Kafkas et al. 2025 Table 3), GPCards gene-phenotype cases (free-text phenotypes) (Kafkas et al. 2025)0.3430.770.985 (best in column)0.7230.5760.928 (best in column)0.9610.998 (best in column)0.9620.91960%78%98% (best in column)76%62%86% (best in column)98% (best in column)100% (best in column)94%86% (best in column)
All 60 result rows with coverage, uncertainty and sources
Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.622 AUPRC (candidate gene set of 100 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'AUPR', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.911 AUROC (candidate gene set of 100 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'ROC AUC', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
68% Top-1 accuracy (candidate gene set of 100 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'Hits@1 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
81% Top-10 accuracy (candidate gene set of 100 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'Hits@10 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.802 AUPRC (candidate gene set of 25 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 25, 'AUPR', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.964 AUROC (candidate gene set of 25 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 25, 'ROC AUC', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
82% Top-1 accuracy (candidate gene set of 25 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 25, 'Hits@1 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
94% Top-10 accuracy (candidate gene set of 25 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 25, 'Hits@10 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.944 AUPRC (candidate gene set of 5 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 5, 'AUPR', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.991 AUROC (candidate gene set of 5 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 5, 'ROC AUC', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
93% Top-1 accuracy (candidate gene set of 5 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 5, 'Hits@1 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
100% Top-10 accuracy (candidate gene set of 5 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 5, 'Hits@10 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.806 AUPRC (candidate gene set of 50 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 50, 'AUPR', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.971 AUROC (candidate gene set of 50 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 50, 'ROC AUC', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
81% Top-1 accuracy (candidate gene set of 50 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 50, 'Hits@1 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
96% Top-10 accuracy (candidate gene set of 50 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 50, 'Hits@10 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.663 AUPRC (candidate gene set of 75 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 75, 'AUPR', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
0.925 AUROC (candidate gene set of 75 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 75, 'ROC AUC', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
71% Top-1 accuracy (candidate gene set of 75 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 75, 'Hits@1 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, ClinVar (Kafkas et al. 2025 Table 3)
Dataset: ClinVar variants added 2 July to 7 October 2023, 100 genes (Kafkas et al. 2025)
82% Top-10 accuracy (candidate gene set of 75 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on ClinVar candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-clinvar-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 75, 'Hits@10 (%)', column 'ClinVar' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, GPCards (Kafkas et al. 2025 Table 3)
Dataset: GPCards gene-phenotype cases (free-text phenotypes) (Kafkas et al. 2025)
0.343 AUPRC (candidate gene set of 100 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on GP-Cards candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-gpcards-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'AUPR', column 'GP-Cards' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, GPCards (Kafkas et al. 2025 Table 3)
Dataset: GPCards gene-phenotype cases (free-text phenotypes) (Kafkas et al. 2025)
0.928 AUROC (candidate gene set of 100 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on GP-Cards candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-gpcards-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'ROC AUC', column 'GP-Cards' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, GPCards (Kafkas et al. 2025 Table 3)
Dataset: GPCards gene-phenotype cases (free-text phenotypes) (Kafkas et al. 2025)
60% Top-1 accuracy (candidate gene set of 100 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on GP-Cards candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-gpcards-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'Hits@1 (%)', column 'GP-Cards' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, GPCards (Kafkas et al. 2025 Table 3)
Dataset: GPCards gene-phenotype cases (free-text phenotypes) (Kafkas et al. 2025)
86% Top-10 accuracy (candidate gene set of 100 genes including the causative gene)
percent · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on GP-Cards candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-gpcards-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 100, 'Hits@10 (%)', column 'GP-Cards' 'GPT-4' 'Zero shot'
Configuration: GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)Protocol: Ranking the causative gene within synthetic candidate sets of 5 to 100 genes, GPCards (Kafkas et al. 2025 Table 3)
Dataset: GPCards gene-phenotype cases (free-text phenotypes) (Kafkas et al. 2025)
0.77 AUPRC (candidate gene set of 25 genes including the causative gene)
fraction · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Author-reported evaluation · Source checked
Methods, coverage and source

GPT-4 Zero shot on GP-Cards candidate gene sets

rare-ranking-20261009-protocol-kafkas2025-gpcards-gene-sets

Aggregation: Not reported

The application of Large Language Models to the phenotype-based prioritization of causative genes in rare disease patients · Table 3 row Size 25, 'AUPR', column 'GP-Cards' 'GPT-4' 'Zero shot'

Source checking is not independent reproduction. Release 2026-11-02-a7f03c9e55a5.

Use this configuration

How it works, versions and access

Additional methodological details, versions and access terms have not yet been extracted into a structured profile for this configuration. Consult the linked sources and evaluation records below.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-11-02-a7f03c9e55a5
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-11-02-a7f03c9e55a5 · Record review: source checked

1 source record and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: rare-ranking-20261009-config-kafkas2025-gpt-4-zero-shot

areas
dna-genomes
contexts
clinical_research
method types
foundation_model
reported name
GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025)
foundation model eligible
true
version
gpt-4-1106-preview
parameters
Zero-shot gene-ranking prompt; the specific zero-shot prompt (Q1-Q3 or Q2Q3) used in Table 3 is not stated
source locator
Table 1; Table 3; Methods 'Prompt engineering'
provenance note
GPT-4 (gpt-4-1106-preview), zero-shot prompt (Kafkas et al. 2025) as evaluated in the cited comparison.
Related records

Suggest a correction