rewirebio.iobenchmarks
Dataset

TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot

Topics and pooled relevance and evidence judgements of the TREC 2020 Precision Medicine track.

Research readiness

These checks assess whether the evidence supports a reproducible investigation. A source-checked score alone does not meet these requirements.

Release 2026-10-10-7b8f80935f90 · Evidence verified: Not verified

Evidence incomplete

Replay metrics

Exact outcomes, predictions, identifiers and evaluator are connected.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • metric replay: verification is missing

Verified: Not verified

Evidence incomplete

Investigate discrepancies

Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • metric replay: verification is missing
  • annotations: verification is missing
  • dependence: verification is missing

Verified: Not verified

Evidence incomplete

Run locally

A pinned recipe describes the inputs, environment and resource requirements.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • recipe pinned: verification is missing
  • resource estimate: verification is missing

Verified: Not verified

Evidence incomplete

Validate independently

Separate data and exposure records support an independent test.

Missing or unresolved evidence

  • No verified artifact manifest is linked to this exact record.
  • artifact hashes: verification is missing
  • join integrity: verification is missing
  • score semantics: verification is missing
  • independent validation: verification is missing
  • overlap checked: verification is missing

Verified: Not verified

Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.

Artifacts and reproduction

No verified artifact manifest is connected to this record yet. The gaps above identify what is needed before analysis can begin.

Read reviewed discrepancy investigations

Evaluation results

15 evaluations · 25 results. Different protocols are not a single leaderboard.

Filter evaluations

Applied filters: All linked evaluations

Exact evaluated configurations and original reported results
Tested configurationProtocol and datasetFindingEvidence and details
Configuration: TREC 2020 PM run baseline (BIT.UA)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.532 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

baseline (BIT.UA), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'infNDCG', row 1: team 'BIT.UA', run 'baseline'
Configuration: TREC 2020 PM run baseline (BIT.UA)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.552 precision-at-10
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

baseline (BIT.UA), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'P@10', row 2: team 'BIT.UA', run 'baseline'
Configuration: TREC 2020 PM run baseline (BIT.UA)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.421 r-precision
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

baseline (BIT.UA), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'R-prec', row 2: team 'BIT.UA', run 'baseline'
Configuration: TREC 2020 PM run bm25 (ASCFDA)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.535 precision-at-10
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

bm25 (ASCFDA), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'P@10', row 4: team 'ASCFDA', run 'bm25'
Configuration: TREC 2020 PM run CSIROmed_strRR (CSIROmed)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.53 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CSIROmed_strRR (CSIROmed), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'infNDCG', row 2: team 'CSIROmed', run 'CSIROmed strRR'
Configuration: TREC 2020 PM run CSIROmed_strRR (CSIROmed)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.565 precision-at-10
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CSIROmed_strRR (CSIROmed), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'P@10', row 1: team 'CSIROmed', run 'CSIROmed strRR'
Configuration: TREC 2020 PM run CSIROmed_strRR (CSIROmed)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.436 r-precision
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

CSIROmed_strRR (CSIROmed), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'R-prec', row 1: team 'CSIROmed', run 'CSIROmed strRR'
Configuration: TREC 2020 PM run damoespcbh3 (ALIBABA)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.452 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

damoespcbh3 (ALIBABA), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'exp-gains', row 1: team 'ALIBABA', run 'damoespcbh3'
Configuration: TREC 2020 PM run damoespcbh3 (ALIBABA)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.478 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

damoespcbh3 (ALIBABA), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'std-gains', row 1: team 'ALIBABA', run 'damoespcbh3'
Configuration: TREC 2020 PM run duoT5 (h2oloo)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.512 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

duoT5 (h2oloo), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'infNDCG', row 4: team 'h2oloo', run 'duoT5'
Configuration: TREC 2020 PM run monoT5 (h2oloo)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.402 r-precision
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

monoT5 (h2oloo), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'R-prec', row 5: team 'h2oloo', run 'monoT5'
Configuration: TREC 2020 PM run monoT5rct (h2oloo)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.419 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

monoT5rct (h2oloo), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'exp-gains', row 2: team 'h2oloo', run 'monoT5rct'
Configuration: TREC 2020 PM run monoT5rct (h2oloo)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.424 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

monoT5rct (h2oloo), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'std-gains', row 2: team 'h2oloo', run 'monoT5rct'
Configuration: TREC 2020 PM run pozbaseline (POZNAN)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.532 precision-at-10
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

pozbaseline (POZNAN), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'P@10', row 5: team 'POZNAN', run 'pozbaseline'
Configuration: TREC 2020 PM run r1st (PINGAN NLP)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.418 r-precision
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

r1st (PINGAN NLP), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'R-prec', row 3: team 'PINGAN NLP', run 'r1st'
Configuration: TREC 2020 PM run rrf (BIT.UA)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.329 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

rrf (BIT.UA), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'exp-gains', row 4: team 'BIT.UA', run 'rrf'
Configuration: TREC 2020 PM run rrf_prf_rprec (ims unipd)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.316 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

rrf_prf_rprec (ims unipd), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'exp-gains', row 5: team 'ims unipd', run 'rrf prf rprec'
Configuration: TREC 2020 PM run rrf (BIT.UA)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.372 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

rrf (BIT.UA), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'std-gains', row 3: team 'BIT.UA', run 'rrf'
Configuration: TREC 2020 PM run sibtm_run1 (BITEM)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.528 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

sibtm_run1 (BITEM), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'infNDCG', row 3: team 'BITEM', run 'sibtm run1'
Configuration: TREC 2020 PM run sibtm_run1 (BITEM)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.402 r-precision
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

sibtm_run1 (BITEM), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'R-prec', row 4: team 'BITEM', run 'sibtm run1'
Configuration: TREC 2020 PM run uog_ufmg_sb_df5 (UoGTr)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.329 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

uog_ufmg_sb_df5 (UoGTr), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'exp-gains', row 3: team 'UoGTr', run 'uog ufmg sb df5'
Configuration: TREC 2020 PM run uog_ufmg_sb_df5 (UoGTr)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.498 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

uog_ufmg_sb_df5 (UoGTr), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'infNDCG', row 5: team 'UoGTr', run 'uog ufmg sb df5'
Configuration: TREC 2020 PM run uog_ufmg_sb_df5 (UoGTr)Protocol: TREC 2020 PM Phase 1: topical relevance of retrieved MEDLINE abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.548 precision-at-10
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

uog_ufmg_sb_df5 (UoGTr), TREC 2020 PM Phase 1

egfrnsclc-20261009-protocol-trec2020-pm-phase1-relevance

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 5 (PDF page 9), block 'P@10', row 3: team 'UoGTr', run 'uog ufmg bg df5'
Configuration: TREC 2020 PM run uog_ufmg_sb_df5 (UoGTr)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.368 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

uog_ufmg_sb_df5 (UoGTr), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'std-gains', row 4: team 'UoGTr', run 'uog ufmg sb df5'
Configuration: TREC 2020 PM run uwman (MRG UWaterloo)Protocol: TREC 2020 PM Phase 2: evidence-tier-weighted ranking of retrieved abstracts
Dataset: TREC 2020 Precision Medicine: 40 cancer-gene-treatment topics over a 2019 MEDLINE baseline snapshot
0.356 ndcg
unitless · higher

Uncertainty: Not reported by the source

Coverage: Not reported scored / Not reported eligible

Independent external evaluation · Source checked
Methods, coverage and source

uwman (MRG UWaterloo), TREC 2020 PM Phase 2

egfrnsclc-20261009-protocol-trec2020-pm-phase2-evidence

Aggregation: Not reported

Overview of the TREC 2020 Precision Medicine Track; NIST TREC Browser, Precision Medicine 2020 runs page · Overview Table 6 (PDF page 9), block 'std-gains', row 5: team 'MRG UWaterloo', run 'uwman'

Source checking is not independent reproduction. Release 2026-10-10-7b8f80935f90.

Dataset and evaluation context

A dataset supplies biological observations. The evaluation protocol defines how those observations are split, used and scored.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

14 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-10-10-7b8f80935f90
Property and statementOriginal source and locationReview and provenance
attributes.population
40 topics, each a cancer, a gene and a treatment; topics 15 and 16 are EGFR-mutant non-small cell lung cancer with afatinib and osimertinib. 22,806 Phase 1 relevance judgements and 2,691 Phase 2 evidence judgements; runs were scored on 31 topics (run appendix PDFs, not a source record of this batch).
Context-only references
Overview of the TREC 2020 Precision Medicine Track

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Proceedings of the Twenty-Ninth Text REtrieval Conference (TREC 2020), NIST Special Publication 1266; 10-page PDF
Retrieved: 2026-10-09T20:41:38Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.population

Source artifact SHA-256: 7951225ee5b517fac7bf5f5739c6a118182ce84a5c3f5ddd2284d85262c126c2

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.population
40 topics, each a cancer, a gene and a treatment; topics 15 and 16 are EGFR-mutant non-small cell lung cancer with afatinib and osimertinib. 22,806 Phase 1 relevance judgements and 2,691 Phase 2 evidence judgements; runs were scored on 31 topics (run appendix PDFs, not a source record of this batch).
Context-only references
TREC 2020 Precision Medicine topics

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: topics2020.xml as served on 2026-10-09 (40 topics)
Retrieved: 2026-10-09T20:40:57Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.population

Source artifact SHA-256: 18053304a8a507aed3d98ed63573738aabed38e17420798f466a8b5ee4275e32

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.scope_note
Topics give no prior therapy, line of treatment or resistance context.
Context-only references
Overview of the TREC 2020 Precision Medicine Track

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Proceedings of the Twenty-Ninth Text REtrieval Conference (TREC 2020), NIST Special Publication 1266; 10-page PDF
Retrieved: 2026-10-09T20:41:38Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.scope_note

Source artifact SHA-256: 7951225ee5b517fac7bf5f5739c6a118182ce84a5c3f5ddd2284d85262c126c2

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.scope_note
Topics give no prior therapy, line of treatment or resistance context.
Context-only references
TREC 2020 Precision Medicine topics

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: topics2020.xml as served on 2026-10-09 (40 topics)
Retrieved: 2026-10-09T20:40:57Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.scope_note

Source artifact SHA-256: 18053304a8a507aed3d98ed63573738aabed38e17420798f466a8b5ee4275e32

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.source_locator
Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics
Context-only references
Overview of the TREC 2020 Precision Medicine Track

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Proceedings of the Twenty-Ninth Text REtrieval Conference (TREC 2020), NIST Special Publication 1266; 10-page PDF
Retrieved: 2026-10-09T20:41:38Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 7951225ee5b517fac7bf5f5739c6a118182ce84a5c3f5ddd2284d85262c126c2

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.source_locator
Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics
Context-only references
TREC 2020 Precision Medicine topics

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: topics2020.xml as served on 2026-10-09 (40 topics)
Retrieved: 2026-10-09T20:40:57Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.source_locator

Source artifact SHA-256: 18053304a8a507aed3d98ed63573738aabed38e17420798f466a8b5ee4275e32

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.total
40
Context-only references
Overview of the TREC 2020 Precision Medicine Track

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Proceedings of the Twenty-Ninth Text REtrieval Conference (TREC 2020), NIST Special Publication 1266; 10-page PDF
Retrieved: 2026-10-09T20:41:38Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.total

Source artifact SHA-256: 7951225ee5b517fac7bf5f5739c6a118182ce84a5c3f5ddd2284d85262c126c2

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.total
40
Context-only references
TREC 2020 Precision Medicine topics

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: topics2020.xml as served on 2026-10-09 (40 topics)
Retrieved: 2026-10-09T20:40:57Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.total

Source artifact SHA-256: 18053304a8a507aed3d98ed63573738aabed38e17420798f466a8b5ee4275e32

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.version
TREC 2020 PM (MEDLINE baseline snapshot of the 2019 track)
Context-only references
Overview of the TREC 2020 Precision Medicine Track

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: Proceedings of the Twenty-Ninth Text REtrieval Conference (TREC 2020), NIST Special Publication 1266; 10-page PDF
Retrieved: 2026-10-09T20:41:38Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 7951225ee5b517fac7bf5f5739c6a118182ce84a5c3f5ddd2284d85262c126c2

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

attributes.version
TREC 2020 PM (MEDLINE baseline snapshot of the 2019 track)
Context-only references
TREC 2020 Precision Medicine topics

Original source ↗

Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics

Shared locator for this statement’s cited sources; not a separate locator for each citation.

Version: topics2020.xml as served on 2026-10-09 (40 topics)
Retrieved: 2026-10-09T20:40:57Z

not individually reviewed

No individual claim review recorded

Audit details

Field: attributes.version

Source artifact SHA-256: 18053304a8a507aed3d98ed63573738aabed38e17420798f466a8b5ee4275e32

Hash scope: Hash scope not separately documented; inspect source record

Inspected artifact

Sources and history

Release 2026-10-10-7b8f80935f90 · Record review: source checked

2 source records and release historyDownload this release (gzip)
Technical metadata and extraction receipts

Stable ID: egfrnsclc-20261009-data-trec2020-pm-topics-medline

areas
dna-genomes
contexts
clinical_research
version
TREC 2020 PM (MEDLINE baseline snapshot of the 2019 track)
total
40
population
40 topics, each a cancer, a gene and a treatment; topics 15 and 16 are EGFR-mutant non-small cell lung cancer with afatinib and osimertinib. 22,806 Phase 1 relevance judgements and 2,691 Phase 2 evidence judgements; runs were scored on 31 topics (run appendix PDFs, not a source record of this batch).
scope note
Topics give no prior therapy, line of treatment or resistance context.
source locator
Overview sections 3-6 and Table 3; topics2020.xml topics 15-16; run appendix PDFs list 31 topics
Related records

Suggest a correction