CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3)
bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. · Preprint
What this source contributed
Records in this release that cite this source. A record can cite several sources.
Results
Values as the source printed them. Compare results only under compatible protocols, datasets and metrics.
| Model or configuration | Metric | Value | Dataset | Evaluation |
|---|---|---|---|---|
| Fine-tuned MedCPT cross-encoder (passage retrieval) | Success rate (appropriate passage retrieved, post-cutoff entries) | 37/40 (92.5%) percent | CIViC-Fact v3 post-cutoff temporal-evaluation cohort, 2026-03-03 to 2026-06-09 | CIViC-Fact v3 post-cutoff within-linked-publication retrieval: fine-tuned MedCPT cross-encoder |
| Qwen3-Reranker-8B (pretrained, not fine-tuned) | Success rate (appropriate passage retrieved, post-cutoff entries) | 37/40 (92.5%) percent | CIViC-Fact v3 post-cutoff temporal-evaluation cohort, 2026-03-03 to 2026-06-09 | CIViC-Fact v3 post-cutoff within-linked-publication retrieval: Qwen3-Reranker-8B (pretrained) |
Claims
Statements this source supports, each with where in the source it was checked.
- Fine-tuned MedCPT cross-encoder (passage retrieval): facets.method_types: Facets: method types ["supervised_machine_learning"] (Record description: MedCPT cross-encoder fine-tuned on the CIViC-Fact training data)
- Qwen3-Reranker-8B (pretrained, not fine-tuned): facets.method_types: Facets: method types ["foundation_model"] (Record names and descriptions: GPT-5, ChatGPT Agent Mode and Qwen3-Reranker-8B are large pretrained language models used without task training)
- Relevance of CIViC-Fact v3 within-linked-publication passage retrieval, post-cutoff cohort to "Review EGFR lung-cancer actionability evidence": Assessed by CIViC-Fact v3 within-linked-publication passage retrieval, post-cutoff cohort (ucc-clinical-egfr-source-civicfact-v3: Results, 'Passage Retrieval Models Perform Well without Fine-Tuning' subsection (printed p.14 / PDF p.15); selection chain in Methods, 'Temporal evaluation' subsection and Supplementary Figure 2 (printed p.33 / PDF p.34))
Models, benchmarks and other records
Configurations (2)
Protocols (1)
Datasets (1)
Evaluations (2)
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
21 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Access note An explicit versioned-URL fetch attempt (https://www.biorxiv.org/content/10.1101/2025.09.10.675443v3.full.pdf) returned HTTP 429 at 2026-10-07T09:48Z and was not retried. The unversioned URL above was used instead; its v3 identity is confirmed by the in-document page header ("this version posted August 29, 2026") and by the bioRxiv API version-history record (date 2026-08-29, version 3, title matches), not by fetching the versioned URL's bytes. Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact retrieved at 2026-10-07T09:28:49Z Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact SHA-256 6beb79ede82f7263a06eafc844bcb4ae41538323e3c9a9a7fa5420f08a8add55 Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Artifact url https://www.biorxiv.org/content/10.1101/2025.09.10.675443.full.pdf Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Code data model reuse Repository-root GitHub licence metadata is null and no root LICENSE file exists, per direct GitHub API inspection (gh api repos/creisle/civicfact). This does not mean the repository has no LICENSE file anywhere: a nested file, data_builder/LICENSE, is GNU GPL version 3 (29 June 2007), confirmed at pinned commit 1a767d889b015a836f0f4331afcac5cef165ec7f (https://github.com/creisle/civicfact/blob/1a767d889b015a836f0f4331afcac5cef165ec7f/data_builder/LICENSE). The adjacent data_builder/pyproject.toml does not explicitly declare a licence. This nested GPLv3 file's scope (e.g. whether it covers the full dataset, trained models, or the experiments/ and bioconverters/ directories) is not established by this inspection and is not assumed; do not treat it as licensing every repository component. Article licence (CC-BY-4.0) is a separate fact from code/data/model reuse terms. No code/data/model copies are included in this record. Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Doi 10.1101/2025.09.10.675443 Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Licence CC-BY-4.0 (article, per bioRxiv API license field cc_by) Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Publication status preprint Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Retrieved at 2026-10-07T09:28:49Z Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Review artifact data/omics/use-case-coverage-egfr-20261007/clinical/artifacts/civic-fact-v3-biorxiv.pdf.gz Source metadata | CIViC-Fact: a proof-of-concept framework for AI-assisted verification of cancer variant interpretations (bioRxiv v3) No field-specific location recorded Version: bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA. | catalogued No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
Release 2026-11-21-c8bea25e5abb · Record review: source checked
Primary source inspected for the scoped post-cutoff passage-retrieval extraction. Automated review does not establish replication.
Technical metadata and extraction receipts
Stable ID: ucc-clinical-egfr-source-civicfact-v3
- areas
- dna-genomes
- contexts
- clinical_research
- url
- https://www.biorxiv.org/content/10.1101/2025.09.10.675443.full.pdf
- retrieved at
- 2026-10-07T09:28:49Z
- version
- bioRxiv preprint doi:10.1101/2025.09.10.675443, Version 3, posted 2026-08-29 (per in-document header and bioRxiv API version metadata); published: NA.
- publication status
- preprint
- doi
- 10.1101/2025.09.10.675443
- artifact sha256
- 6beb79ede82f7263a06eafc844bcb4ae41538323e3c9a9a7fa5420f08a8add55
- artifact url
- https://www.biorxiv.org/content/10.1101/2025.09.10.675443.full.pdf
- artifact retrieved at
- 2026-10-07T09:28:49Z
- review artifact
- data/omics/use-case-coverage-egfr-20261007/clinical/artifacts/civic-fact-v3-biorxiv.pdf.gz
- code data model reuse
- Repository-root GitHub licence metadata is null and no root LICENSE file exists, per direct GitHub API inspection (gh api repos/creisle/civicfact). This does not mean the repository has no LICENSE file anywhere: a nested file, data_builder/LICENSE, is GNU GPL version 3 (29 June 2007), confirmed at pinned commit 1a767d889b015a836f0f4331afcac5cef165ec7f (https://github.com/creisle/civicfact/blob/1a767d889b015a836f0f4331afcac5cef165ec7f/data_builder/LICENSE). The adjacent data_builder/pyproject.toml does not explicitly declare a licence. This nested GPLv3 file's scope (e.g. whether it covers the full dataset, trained models, or the experiments/ and bioconverters/ directories) is not established by this inspection and is not assumed; do not treat it as licensing every repository component. Article licence (CC-BY-4.0) is a separate fact from code/data/model reuse terms. No code/data/model copies are included in this record.
- version note
- This v3 preprint is a distinct version from the PMC12458922 cached copy, which is v2 (posted 2025-09-15, same DOI, different title/author list). The two versions must not be conflated; this source record covers v3 only.
- access note
- An explicit versioned-URL fetch attempt (https://www.biorxiv.org/content/10.1101/2025.09.10.675443v3.full.pdf) returned HTTP 429 at 2026-10-07T09:48Z and was not retried. The unversioned URL above was used instead; its v3 identity is confirmed by the in-document page header ("this version posted August 29, 2026") and by the bioRxiv API version-history record (date 2026-08-29, version 3, title matches), not by fetching the versioned URL's bytes.
- licence
- CC-BY-4.0 (article, per bioRxiv API license field cc_by)