rewire.itbenchmarks
← Back to results
Protocol

CAFA3 BPO all organisms; type1 no-knowledge; mode1 · CAFA3 final benchmark; BPO; all; type1; mode1

Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.

146 evaluations · 146 results

Overview

Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Results

Each comparison retains its reviewed evaluation scope, dataset and metric. Results are shown without a pooled ranking.

CAFA3 BPO all organisms; type1 no-knowledge; mode1 · CAFA3 final benchmark; BPO; all; type1; mode1: F1-max (source entries 1–80 of 146)

F1-max (fraction) · Higher values are better.

CAFA3 BPO all organisms; type1 no-knowledge; mode1 · CAFA3 final benchmark; BPO; all; type1; mode1 · CAFA3 final benchmark; BPO; all; type1; mode1

Evidence origin: Independent external evaluation.

CAFA: Figshare 8135393 v3, file 17519846 · supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 2; ID-model=BB7U; column F1-max through supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 81; ID-model=M078; column F1-max
  • Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.
Comparison details and limitations

Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.

  • Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.
  • Exact source-defined evaluation scope; reported scores are not rewire reproductions.

Automated source review: 2026-09-19. Numerical source review does not establish independent reproduction.

Dots show point estimates. Whiskers show only explicitly defined uncertainty (standard deviation, standard error or a labelled interval); their definitions remain in Table. Unresolved uncertainty is not plotted. Differences do not establish statistical significance.

Showing 12 of 80 matching rows.

Tested configuration
00.250.50.751
Reported score
  1. CAFA3 M0610.389
  2. CAFA3 M0620.389
  3. CAFA3 M0030.382
  4. CAFA3 M0050.382
  5. CAFA3 M0040.381
  6. CAFA3 M0020.379
  7. CAFA3 M0780.378
  8. CAFA3 M0580.377
  9. CAFA3 M0590.377
  10. CAFA3 M0770.373
  11. CAFA3 M0730.371
  12. CAFA3 M0740.371

Methods and evaluation design

Procedure, tasks and evaluated configurations

Evaluation design

Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.

Benchmarks

These source-backed links do not make different protocols or scores interchangeable.

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Explore all linked results

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 2 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

No execution recipe linked to this protocol. Recipe availability does not establish a completed evaluation.

No reviewed evaluations with results linked in this release.

Literature evidence is not a Rewire measurement. Executed but unpublished runs and private review status are not included.

Null control

Proposed control: requires review

Training-set class prior where supervised fitting is permitted

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Conventional reference

Proposed control: requires review

Regularised classifier on simple permitted features, or protocol's conventional reference

Protocol-specific applicability, permitted inputs, access, split, evaluator and execution requirements need review before implementation or execution.

This is a suggested selection rule, not a validated method or a measured score.

Protocol coverage CSV · Model evaluation matrix · Source table · Release and checksums

Coverage is derived from release 2026-09-29-06401fd5b220. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run instructions

No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-29-06401fd5b220
Property and statementOriginal source and locationReview and provenance
Relationship: part of
discovery-benchmark-cafa
Individual claims		CAFA: Figshare 8135393 v3, file 17519846

Original source ↗

supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 2; ID-model=BB7U; column F1-max

Version: Figshare 8135393 v3, file 17519846
Retrieved: 2026-09-19

source checked

ai assisted source review · 2026-09-19

Audit details

Field: links:part_of:discovery-benchmark-cafa

Claim: acquired-membership-3944702c2844ba61c80d

Source artifact SHA-256: 8587fd5675e79b8450f0ab21f13a02459cdf5ff7d338a59a7be641d2ebfeb626

Hash scope: SHA-256 of the named archive member; archive SHA-256 recorded separately

Archive member: supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv

Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-29-06401fd5b220 · Record review: discovered

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: acquired-protocol-906c90560bda45e6b1af

source locator
supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 2; ID-model=BB7U; column F1-max
procedure
CAFA3 BPO all organisms; type1 no-knowledge; mode1
comparison panels
id: acquired-figure-dcf9ac92014b31c2d082; title: CAFA3 BPO all organisms; type1 no-knowledge; mode1 · CAFA3 final benchmark; BPO; all; type1; mode1: F1-max (source entries 1–80 of 146); protocol id: acquired-protocol-906c90560bda45e6b1af; dataset id: acquired-dataset-abbcdc3b3c54d87fa5b1; metric: F1-max; unit: fraction; direction: higher; result ids: acquired-result-7ad095d88ac3467440c4; acquired-result-69af065c885fba8720df; acquired-result-323a71d75aa8959fcaf1; acquired-result-682dd1efd0370714b949; acquired-result-79433b21b0b19b74d405; acquired-result-bfb3e47e9b8ecb2ba550; acquired-result-162835ba3501486b3d18; acquired-result-73207ff3c76747b4dcec; acquired-result-c8b8a05e351ecbb63bc0; acquired-result-b7378dcd2477017ce372; acquired-result-3c4bf23b96947c69949f; acquired-result-06cbbe4531c5e10bc9b4; acquired-result-e494326499cf0433a69e; acquired-result-8059b1f3ada78ecf9beb; acquired-result-052d1128f2b054f0ee2c; acquired-result-b85684982570f98ec238; acquired-result-3708f710b1fee5e0438a; acquired-result-971f976f8f6d55644501; acquired-result-a2aecac14ca0e5ddc589; acquired-result-6066c7d030e816ac028a; acquired-result-384b96ed8517ddd9c963; acquired-result-78d5f5bfec3f83a4ecb6; acquired-result-68f11ca6d2f7408e8593; acquired-result-260cc229a30669996a20; acquired-result-0e0aa85a98509d0ce44a; acquired-result-d3c5e18babfcfdc7b4a0; acquired-result-1246577de27785b00940; acquired-result-9c3597605962f8011817; acquired-result-6fe5ab1034d3685d9eb4; acquired-result-1d990476f100ca5d6192; acquired-result-922c083416ddd33bbfba; acquired-result-64ac791b6a5bc173944f; acquired-result-8844aac4d93bc0169a14; acquired-result-46c313b6e193acf74083; acquired-result-5577e0ab756bb8a4f44c; acquired-result-3456e67daefe4c1f7b15; acquired-result-916d622a0d41fe42aecc; acquired-result-3434f0ed5b4a745adb08; acquired-result-390c58a01b922d4142ec; acquired-result-b76a5a662c7f225fca32; acquired-result-a1c18c4466af8330bedd; acquired-result-68b108df5ee902ebc3cb; acquired-result-fb73f3890c11275e351f; acquired-result-90e859af7589b8b0d4bf; acquired-result-ac316bfe28c36eeee46c; acquired-result-47dbcffe9e849d3d1001; acquired-result-53714e042bdc23165046; acquired-result-99239c7a2b989ea746c1; acquired-result-aee57abf76902e08951c; acquired-result-39eddec957f367f39130; acquired-result-fa3744b972c27dfe447f; acquired-result-8709b7730b34cc879352; acquired-result-46565878c128dc25b9c1; acquired-result-c6f6857417374a58b901; acquired-result-6d7772f11dd7307f0faa; acquired-result-7cbbb8ac7c905f02afb2; acquired-result-4fe7fdad6b5557a38301; acquired-result-f050199fad9f16014792; acquired-result-cfdf219c59eb6291c43e; acquired-result-dd72aff172341ba69629; acquired-result-13ef0e4412bb797c1d92; acquired-result-6257afbfee085c246819; acquired-result-75d95dce74fb82b298dd; acquired-result-86b77297eaa597e22fd8; acquired-result-d1305d85ef4ac4733ed7; acquired-result-33096d6793e74722ebac; acquired-result-b6574bbc6901e1b2229d; acquired-result-0029941587946eae22fc; acquired-result-d72fdae1c2bc0f4fe680; acquired-result-73f84921594d03c54b60; acquired-result-a597c53eda5bbcdde0c8; acquired-result-f8a2af4483399e176430; acquired-result-0bc3b9a67a2927d45ef3; acquired-result-fcf7e37d6b7aa29d2a27; acquired-result-3b699f081bd8d839b42d; acquired-result-0a6e6a05f17ba9f3f677; acquired-result-02738500e1477cbf6420; acquired-result-b1266b5ff1975100c57c; acquired-result-4bf346212db9edbfae13; acquired-result-a293ab02870c83835c68; source ids: acquired-source-8729ad22565c7a738b41; source locator: supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 2; ID-model=BB7U; column F1-max through supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 81; ID-model=M078; column F1-max; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-210bfea190a8cd3b940e; title: CAFA3 BPO all organisms; type1 no-knowledge; mode1 · CAFA3 final benchmark; BPO; all; type1; mode1: F1-max (source entries 81–146 of 146); protocol id: acquired-protocol-906c90560bda45e6b1af; dataset id: acquired-dataset-abbcdc3b3c54d87fa5b1; metric: F1-max; unit: fraction; direction: higher; result ids: acquired-result-b91703ae1172bff4db4a; acquired-result-89e62af9e1f9bc347053; acquired-result-4604666fe84abeec47c7; acquired-result-ad233c46f9e916d0a585; acquired-result-f817479d1538a0a6be53; acquired-result-800ec249de042e5a7c65; acquired-result-7bdca7aff1c68de3f60f; acquired-result-8fd9f3ac1ba63ac07f51; acquired-result-e9c91d30ba9336f80cf5; acquired-result-0ba363ad65aed276ecfa; acquired-result-78fe6ff79e1dd68713f3; acquired-result-ba6958079e0556bcb7e4; acquired-result-20d8546168cec935317c; acquired-result-520d17bfe708cf61557f; acquired-result-863646e66db5be1cfd3a; acquired-result-284294cd6998bb1a31a2; acquired-result-64f20b300d3366a481e9; acquired-result-fe13dec686cf80afc951; acquired-result-90e044978a848b669dc4; acquired-result-5e08ebf3c54b909d2e10; acquired-result-c75b6300a82a3b63005d; acquired-result-7492d3147cfd5c4a34ee; acquired-result-09b5a04210d3aa8fee06; acquired-result-c88dd31c5d930c1cd933; acquired-result-0d54c7782eee49765c2d; acquired-result-9bec39ecf85bbe2f05d9; acquired-result-c5ffc0f128b76fe71f9e; acquired-result-1ec2a89f819951a48d23; acquired-result-9268cf21d5f59d601ba2; acquired-result-479e0b7ede0b679a9048; acquired-result-de0249ebfe385a76bcbc; acquired-result-a46dc6c1c930f0260cc6; acquired-result-cbfe0ecac26818eb630b; acquired-result-a637267f5546a8712548; acquired-result-de017024c52114b66641; acquired-result-ddc9ba9b2fe660806493; acquired-result-44524a488064534f885e; acquired-result-8ccce734adfef247c5ef; acquired-result-f8ddb63459e5cd9f7bbd; acquired-result-aba557ea51ad2bf33c44; acquired-result-509035dcb70996516260; acquired-result-ce68e38dd76be56ddf62; acquired-result-4bcf01cf27638a6f8a25; acquired-result-8a27d26d2ec680a3a279; acquired-result-8758692f18680b14f4a3; acquired-result-149cb3f8774393b42dfd; acquired-result-4f7bae7400d838088535; acquired-result-806eb20bd7f183f00e93; acquired-result-b35e7f4173156e8fb760; acquired-result-f4cc933471d05fd917cd; acquired-result-d9e067a5df2f91a120cf; acquired-result-d1c4f905aefce4715f69; acquired-result-811eed967535e7f52419; acquired-result-8f63e01f2d719ea854b9; acquired-result-8b26f116ed6f663fea1c; acquired-result-8dad08608331087ccc43; acquired-result-338542e981162d1ff811; acquired-result-e02a4f31ac77f5bea716; acquired-result-e0fe3a4b8c9c1300b81a; acquired-result-168e2b60c9e7e1901f7b; acquired-result-847db34dcc85799a4463; acquired-result-1b0a3e78b97024319377; acquired-result-0ba22cfbd52b135e01db; acquired-result-18457db343d48c900225; acquired-result-b4d343a5a802e0e9ca8d; acquired-result-5a9d7e6a26e97d7cc4fb; source ids: acquired-source-8729ad22565c7a738b41; source locator: supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 82; ID-model=M079; column F1-max through supplementary_data/cafa3/sheets/bpo_all_type1_mode1_all_fmax_sheet.csv; line 147; ID-model=M144; column F1-max; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19
scope limitations
Exact source-defined evaluation scope; reported scores are not rewire reproductions.
Related records

Suggest a correction