These checks assess whether the evidence supports a reproducible investigation. A source-checked score alone does not meet these requirements.
Evidence completeReplay metrics
Exact outcomes, predictions, identifiers and evaluator are connected.
Supporting evidence
- flip2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
- flip2-discrepancies: join_integrity: 184 unique test IDs; scores and outcomes reconcile.
- flip2-discrepancies: score_semantics: Higher scores predict higher spectral wavelength; metrics retain their own direction.
- flip2-discrepancies: metric_replay: Saved predictions reproduce recorded metrics within 1e-9 absolute tolerance.
Verified: 2026-09-23
Evidence completeInvestigate discrepancies
Replay evidence includes annotations and an assessment of dependence. Unknown independence permits descriptive analysis only.
Supporting evidence
- flip2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
- flip2-discrepancies: join_integrity: 184 unique test IDs; scores and outcomes reconcile.
- flip2-discrepancies: score_semantics: Higher scores predict higher spectral wavelength; metrics retain their own direction.
- flip2-discrepancies: metric_replay: Saved predictions reproduce recorded metrics within 1e-9 absolute tolerance.
- flip2-discrepancies: annotations: Registered subgroup fields derive from the preserved source snapshot.
- flip2-discrepancies: dependence: Independent sampling unit unknown; descriptive analysis only.
Verified: 2026-09-23
Evidence completeRun locally
A pinned recipe describes the inputs, environment and resource requirements.
Supporting evidence
- flip2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
- flip2-discrepancies: join_integrity: 184 unique test IDs; scores and outcomes reconcile.
- flip2-discrepancies: score_semantics: Higher scores predict higher spectral wavelength; metrics retain their own direction.
- flip2-discrepancies: recipe_pinned: Registered SDK recipe; implementation artifact and environment hashes retained.
- flip2-discrepancies: resource_estimate: Local CPU controls previously executed; all jobs remain subject to the campaign watchdog.
Verified: 2026-09-23
Evidence incompleteValidate independently
Separate data and exposure records support an independent test.
Missing or unresolved evidence
- independent validation: verification is missing
- overlap checked: verification is missing
- Data has already been exposed during hypothesis selection; it is not untouched validation.
Supporting evidence
- flip2-discrepancies: artifact_hashes: Exact local bytes recorded; source pins checked where available.
- flip2-discrepancies: join_integrity: 184 unique test IDs; scores and outcomes reconcile.
- flip2-discrepancies: score_semantics: Higher scores predict higher spectral wavelength; metrics retain their own direction.
Verified: 2026-09-23
Readiness describes the evidence in this release. Availability on your computer is checked separately when an investigation runs. Existing data exposure can prevent independent validation even when files are available.
One or more artifacts need a local resolver. Their checksums are recorded, but this release does not provide every download.
FLIP2 Rhomax: metric interpretation control
Why can a constant predictor have high NDCG and undefined Spearman correlation?
- Manifest
- flip2-discrepancies
- Prepared outcome
- spectral wavelength
- Outcome type
- continuous
- Units
- nm
- Score direction
- higher
- Join identifier
- id
- Unit of independence
- Not reported
- Split
- test
- Prior data exposure
- Already used for exploration; not untouched validation
Evaluation protocol and run instructions
Resolve each required artifact from its recorded source, verify its SHA-256, and retain the prepared snapshot and identifiers. A missing public URL means this release does not redistribute that file.
flip2-discrepancies-prepared
prepared · json
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: df996aee84bd5ed3e6381f9f6db864a377ab0b4809a9a48ff146d06a3dc069df
Semantic SHA-256: f417d43497e0c8c453bd7c66cfea05959b4d6d47462283096e42a2dae8b72419 (separate from the file checksum)
flip2-discrepancies-flip2-composition-predictions
flip2-composition-predictions · json
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: 72ea3c506b8645ae6020207f904fbd5c0b09549cd125fcdcabfb487e68681b9c
flip2-discrepancies-flip2-composition-report
flip2-composition-report · json
Artifact source
File SHA-256: abd08d3f493428d06f43740c94e268575d755560e72120c73b294127acb395e6
flip2-discrepancies-flip2-composition-source
flip2-composition-source · json
Artifact source
File SHA-256: 7157313eab75ff8f93b934ac186852c8c82f8bb885617cab70c89427c631c1e4
flip2-discrepancies-flip2-train-mean-predictions
flip2-train-mean-predictions · json
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: 599dca4e6fa643a7cdfc96ac339033f61e5846ce225af17ac2ac3917ecc14fac
flip2-discrepancies-flip2-train-mean-report
flip2-train-mean-report · json
Artifact source
File SHA-256: eb89260f6e138bb9ae2fdf3b882a87fdf8aeabd54a0ac6f17a73f5671c96b4d8
flip2-discrepancies-flip2-train-mean-source
flip2-train-mean-source · json
Artifact source
File SHA-256: 8bd712289f136edbfde3fa885166ef85e4f6fe3c4c437810c24dadb87107cc3f
flip2-discrepancies-recipe_code
recipe code · py
Artifact source
File SHA-256: b3407940ca4c8a1cdcf3a3bb3849c3e26d7f85272b2ee63087307378ffaa79dc
flip2-discrepancies-table
table · json
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: 8562d4891270a73026fc7852c05f41206ad52e8fcae1d706d83ec57572c7c949
flip2-discrepancies-receipt
receipt · json
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: 68631e653cd5aa9047b3f4e88cbb3fec94630847c1b73fad8de1018423d81fac
flip2-discrepancies-preparation_code
preparation code · py
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: 8a1d691de8fdd9fcf8242fe6fa2cfe2703a1c3281b880fe2a226cb8bd946fd1b
flip2-discrepancies-environment
environment · lock
No public download in this release. Obtain access using the documented source and terms.
File SHA-256: 748257abb3664595db1ebf892799e91c6f1a4ca79b0e65eccb3958cf5644a671
Registered recipes and verification receipt
- Local recipes
- sdk:train-mean-v1; sdk:sequence-composition-v1
- Verification
- verified at: 2026-09-23T23:00:14.349323+00:00; checks: check: artifact_hashes; status: passed; detail: Exact local bytes recorded; source pins checked where available.; check: join_integrity; status: passed; detail: 184 unique test IDs; scores and outcomes reconcile.; check: score_semantics; status: passed; detail: Higher scores predict higher spectral wavelength; metrics retain their own direction.; check: metric_replay; status: passed; detail: Saved predictions reproduce recorded metrics within 1e-9 absolute tolerance.; check: annotations; status: passed; detail: Registered subgroup fields derive from the preserved source snapshot.; check: dependence; status: passed; detail: Independent sampling unit unknown; descriptive analysis only.; check: recipe_pinned; status: passed; detail: Registered SDK recipe; implementation artifact and environment hashes retained.; check: resource_estimate; status: passed; detail: Local CPU controls previously executed; all jobs remain subject to the campaign watchdog.; limitations: Existing test outcomes are exposed; no independent validation is claimed.; Independent experimental grouping is unavailable; subgroup summaries are descriptive.; Prepared opaque IDs must not be joined to a newly prepared snapshot by ID.; High wavelength is not universally biologically preferable; NDCG is a numerical ranking metric.; Known methodological control, not a novel biological finding.