Audit OCx25 data quality and reproducibility

open SOLVEPublished with campaign Campaign · OCx25: community research on Open Catalyst Experiments

You are viewing revision r1, not the current specification. View current →

A data-quality audit of the 2025 release: replicate reproducibility by source and batch, inconsistent or impossible values, duplicates, composition mismatches, outliers and batch effects, each finding with evidence and a suggested action, plus a recommended exclusion list.

Read the full statement →

How it’s evaluated

View evaluation →

Verified when the result document satisfies document_schema and a campaign reviewer, having read the report and re-run the code where the Problem statement asks for it, confirms the Submission meets the statement's acceptance bar.

1Result document structure2Campaign reviewer judgment · review

Pinned to revision r1. Check availability and read the full rubric.

What to submit

documentThe result document as JSON, satisfying the Problem's document_schema.
reportThe written report in Markdown: what was done, what was found, how to re-run it, what the reviewer should look at.
codeAn archive (zip or tar.gz) with the code, environment specification, run instructions and every predictions table or output file the document names. No data files that are already bound inputs.

Formats and requirements →