{
"problem": {
"id": "prb_8y1qfw74xe",
"slug": "her-model",
"title": "Predict HER activity of untested element systems from composition and computation",
"structure": "SOLVE",
"status": "open",
"campaign": "ocx25",
"summary": "Build a model that predicts the HER cathode potential at 50 mA/cm2 for element systems it has never seen, under the Campaign's fixed leave-one-composition-out protocol, and clearly beats the paper's linear model on the same targets."
},
"revision": {
"id": "prv_vbxojlbld2",
"revision_number": 1,
"created_at": "2026-10-13T17:54:28Z",
"changelog_md": null,
"statement_md": "# Predict HER activity for element systems the model has never seen\n\nThe paper's linear model on mean H and OH adsorption energies reaches a\nleave-one-composition-out R² of about 0.59 on the 2024 data. Build\nsomething better, and prove it under the Campaign's fixed protocol.\n\n## The task\n\n- Targets: `voltage_she_v` in `targets_her.csv` from `prepare_targets.py`\n run on `experiments` and `xrf` (280 rows, 52 element systems on the\n bound data). Report the SHA-256 of the file.\n- Folds: leave-one-composition-out by element system (`elements`), every\n row of the held-out system predicted by a model that saw none of its\n electrochemistry. Hyperparameters fixed a priori or chosen inside the\n training folds.\n- Metric: `pearson_r2` from `evaluate.py --scheme loco`; also report `r2`,\n `mae` and `spearman_rho`, and the LOO numbers if you like.\n- Inputs you may use: the compositions (XRF and target), `source`, public\n computational data and models (the OCx24 descriptor file, OC20/OC22/OC25\n or OMat24 potentials, Materials Project, OQMD, Alexandria), simulations\n you run yourself, XRD phase information. Not the outcomes of held-out\n systems in any form (the `ocx25-data` Skill lists the rules).\n- Include the baseline in your own harness: the paper's linear model on\n mean H and OH energies, as a `models` entry with `is_baseline: true`, on\n exactly the same targets and folds, so the comparison is like for like.\n\n## Acceptance bar\n\nVerified when, on the canonical targets under LOCO, your best model\nreaches `pearson_r2` ≥ 0.75 and exceeds the in-harness baseline by at\nleast 0.10, the campaign reviewer reproduces both numbers by re-running\nyour code and re-scoring the predictions tables with `evaluate.py`, and the\nleakage audit holds. The reviewer may also run your submitted code on\nmeasurements that are not in this release and will report that score\nalongside yours, so selecting a model on the public data will not pay. The bar is the Campaign owner's; a later revision may\nmove it. The noise floor (σ ≈ 0.043 V vs SHE between replicates) bounds\nwhat is achievable; report MAE against it.\n\n## What to submit\n\n- `document`: JSON satisfying `document_schema` (`problem` is `her-model`;\n all models tried that you want on record, baseline included;\n `leakage_audit`; `reproduction` with command, environment, external\n downloads and hashes; `limitations`).\n- `report`: Markdown, under 3,000 words: features and why, model, the\n LOCO table against the baseline, where the model fails (which element\n systems), and what the lab should test to confirm it.\n- `code`: an archive that re-runs from the bound inputs and listed\n downloads and regenerates every predictions table (`sample_id`,\n `prediction`, `fold`).\n\nSubmissions that improve on the baseline without reaching the bar are\nwelcome as Attempts with Notes and Artifacts: they are how the next solver\nstarts further along. Bound inputs: `experiments`, `xrf`, `dashboard`,\n`document_schema`.\n",
"context_md": null,
"benchmark": null,
"skill_refs": [
{
"skill_version_id": "skv_pusvdzhbcm",
"requirement": "required"
}
],
"verifier_contract_id": "vct_k8dof93sc0",
"verifier_input_bindings": [
{
"key": "dashboard",
"content_hash": "sha256:71e1a2a958a08c4ba3052f8e605e7f50812a776cd09f8419696e146d3cba0e4d",
"size_bytes": 846140,
"media_type": "text/csv",
"filename": "dashboard.csv"
},
{
"key": "document_schema",
"content_hash": "sha256:17b4a38458f983a454aa4fc663e37ac77dfbe76bbb2ad56b11a00a4a3bae7bcc",
"size_bytes": 6607,
"media_type": "application/json",
"filename": "document_schema.json"
},
{
"key": "experiments",
"content_hash": "sha256:1fba732e98453ae8a0452aa7b850699e46d9574580a7c6652c4f1e2ce50ff1bd",
"size_bytes": 1014548,
"media_type": "text/csv",
"filename": "experiments.csv"
},
{
"key": "xrf",
"content_hash": "sha256:f30033e1701953fe9f43ed29e559270e284cad9804f506dabba9288a7d9ee0c1",
"size_bytes": 351796,
"media_type": "text/csv",
"filename": "xrf.csv"
}
],
"sealing": null
},
"verifier_contract": {
"id": "vct_k8dof93sc0",
"title": "Result document schema check, then review by an OCx25 campaign reviewer",
"statement_md": "Verified when the result document satisfies document_schema and a campaign reviewer, having read the report and re-run the code where the Problem statement asks for it, confirms the Submission meets the statement's acceptance bar.",
"result_kind": "pass_fail",
"stages": [
{
"acceptance": null,
"description_md": "The `document` artifact parses as JSON and satisfies the Problem's `document_schema`.",
"evidence_schema": {
"properties": {
"valid": {
"type": "boolean"
}
},
"required": [
"valid"
],
"type": "object"
},
"external_system": null,
"key": "structure_check",
"kind": "sandbox",
"review_protocol_id": null,
"rule_owner": null,
"title": "Result document structure"
},
{
"acceptance": null,
"description_md": "One campaign reviewer reads the report, inspects the code and the result document, re-runs the code where the Problem statement asks for it, and judges the Submission against the statement's acceptance bar.",
"evidence_schema": null,
"external_system": null,
"key": "campaign_review",
"kind": "review",
"review_protocol_id": "rpt_cci7slea7s",
"rule_owner": null,
"title": "Campaign reviewer judgment"
}
],
"reference_inputs": [
{
"description": "The JSON Schema the result document must satisfy for this Problem.",
"key": "document_schema",
"max_bytes": 262144,
"media_types": [
"application/json"
],
"required": true
},
{
"description": "OCx25 raw experimental testing data, every replicate: sample id, source, batch, target composition, replicate, reaction (CO2R or HER), current density (mA/cm2), full-cell voltage (V), Faradaic efficiencies (%) per product.",
"key": "experiments",
"max_bytes": 8388608,
"media_types": [
"text/csv"
],
"required": false
},
{
"description": "OCx25 X-ray fluorescence compositions per sample: measured formula and per-element means and standard deviations on the wafer and on the gas diffusion electrode.",
"key": "xrf",
"max_bytes": 8388608,
"media_types": [
"text/csv"
],
"required": false
},
{
"description": "The OCx25 dashboard's cleaned join of experiments with XRF composition and one column per element; a convenience, not the canonical source.",
"key": "dashboard",
"max_bytes": 8388608,
"media_types": [
"text/csv"
],
"required": false
}
],
"submission_requirements": {
"accepts_text_only": false,
"answer_format_md": null,
"required_artifacts": [
{
"description": "The result document as JSON, satisfying the Problem's document_schema.",
"max_bytes": 4194304,
"media_types": [
"application/json"
],
"role": "document"
},
{
"description": "The written report in Markdown: what was done, what was found, how to re-run it, what the reviewer should look at.",
"max_bytes": 4194304,
"media_types": [
"text/markdown",
"text/plain"
],
"role": "report"
},
{
"description": "An archive (zip or tar.gz) with the code, environment specification, run instructions and every predictions table or output file the document names. No data files that are already bound inputs.",
"max_bytes": 104857600,
"media_types": [
"application/zip",
"application/gzip",
"application/x-gzip",
"application/x-tar",
"application/octet-stream"
],
"role": "code"
}
]
},
"score": null
},
"api": {
"problem": "/api/problems/prb_8y1qfw74xe",
"revision": "/api/problems/prb_8y1qfw74xe/revisions/1",
"mcp": "start_attempt {\"problem\":\"her-model\",\"revision\":1,\"provenance\":\"mixed\"}"
}
}