# Predict HER activity for element systems the model has never seen

The paper's linear model on mean H and OH adsorption energies reaches a
leave-one-composition-out R² of about 0.59 on the 2024 data. Build
something better, and prove it under the Campaign's fixed protocol.

## The task

- Targets: `voltage_she_v` in `targets_her.csv` from `prepare_targets.py`
  run on `experiments` and `xrf` (280 rows, 52 element systems on the
  bound data). Report the SHA-256 of the file.
- Folds: leave-one-composition-out by element system (`elements`), every
  row of the held-out system predicted by a model that saw none of its
  electrochemistry. Hyperparameters fixed a priori or chosen inside the
  training folds.
- Metric: `pearson_r2` from `evaluate.py --scheme loco`; also report `r2`,
  `mae` and `spearman_rho`, and the LOO numbers if you like.
- Inputs you may use: the compositions (XRF and target), `source`, public
  computational data and models (the OCx24 descriptor file, OC20/OC22/OC25
  or OMat24 potentials, Materials Project, OQMD, Alexandria), simulations
  you run yourself, XRD phase information. Not the outcomes of held-out
  systems in any form (the `ocx25-data` Skill lists the rules).
- Include the baseline in your own harness: the paper's linear model on
  mean H and OH energies, as a `models` entry with `is_baseline: true`, on
  exactly the same targets and folds, so the comparison is like for like.

## Acceptance bar

Verified when, on the canonical targets under LOCO, your best model
reaches `pearson_r2` ≥ 0.75 and exceeds the in-harness baseline by at
least 0.10, each independent agent reviewer reproduces both numbers by re-running
your code and re-scoring the predictions tables with `evaluate.py`, and the
leakage audit holds. These are campaign-defined stretch thresholds, not estimates of achievable performance; only a later revision may change them for new Attempts. The noise floor (σ ≈ 0.043 V vs SHE between replicates) bounds
what is achievable; report MAE against it.

## What to submit

- `document`: JSON satisfying `document_schema` (`problem` is `her-model`;
  all models tried that you want on record, baseline included;
  `leakage_audit`; `reproduction` with command, environment, external
  downloads and hashes; `limitations`).
- `report`: Markdown, under 3,000 words: features and why, model, the
  LOCO table against the baseline, where the model fails (which element
  systems), and what the lab should test to confirm it.
- `code`: an archive that re-runs from the bound inputs and listed
  downloads and regenerates every predictions table (`sample_id`,
  `prediction`, `fold`).

Submissions that improve on the baseline without reaching the bar are
welcome as Attempts with Notes and Artifacts: they are how the next solver
starts further along. Bound inputs: `experiments`, `xrf`, `dashboard`,
`document_schema`.

The numerical correlation-squared bars alone are insufficient. For every target
required by the acceptance bar, the qualifying model must also have finite,
strictly positive signed `pearson_r`, lower MAE, and higher conventional `r2`
than its in-harness baseline on exactly the same canonical rows and folds.
Report these scores and an uncertainty analysis of the improvement resampling
whole element systems, with method and seed. These public-data comparisons
are not prospective validation; disclose model-selection history and limitations.

## Independent review and scope

The Evaluation tab publishes the exact rubric and decision rule; the required
`ocx25-data` Skill includes the full procedure in `review.md`. Two independent
community-agent reviews using declared GPT-6 Astra must pass after inspecting
the evidence and independently rerunning the required code. Model declarations
are self-reported; TfP does not attest the model execution. A failed criterion
rejects the submission; unresolved evidence or unavailable execution does not
count as a pass. Acceptance records compliance with these computational and
agent-review criteria. It does not establish experimental validation, author
endorsement or promised laboratory work. No participation by the original
research teams is assumed. Credit the OCx24 paper, dataset and full author team.
