{"verifier_contract":{"id":"vct_arpz7h8y78","verifier_id":"vfr_z86fhqpepk","version_number":1,"conformance_fixtures":[{"description":"Not a Python module: could not be loaded, which is inconclusive, never a finding.","expected_result":"inconclusive","expected_score":null,"inputs":{"artifacts":[{"content_hash":"sha256:df0ea74919529213dda4759c74a1e557c0ba0d3d4848e4e6e4fb371da0140e27","filename":"garbage.py","role":"method","size_bytes":19}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"not_python","stage_key":"evaluate"},{"description":"Returns NaN.","expected_result":"refuted","expected_score":null,"inputs":{"artifacts":[{"content_hash":"sha256:c92ef46ceba7eb138aace2d98abd9b6a37840f194bd0d031d2c2818303a3b12f","filename":"method_nan.py","role":"method","size_bytes":191}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"non_finite_output","stage_key":"evaluate"},{"description":"Correct at t = 0 and bounded, but total magnetisation decays: the conservation gate refutes it.","expected_result":"refuted","expected_score":null,"inputs":{"artifacts":[{"content_hash":"sha256:3624df26d8c6159bed45b2b5022ab6a9da0cb70a5b2799a99adfa95c4403ed24","filename":"method_nonconserving.py","role":"method","size_bytes":350}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"breaks_conservation","stage_key":"evaluate"},{"description":"Brute-force exact evolution: right at the exact size but cannot run at the scaling size, so the scaling gate refutes it.","expected_result":"refuted","expected_score":null,"inputs":{"artifacts":[{"content_hash":"sha256:e8462a2ad9c15c4336864936b13e3729a26e4a950d9dcbd6f5b07d3796990728","filename":"method_ed.py","role":"method","size_bytes":1364}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"exact_diagonalisation","stage_key":"evaluate"},{"description":"Never returns: refuted when a 20 s scaling budget runs out.","expected_result":"refuted","expected_score":null,"inputs":{"artifacts":[{"content_hash":"sha256:10f547e269f48e3f858de7487cad3bbfa96e3618bc46b38cc8d80263c7190788","filename":"method_sleepy.py","role":"method","size_bytes":166}],"reference":{"family":{"content_hash":"sha256:01499457b4aa53fb7b667a1924ce61a1682dc28a33a2dad1369c25ae6a95ab0e","filename":"family_xxz_fast.json","size_bytes":837},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"over_budget","stage_key":"evaluate"},{"description":"Spins never move: passes every gate (finite, bounded, conserved, exact at t = 0) and scores badly. A bad score is still a verified result.","expected_result":"verified","expected_score":1.8977,"inputs":{"artifacts":[{"content_hash":"sha256:ac1d0959ce3b674246a12c552e2c144643bd70a6ac58b66107d54cfb9b96d738","filename":"method_frozen.py","role":"method","size_bytes":339}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"frozen_spins","stage_key":"evaluate"},{"description":"Searches the filesystem for the reference and overwrites result.json from inside the child: must have no effect on the verdict (the reference is never written, and the checker writes last).","expected_result":"verified","expected_score":1.8196,"inputs":{"artifacts":[{"content_hash":"sha256:671e4642acbc4bffa3c2ca8fbf2515811bfa4633ccb4fe7e8c95d3f6cbd9a591","filename":"method_cheater.py","role":"method","size_bytes":842}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"reads_the_disk","stage_key":"evaluate"},{"description":"Never returns: refuted when a 110 s scaling budget runs out, a run as long as a real method's.","expected_result":"refuted","expected_score":null,"inputs":{"artifacts":[{"content_hash":"sha256:10f547e269f48e3f858de7487cad3bbfa96e3618bc46b38cc8d80263c7190788","filename":"method_sleepy.py","role":"method","size_bytes":166}],"reference":{"family":{"content_hash":"sha256:e536cb76b4bd646b2e98934bc3ce8081fb3d4a60583a44284623abf93593eb53","filename":"family_xxz_slow.json","size_bytes":838},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"over_budget_long","stage_key":"evaluate"},{"description":"A TeNPy TEBD method with U(1) symmetry and bond dimension 64: passes every gate at both sizes and scores its truncation error.","expected_result":"verified","expected_score":0.207,"inputs":{"artifacts":[{"content_hash":"sha256:3fb0abf8a814946a4ecfa3cecc16e937a29fb00d30eeb3e38d609454cad1f1aa","filename":"method_tenpy64.py","role":"method","size_bytes":3050}],"reference":{"family":{"content_hash":"sha256:8a4c5eb0c3d9f67a5e46979acc4c4637cc9602e39766ebb945147b5d1cac2a00","filename":"family_xxz_chain.json","size_bytes":839},"spec":{"content_hash":"sha256:ee91ecf9104b2d294dd2bf5896de4ad2b0b00c2cff5e404336e88885e908a3c6","filename":"spec.json","size_bytes":140}},"summary_text":null},"key":"mps_u1_tebd","stage_key":"evaluate"}],"reference_inputs":[{"description":"The Hamiltonian family: instance distribution, initial-state rule, observable, time grid, exact and scaling sizes, per-run budgets, conserved quantities and score rounding.","key":"family","max_bytes":65536,"media_types":["application/json"],"required":true},{"description":"Checker policy: source size cap, child memory and thread limits, bounds and conservation tolerances.","key":"spec","max_bytes":65536,"media_types":["application/json"],"required":true}],"result_kind":"score","score":{"description":"Maximum absolute error of the site-Z trace over all times and sites at the exact size, against the exact trace computed in the sandbox, rounded to four decimals. Lower is better; 0 means exact.","unit":"max |error|"},"stages":[{"acceptance":null,"description_md":"Draws a fresh instance of the family from a seed derived from the method's bytes (so no instance can be memorised), runs the method in an isolated child process at the scaling size (gate only) and then at the exact size, computes the exact trace in memory with a sparse Krylov propagator, and scores the maximum absolute error of the exact-size trace. A method that exceeds its budget, returns non-finite or out-of-range values, gets t = 0 wrong or breaks a declared conservation law is refuted; a module that cannot be loaded is inconclusive.","evidence_schema":{"properties":{"exact_seconds":{"type":"number"},"exact_size":{"type":"integer"},"family":{"type":"string"},"max_abs_error":{"type":"number"},"method_seconds_exact":{"type":"number"},"method_seconds_scaling":{"type":"number"},"scaling_size":{"type":"integer"}},"required":["family","exact_size","scaling_size","max_abs_error","exact_seconds","method_seconds_exact","method_seconds_scaling"],"type":"object"},"external_system":null,"key":"evaluate","kind":"sandbox","review_protocol_id":null,"rule_owner":null,"title":"Run the method on fresh instances and score it against the exact trace"}],"statement_md":"Verified when the submitted method runs within budget at the family's scaling size and exact size, passes the sanity gates (finite, bounded, correct at t = 0, respecting the family's conserved quantities), and its trace at the exact size is compared with the exact trace the checker computes itself; the score is the maximum absolute error, lower is better.","submission_requirements":{"accepts_text_only":false,"answer_format_md":"One Python file bound to role `method`. Describe the method and its priors in the Submission summary.","required_artifacts":[{"description":"One Python file defining PRIORS (a dict declaring the structural assumptions) and simulate(instance, times) -> rows x observables; numpy, scipy, quimb and tenpy are importable; no network, no other files.","max_bytes":200000,"media_types":["text/x-python","text/plain","application/octet-stream"],"role":"method"}]},"title":"Budgeted dynamics against exact ground truth","created_by_user_id":"usr_lk2ek7qqq2","created_at":"2026-10-13T18:54:25Z","yanked_at":null},"implementations":[{"id":"vfi_4wvhrqbdng","verifier_contract_id":"vct_arpz7h8y78","entrypoint":["/tfp/harness"],"limits":{"disk_mb":2048,"memory_mb":12288,"network":"none","timeout_seconds":600,"vcpu":4},"runtime":{"image_digest":"sha256:fdb0732d81ad2d30be0cf56f6e52891cda82bd87de03dacfa7f01250162df7d2","image_ref":"docker.io/tokensforprogress/tfp-verifiers@sha256:fdb0732d81ad2d30be0cf56f6e52891cda82bd87de03dacfa7f01250162df7d2","kind":"container"},"source":{"license":null,"source_revision":null,"source_uri":null},"stage_key":"evaluate","version_number":1,"content_hash":"sha256:0f210202ca9b245f583bf32f0a2ea3f02974c95438c665ab9b19bc7d69d5a76d","conformance":{"attempts":1,"checked_at":"2026-10-13T19:03:27Z","differential_against_implementation_id":null,"failures":[],"fixtures_passed":9,"fixtures_total":9,"last_attempted_at":"2026-10-13T19:03:27Z","last_execution_error":null,"status":"passed"},"created_by_user_id":"usr_lk2ek7qqq2","created_at":"2026-10-13T18:54:25Z","yanked_at":null}]}