Criteria for revision r1 · fixed when you start an Attempt
Verified only when the report satisfies document_schema and an independent reviewer accepts all task-specific evidence. No predictive performance threshold is implied by a schema pass.
Checks run in this order. Open a step to inspect its rules, checker or review rubric.
Validate the JSON report only. This does not run the submitted model or validate measurements.
A conforming checker is configured. Execution capacity and availability are checked when the Submission runs.
TfP builtin checker
This checker executes code inside the TfP Worker. It is not a pullable OCI image.
This viewer shows the builtin source bundled with the current deployment. It is not a historical execution or build attestation.
The builtin’s recorded digest identifies its reference string; it is not an OCI digest or a hash of the executed source code.
tfp-builtin/json-schema-check:1sha256:0d84283aa10e891272f89c4dab2f6e8f09c9bbebf6e9c8a0f57409a372b2b9ac["/tfp/verify"]Declared source
Open recorded source repository ↗
No exact source commit is recorded.
Declared license: MIT. TfP has not verified a reproducible build connecting this declared source to the runtime.
Implementations can be replaced while preserving this Contract’s acceptance rules.
{
"verifier_implementation_id": "vfi_4sb243bb5f",
"version": 1,
"content_hash": "sha256:ea0fdf7bfda2b25b598d6423f8df68be97a30505fd3da489f9ed6927d66e4e50",
"conformance": {
"attempts": 1,
"checked_at": "2026-10-14T17:12:16Z",
"differential_against_implementation_id": null,
"failures": [],
"fixtures_passed": 3,
"fixtures_total": 3,
"last_attempted_at": "2026-10-14T17:12:16Z",
"last_execution_error": null,
"status": "passed"
},
"runtime_image_digest": "sha256:0d84283aa10e891272f89c4dab2f6e8f09c9bbebf6e9c8a0f57409a372b2b9ac",
"limits": {
"disk_mb": 64,
"memory_mb": 512,
"network": "none",
"timeout_seconds": 60,
"vcpu": 1
}
}{
"type": "object"
}Inspect actual source data, predictions, code and run evidence against the statement.
Eligible reviewers must complete the pinned rubric. Seat availability and completion are not guaranteed.
Read the exact Problem statement and its bound inputs, then the report, predictions where required, code, environment and logs. Accept only if every task-specific deliverable is present, calculations and source joins are faithful, and the claimed run is supported by reproducible evidence. Check for test-label leakage and undeclared data, dropped/duplicated identifiers, incorrect units or transforms, unsupported curve/channel assignments, and claims exceeding the available evidence. A well-supported reproduction discrepancy or an audit finding no defect can pass; do not demand a favorable metric or a predetermined defect. Schema conformance is only a format check. Cite concrete files/rows or code locations for your decision. Return uncertain if a material scientific or reproducibility question cannot be resolved.
findings · required arrayverdict · required "pass" / "fail" / "uncertain"{
"additionalProperties": false,
"properties": {
"findings": {
"items": {
"minLength": 1,
"type": "string"
},
"type": "array"
},
"verdict": {
"enum": [
"pass",
"fail",
"uncertain"
]
}
},
"required": [
"verdict",
"findings"
],
"type": "object"
}{
"reviewers": {
"allowed": null,
"assistance": {
"allowed": [],
"required": false
},
"count": 1,
"eligibility": {
"organization_id": null,
"rule": "campaign_reviewers",
"user_ids": null
},
"independent": true,
"kind": "human"
},
"conflicts": {
"exclude_submitter": true,
"exclude_submitter_organization": false
},
"visibility": {
"hidden": [
"submitter_identity",
"submitter_organization"
],
"prior_nodes": [],
"stage_evidence": true
},
"skills": []
}verdict equals "pass". Reject when at least 1 have verdict equals "fail". Otherwise unresolved.reviewer · decisionFinal outcome comes from decision. Accept passes this stage; reject refutes it; unresolved is inconclusive. All verification stages must pass.
rpt_ifyvwehilnsha256:612759f5956ec7edbd34897ac3172d0c3e3b802a857ecc49e76d777d3c9ed05fRead the complete pinned protocol →
{
"output": "decision",
"policy": {
"assignment_timeout_hours": 168,
"claim_hold_minutes": 120
}
}document — Machine-readable scientific report matching document_schema.application/json · up to 1 MBreproducibility — ZIP containing runnable source, pinned environment, exact commands, execution logs and human-readable report; curve audit also includes plots.application/zip · up to 25 MBpredictions — Complete row-aligned predictions CSV with the columns required in the statement.text/csv · up to 8 MBA text-only Submission is not accepted.
document_schema · requireddocument_schema.json ↗application/json · 4 KBtrain · optionaltrain.csv ↗text/csv · 453.2 KBtest · optionaltest.csv ↗text/csv · 216.1 KBraw · optionalraw.csv ↗text/csv · 670.7 KBdata_card · optionaldata_card.md ↗text/markdown · 4.3 KBtutorial · optionaltutorial.zip ↗application/zip · 139.4 KBsource_manifest · optionalsource_manifest.json ↗application/json · 5.1 KBRevision prv_5fhsp2s7pu
Contract vct_d2ijt2rjs7
Complete evaluation Contract →
[
{
"key": "data_card",
"content_hash": "sha256:cb8a82b1414ab82bce1a50822d916327a414ea51e5cb129a01c855621e3d33d8",
"size_bytes": 4388,
"media_type": "text/markdown",
"filename": "data_card.md"
},
{
"key": "document_schema",
"content_hash": "sha256:4c07e4b7d235ca8ab95c6c4f86a50b976e909e1a089154cdb5af2a69c8731b54",
"size_bytes": 4063,
"media_type": "application/json",
"filename": "document_schema.json"
},
{
"key": "raw",
"content_hash": "sha256:f674ec74cca1146bc386f832a32d4b8d921d3c312f92cb436cc005901c724a3c",
"size_bytes": 686791,
"media_type": "text/csv",
"filename": "raw.csv"
},
{
"key": "source_manifest",
"content_hash": "sha256:58474070f5fe97abb3e689ca03fcc16303c93b721c6e63c9727daa9239b46487",
"size_bytes": 5247,
"media_type": "application/json",
"filename": "source_manifest.json"
},
{
"key": "test",
"content_hash": "sha256:e21c0ef19795317216287e924e00ca3ef9388b7032a7fa4c7f27e2580372c85e",
"size_bytes": 221291,
"media_type": "text/csv",
"filename": "test.csv"
},
{
"key": "train",
"content_hash": "sha256:c5214ad8c8a4d7d4d09082fcce24fe16c97a980a1e0873b91b8c8e474b79f6e4",
"size_bytes": 464076,
"media_type": "text/csv",
"filename": "train.csv"
},
{
"key": "tutorial",
"content_hash": "sha256:da03b18ebc4e031f87123c483980ea03eaa8f72f2d3f3c1cded368befd3a42b7",
"size_bytes": 142711,
"media_type": "application/zip",
"filename": "tutorial.zip"
}
]