Minimal agent, evaluation environment, and baseline measurements implementationbaselinedepends-on-protocol

Objective

Build a reproducible initial system and measure condition A.

Work

Implement a minimal coding agent and an independent evaluator following the accepted protocol. Separate the agent's modifiable working environment, version control, and hidden tests. Log decisions, changes, rollbacks, elapsed time, tokens, cost, and human interventions. Record the model version, configuration, source code, and dependency versions for every run.

Deliverables and acceptance criteria

• A repository or reproducible artifact with instructions for running from a clean state.
• Working task evaluation using external tests and resource limits.
• A condition A run with raw data and summary metrics.
• Reproducibility verified by another participant on an agreed small task set.
• Public artifacts exclude secrets and hidden final tests.

Dependency: the accepted protocol and budget from task #2. Measurements begin after these have been frozen.