Commit graph

3 commits

Author SHA1 Message Date
Claude
3ccbba7284
Coldstart runner: checkpoint each run, so losing the box costs hours not days
The runner never passed --checkpoint-every, so each run's only output landed at
the end. The longest single run in the first baseline took 62 h; losing the
machine at hour 61 lost all of it. That flag was added during this session
precisely for this case and then not wired into the one script that needs it.

Default is budget/20 -- 25000 evals at the 500k baseline budget, roughly every
3 h for the slowest programme. --checkpoint-every overrides it.

Also documented --slots: it is the number of concurrent runs, each single-worker
(one worker per run avoids b8g's parallel non-determinism), so it should match
the core count.

Verified end to end with a 400-eval run: the .dom.checkpoint appears alongside
the output, and the score/record/push path still works. The smoke-test artefacts
were removed rather than committed.

Refs homemaker-py-bk9.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MJ84Feep79Hhm3E4zZJmnB
2026-09-06 20:58:05 +00:00
Claude
c747e55abe
coldstart runner: commit only its own artefacts, not the whole tree
record_and_push used `git add -A`, so each completion committed the entire
working tree. On the live local run that meant one commit carrying 49 files
and ~1.97M insertions -- three still-running programmes' partial
coldstart-*.dom, plus unrelated evolved-*.dom -- under a message naming
only programme-house seed 0. In-flight artefacts were being recorded as if
they were results, attributed to the wrong run.

Now stages and commits exactly this run's .dom/.log/.score/.fails plus the
results TSV, via `git commit --only <paths>` so it holds regardless of what
else is staged and a concurrent edit elsewhere cannot ride along.

Note for the run currently in progress: it has the old code loaded, so it
will keep sweeping until restarted. The committed .dom files for
harbor-house, maple-court and health-centre are mid-run snapshots, not
results -- their logs show 75k/87k of 500k evals -- and should be
disregarded until those runs report their own rows.

First real result is in: programme-house seed 0 @ 500k, finish collapse
28 -> 1 fails, final 1 fail (0 hard / 1 soft), 19400s.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MJ84Feep79Hhm3E4zZJmnB
2026-08-29 19:40:00 +00:00
Claude
e2d5838433
coldstart programme-house seed 0 @ 1000: 7 fails (3h/4s)
Cold-start re-baseline after the DESIGN.md 38.10/38.11 objective
change. Single worker (avoids homemaker-py-b8g), scored by the
shipped scorer from the programme directory.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MJ84Feep79Hhm3E4zZJmnB
2026-08-28 23:29:01 +00:00