Harbor and maple, three 500k plateau starts x two RNG seeds, 8000 evals, all
arms scored under stock. Run against the pre-39.19 defaults, so "stock" is the
old objective.
harbor geomean 39.17 -> 39.00 1W/0L/5T diff +0.167 MDD 0.428
harbor geomean+daylight 39.17 -> 39.00 1W/0L/5T diff +0.167 MDD 0.428
maple geomean 60.50 -> 60.17 1W/1L/4T diff +0.333 MDD 1.434
maple geomean+daylight 60.50 -> 60.00 1W/0L/5T diff +0.500 MDD 1.285
Every margin sits below what N=6 can resolve (N ~= 26-67 needed). Unlike
39.13's ramp, which was an exact null with sd=0 and identical trajectories, the
arms here do diverge and all four land on the favourable side of zero -- worth
exactly what four coin-flips landing the same way is worth. Recorded so a later
run cannot cite it as evidence.
Also recorded: none of 39.13, 39.14 or 39.18 produced a measurable search
improvement at this budget. All were shipped on correctness grounds and 39.19
then required two of them outright. If the 39 objective changes pay off in
search terms, this corpus has not shown it yet.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MJ84Feep79Hhm3E4zZJmnB
