Bruno Postle
a103e0114a
Adds operators.mutate_bridge_circulation: retypes the cheapest path between two disconnected circulation components to circulation, directly clearing a 'level N not connected' fail instead of relying on the qi6 graded comparator key (measured negative, DESIGN.md §18). Gated off by default via driver.search's enable_bridge_circulation flag and evolve.py --bridge-circulation, mirroring enable_reassociate's clean-toggle pattern. qi6/qpk-protocol A/B (DESIGN.md §21) is directionally positive but mixed at N=3/N=5 (never worse on total fails; clears 2/5 baseline not-connected fails vs qi6's 0/4; one seed's RNG-trajectory divergence adds 2 new not-connected fails) — kept default off pending a larger-N confirmation sweep (homemaker-py-qjg) and a mutation-weight bump experiment (homemaker-py-lj3). Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GDZjAATDWW1xFfc7xnJqSt
60 lines
2.7 KiB
Bash
Executable file
60 lines
2.7 KiB
Bash
Executable file
#!/usr/bin/env bash
|
|
# 8sh A/B (DESIGN.md §18 follow-on): does the explicit bridge_circulation
|
|
# repair mutation (qi6 mechanism (a)) actually clear 'level N not connected'
|
|
# fails that the graded comparator-key signal (mechanism (b)/(c)) measured
|
|
# negative on? Same qpk protocol as qi6: equal-budget ON vs OFF, both arms
|
|
# finished with the standard finish-time --collapse (94g) so the comparison
|
|
# is apples-to-apples on the final collapsed score.
|
|
#
|
|
# Authoritative metrics: total fail count and 'not connected' fail count, read
|
|
# from the .fails file homemaker-fitness writes (evolve.py itself only prints
|
|
# n_fails, not the fail list). Each run appends one TSV row so partial results
|
|
# survive an interrupt.
|
|
#
|
|
# Usage: experiments/run_8sh_ab.sh
|
|
set -u
|
|
cd "$(dirname "$0")/.."
|
|
|
|
WORKERS=4
|
|
OUT=scratch/8sh_ab; mkdir -p "$OUT"
|
|
TSV=scratch/8sh_ab_results.tsv
|
|
[ -f "$TSV" ] || printf 'programme\tseed\tbridge\tbudget\tfails\tnot_connected\tfitness\telapsed_s\n' > "$TSV"
|
|
|
|
run() { # programme seed bridge(0|1) budget
|
|
local prog="$1" seed="$2" bc="$3" budget="$4"
|
|
local tag="bc${bc}"
|
|
local dom="$OUT/${prog}_${tag}_s${seed}.dom"
|
|
local log="$OUT/${prog}_${tag}_s${seed}.log"
|
|
local flag="--no-bridge-circulation"; [ "$bc" = 1 ] && flag="--bridge-circulation"
|
|
echo ">>> $prog seed=$seed bridge=$bc budget=$budget"
|
|
local t0; t0=$(date +%s)
|
|
homemaker-evolve "examples/$prog/init.dom" \
|
|
--budget "$budget" --workers "$WORKERS" --seed "$seed" \
|
|
$flag --output "$dom" > "$log" 2>&1
|
|
local t1; t1=$(date +%s)
|
|
local fitness fails notconn
|
|
fitness=$(sed -n 's/^best *: \([0-9.e+-]*\) .*/\1/p' "$log")
|
|
fails=$(sed -n 's/^best *: [0-9.e+-]* (\([0-9]*\) fails).*/\1/p' "$log")
|
|
# re-score with the canonical scorer to get the .fails breakdown (evolve.py
|
|
# only prints the count, not the list); dom lives outside examples/$prog so
|
|
# pass an absolute path while cd'd there for patterns.config resolution
|
|
( cd "examples/$prog" && homemaker-fitness "$(realpath "../../$dom")" > /dev/null 2>&1 )
|
|
notconn=0
|
|
if [ -f "${dom}.fails" ]; then
|
|
notconn=$(grep -c 'not connected' "${dom}.fails")
|
|
fi
|
|
printf '%s\t%s\t%s\t%s\t%s\t%s\t%s\t%s\n' \
|
|
"$prog" "$seed" "$bc" "$budget" "${fails:-ERR}" "$notconn" "${fitness:-ERR}" "$((t1-t0))" >> "$TSV"
|
|
echo " -> ${fails:-ERR} fails (${notconn} not-connected), fitness=${fitness:-ERR}, $((t1-t0))s"
|
|
}
|
|
|
|
# harbor-house: budget 2500, seeds 1-3 (qpk protocol)
|
|
for seed in 1 2 3; do run harbor-house "$seed" 0 2500; done
|
|
for seed in 1 2 3; do run harbor-house "$seed" 1 2500; done
|
|
|
|
# programme-house: budget 3000, seeds 1-5 (qpk protocol)
|
|
for seed in 1 2 3 4 5; do run programme-house "$seed" 0 3000; done
|
|
for seed in 1 2 3 4 5; do run programme-house "$seed" 1 3000; done
|
|
|
|
echo "=== 8sh bridge_circulation A/B complete ==="
|
|
column -t -s $'\t' "$TSV"
|