openpencil/scripts/ab-corpus
Fini 2f31b62ca9 chore(ab-corpus): add prompt-size measurement helper
One-shot diagnostic that prints char + token-estimate sizes for every
(variant, difficulty) combination of buildSystemPrompt. Used to verify
the elements-cookbook diet is shaving the bytes the test floor
predicts (>10kb) before running an actual sweep. Confirms today's
numbers: B 15kb, T-obvious 57kb, T-composite 75kb — diet saves ~17kb
(~4.4k tokens) on every obvious prompt. Phase 2 (per-domain split)
still needed to hit the 6-8k target.
2026-04-29 09:49:43 +08:00
..
__tests__ feat(ab-corpus): gate elements-cookbook on T arm by difficulty 2026-04-29 09:49:42 +08:00
clients feat(ab-corpus): exponential backoff + bump retries=2 on ark/deepseek 2026-04-29 09:49:41 +08:00
apply.ts fix(ab-corpus): plumb multi-tool output end-to-end for composite 2026-04-29 08:35:00 +08:00
build-prompt.ts feat(ab-corpus): gate elements-cookbook on T arm by difficulty 2026-04-29 09:49:42 +08:00
measure-prompt-sizes.ts chore(ab-corpus): add prompt-size measurement helper 2026-04-29 09:49:43 +08:00
real-model.ts feat(ab-corpus): gate elements-cookbook on T arm by difficulty 2026-04-29 09:49:42 +08:00
run.ts feat(ab-corpus): bootstrap ab-v3 with token cost + composite difficulty 2026-04-29 07:45:00 +08:00
stub-model.ts fix(ai-skills): drop invalid section_header subtitle from cookbook + stubs 2026-04-29 09:49:40 +08:00
write-report.ts feat(ab-corpus): bootstrap ab-v3 with token cost + composite difficulty 2026-04-29 07:45:00 +08:00