openpencil/scripts/ab-corpus
Fini bacafae52a feat(ab-corpus): bump minimax max_tokens to 8192 (defensive)
ab-v4 raw output capture on dashboard-search-filters-composite shows
minimax-m2.7 emitting <think>...</think> + 4 op_tool tags that fit
inside the 4096 default — its measured completion-token average for
this run was 697, well under the cap. So thinking-budget truncation
is NOT the actual root cause of minimax's lower multi-tool hit rate
(25% vs gpt+deepseek 50%); the real issues are instruction-following
(mixed Strategy A + B despite the explicit forbidance, invented
"canvas" parent_id placeholder).

Still doubling the cap defensively: composite multi-tool outputs can
chain 12-13 op_tool tags + thinking, and "fit easy" today doesn't
mean "fits headroom-free on a longer brief tomorrow." The bump is
free on the happy path (provider stops generating when done, doesn't
bill unused headroom) and only ever helps when the model would
otherwise hit a real ceiling.

Real follow-up for minimax: instruction compliance — the no-mix rule
needs to land harder than a single trailing sentence. Probably wants
the rule moved to top-of-prompt + a few-shot bad-example contrast.
Out of scope here; tracked under Phase 2 prompt design.
2026-04-29 09:49:48 +08:00
..
__tests__ fix(ab-corpus): forbid mixing batch_design with element tools in T 2026-04-29 09:49:45 +08:00
clients feat(ab-corpus): bump minimax max_tokens to 8192 (defensive) 2026-04-29 09:49:48 +08:00
apply.ts fix(ab-corpus): plumb multi-tool output end-to-end for composite 2026-04-29 08:35:00 +08:00
build-prompt.ts fix(ab-corpus): forbid mixing batch_design with element tools in T 2026-04-29 09:49:45 +08:00
measure-prompt-sizes.ts fix(ab-corpus): allow multi-tool output in T system prompt 2026-04-29 09:49:44 +08:00
real-model.ts feat(ab-corpus): gate elements-cookbook on T arm by difficulty 2026-04-29 09:49:42 +08:00
run.ts feat(ab-corpus): bootstrap ab-v3 with token cost + composite difficulty 2026-04-29 07:45:00 +08:00
stub-model.ts fix(ai-skills): drop invalid section_header subtitle from cookbook + stubs 2026-04-29 09:49:40 +08:00
write-report.ts feat(ab-corpus): bootstrap ab-v3 with token cost + composite difficulty 2026-04-29 07:45:00 +08:00