feat: whiteboard layout quality eval harness#425

Open

wyuc wants to merge 20 commits intomainfrom

worktree-whiteboard-eval-harness

Commits on Apr 16, 2026

feat(eval): add state manager bridging ActionEngine for eval

wyuc
and
claude
committed
feat(eval): add shared types for whiteboard layout eval harness
wyuc
committed
feat(eval): add SSE chat client for whiteboard eval
wyuc
committed
feat(eval): add Playwright capture module for whiteboard screenshots
wyuc
committed
feat(eval): add VLM scorer for whiteboard layout evaluation
wyuc
committed
feat(eval): add report generator for whiteboard eval results
wyuc
committed
feat(eval): add 8 constructed scenarios for whiteboard layout eval
wyuc
committed
feat(eval): add minimal whiteboard render page for Playwright screenshots

wyuc
and
claude
committed
feat(eval): add main runner for whiteboard layout eval

wyuc
and
claude
committed
feat(eval): add eval:whiteboard script, install tsx, gitignore results
wyuc
committed
fix(eval): fix TS errors, lint, and prettier formatting
wyuc
committed
fix(eval): address code review — add cue_user/empty turn guards, validate VLM output, fix empty array crash
wyuc
committed
refactor(eval): replace synthetic scenarios with realistic ones

wyuc
and
claude
committed
refactor: extract shared agent loop from use-chat-sessions

wyuc
and
claude
committed
fix(eval): use project LLM infrastructure, fix eval page and model config

wyuc
and
claude
committed
feat(eval): organize results by model/timestamp
wyuc
committed
fix: remove double turnCount increment in shared agent loop

wyuc
and
claude
committed
feat(eval): organize screenshots by scenario subdirectory

wyuc
and
claude
committed
feat(eval): revise scorer rubric and add rescore mode

wyuc
and
claude
committed

Commits on Apr 17, 2026

feat(eval): sharpen scorer rubric with teacher-perspective examples

wyuc
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: whiteboard layout quality eval harness#425

feat: whiteboard layout quality eval harness#425
wyuc wants to merge 20 commits intomainfrom
worktree-whiteboard-eval-harness

Commits on Apr 16, 2026

feat(eval): add state manager bridging ActionEngine for eval

feat(eval): add shared types for whiteboard layout eval harness

feat(eval): add SSE chat client for whiteboard eval

feat(eval): add Playwright capture module for whiteboard screenshots

feat(eval): add VLM scorer for whiteboard layout evaluation

feat(eval): add report generator for whiteboard eval results

feat(eval): add 8 constructed scenarios for whiteboard layout eval

feat(eval): add minimal whiteboard render page for Playwright screenshots

feat(eval): add main runner for whiteboard layout eval

feat(eval): add eval:whiteboard script, install tsx, gitignore results

fix(eval): fix TS errors, lint, and prettier formatting

fix(eval): address code review — add cue_user/empty turn guards, validate VLM output, fix empty array crash

refactor(eval): replace synthetic scenarios with realistic ones

refactor: extract shared agent loop from use-chat-sessions

fix(eval): use project LLM infrastructure, fix eval page and model config

feat(eval): organize results by model/timestamp

fix: remove double turnCount increment in shared agent loop

feat(eval): organize screenshots by scenario subdirectory

feat(eval): revise scorer rubric and add rescore mode

Commits on Apr 17, 2026

feat(eval): sharpen scorer rubric with teacher-perspective examples