Add TriAttention KV cache compression#985

Open

Blaizzy wants to merge 5 commits intomainfrom

Commits on Apr 8, 2026

add triattention
Blaizzy
committed
Update README to reflect model change from google/gemma-4-12b-it to google/gemma-4-31b-it for triattention calibration and generation commands.
Blaizzy
committed

Commits on Apr 14, 2026

Commits on Apr 16, 2026

Update triattention budget argument to accept None as default value in generate.py
Blaizzy
committed