← Rakesh Kariya

Writing

Three GRPO runs to give a 1.5B model a thinking-budget dial. I got a 3.2x compression instead.

August 28, 2026

Three GRPO runs and 31 hours of A100 time trying to reproduce L1/LCPO on a 1.5B model. The budget dial never formed, but MATH-500 reasoning compressed 3.2x. A writeup of all three runs, including the two that failed.