feat: Add pinned memory optimizer offload for Megatron policy worker#2248

Open

snivertynv wants to merge 1 commit intomainfrom

sniverty/optimizer_offload_perf

Commits on Apr 10, 2026

Add pinned memory optimizer offload for Megatron policy worker. Controlled using the use_pinned_optimizer_offload setting - set to false in a couple of grpo_math* yaml configs as an example. Added …
snivertynv
committed