#ZeRO-Offload20/08/2025
ZenFlow Cuts GPU Stalls and Boosts LLM Training Up to 5×
'ZenFlow is a DeepSpeed offloading engine that removes CPU-induced GPU stalls using importance-aware pipelining, enabling up to 5× faster LLM training with minimal config changes.'