July 2026 monthly highlights for NVIDIA-NeMo/Automodel: delivered memory- and stability-focused enhancements for large multimodal and MoE models at scale, plus targeted reliability fixes and CI improvements. Key features include scoped activation checkpointing for multimodal models with MoE path support, updating distribution configs and docs to enable selective memory optimization without impacting correctness; opt-in prewarm to lazily initialize CUDA components (cuBLAS workspaces, Triton autotune caches, NCCL groups) to prevent first-step OOMs; and memory-efficient cross-entropy with a chunked path and a Flash Attention 2 packing mask shim to reduce peak memory while preserving correctness. Additional work introduced dynamic attention selection for remote-code models with rank-0 Hugging Face reload synchronization to mitigate NCCL timeouts, and a Gloo-based inline consolidation mechanism to isolate NCCL-related timeout risks during checkpointing. These features were complemented by a focused set of robustness fixes and testing improvements aimed at increasing reliability in production-scale training.