Distributed training megatron core
Configures and drafts NVIDIA Megatron-Core distributed training setups — parallelism strategies, launch scripts, throughput tuning, MoE configuration, and troubleshooting. Use when the user asks about training LLMs from 2B to 462B parameters, parallelism degre