https://pillumina.github.io/tags/communication/ Recent content in Communication on CctoctoFX https://pillumina.github.io/imgs/icon_head.png https://pillumina.github.io/imgs/icon_head.png Hugo -- 0.148.2 en Mon, 22 Jun 2026 09:05:00 +0800 https://pillumina.github.io/posts/aiinfra/llm-computation-methodology/part-6/ Mon, 22 Jun 2026 09:05:00 +0800 https://pillumina.github.io/posts/aiinfra/llm-computation-methodology/part-6/ 训练通信完整分析：从物理原理到框架实现，覆盖 TP/PP/DP/EP/CP/FSDP2 六种并行维度的通信模式、时间线建模和掩盖策略。含 M3 完整 step time 推演和 Dense 70B/M3 MoE 多场景实战。跨 NVIDIA + Ascend 双平台。