Alltoall

聊一聊为啥有 alltoall，为啥需要 alltoall，alltoall 的问题和优化

MoE alltoall
Deepspeed Ulysses
- https://github.com/microsoft/DeepSpeed/blob/master/blogs/deepspeed-ulysses/chinese/README.md

Alltoall 可能会有什么问题

NCCL alltoall 的 bug
GCP alltoall 的问题

All-to-All Primitive

Author houmin

Publish January 1, 0001

LastMod November 9, 2025

License CC BY-NC-ND 4.0

Linked Mentions

No backlinks found.