Linking pages
- Visualizing 6D Mesh Parallelism · main https://main-horse.github.io/posts/visualizing-6d/ 3 comments
- Everything about Distributed Training and Efficient Finetuning | Sumanth's Personal Website https://sumanthrh.com/post/distributed-and-efficient-finetuning/ 1 comment
- What is DeepSpeed? - by Michael Spencer https://datasciencelearningcenter.substack.com/p/what-is-deepspeed 0 comments
- DeepSpeed’s Bag of Tricks for Speed & Scale: Part I | Kola Ayonrinde http://www.kolaayonrinde.com/blog/2023/07/14/deepspeed-train.html 0 comments
Related searches:
Search whole site: site:www.microsoft.com
Search title: ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters - Microsoft Research
See how to search.