Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves, we are listening to the growing DeepSpeed community to learn […]
Announcing the DeepSpeed4Science Initiative: Enabling large-scale scientific discovery through sophisticated AI system technologies - Microsoft Research
AI, Free Full-Text
Announcing the DeepSpeed4Science Initiative: Enabling large-scale scientific discovery through sophisticated AI system technologies –
Samyam Rajbhandari - CatalyzeX
DeepSpeed: Accelerating large-scale model inference and training via system optimizations and compression - Microsoft Research
Deploy large models on SageMaker using DJLServing and DeepSpeed model parallel inference
Blog - DeepSpeed
A Fascinating Prisoner's Exploring Different Approaches To, 44% OFF
DeepSpeed Compression: A composable library for extreme compression and zero-cost quantization - Microsoft Research
