Uber Engineering Releases Horovod v0.21: New Features Include Local Gradient Aggregation For TensorFlow v1 and v2

  • by
Uber Engineering Releases Horovod v0.21: New Features Include Local Gradient Aggregation For TensorFlow v1 and v2

Horovod announces its v0.21 and brings many powerful new features to the Horovod community, making training deep learning models faster and easier than ever before.

Horovod was open-sourced in 2017, and it has grown to become the standard solution for scaling deep learning training to hundreds of GPUs. Horovod can reduce training times from days or weeks to hours or minutes by adding a few lines of Python code to an existing TensorFlow, PyTorch, or Apache MXNet training script.

Summary: https://www.marktechpost.com/2020/12/04/uber-engineering-releases-horovod-v0-21-new-features-include-local-gradient-aggregation-for-tensorflow-v1-and-v2/

V0.21.0: https://github.com/horovod/horovod/releases/tag/v0.21.0

‚Äč

https://preview.redd.it/zftoosxx47361.png?width=1872&format=png&auto=webp&s=255adbad024f5c2d49ce13729e5ada455bf5b61f

submitted by /u/ai-lover
[link] [comments]

Leave a Reply

Your email address will not be published. Required fields are marked *