ChainerMN: Distributed Deep Learning with Chainer
Documentation | Installation | Examples | Release Notes
ChainerMN is an additional package for Chainer, a flexible deep learning framework. ChainerMN enables multi-node distributed deep learning with the following features:
Scalable --- it makes full use of the latest technologies such as NVIDIA NCCL and CUDA-Aware MPI,
Flexible --- even dynamic neural networks can be trained in parallel thanks to Chainer's flexibility, and
Easy --- minimal changes to existing user code are required.
This blog post provides our benchmark results using up to 128 GPUs.