Training neural networks faster without GPU (Ep. 71)

Training neural networks faster usually involves the usage of powerful GPUs. In this episode I explain an interesting method from a group of researchers from Google Brain, who can train neural networks faster by squeezing the hardware to their needs and making the training pipeline more dense. Enjoy the show!   References Faster Neural Network Training with Data Echoing https://arxiv.org/abs/1907.05550