Faster and Memory-Efficient PyTorch models using AMP

栏目: IT技术 · 发布时间: 5年前

内容简介：Do you know that the Backpropagation algorithm was given in 1986 in the NatureAlso, the Convnets were first presented by Yann le cun in 1998 for digit classification where he used a single convolution layer. It was only later in 2012 that Alexnet populariz

Faster and Memory-Efficient PyTorch models using AMP

By just adding a few lines of Code

Rahul Agarwal

Mar 9 ·6min read

Do you know that the Backpropagation algorithm was given in 1986 in the Nature paper by Geoffrey Hinton?

Also, the Convnets were first presented by Yann le cun in 1998 for digit classification where he used a single convolution layer. It was only later in 2012 that Alexnet popularized Convnets by using multiple convolution layers to achieve state of the art on imagenet.

So what made them so famous just now and not before?

It is only with the vast computing resources at our disposal, were we able to experiment and utilize Deep Learning to its full potential in the recent past.

But are we using our computing resources well enough? Can we do better?

This post is about utilizing Tensor Cores and Automatic Mixed Precision for faster training of Deep Learning Networks.

以上就是本文的全部内容，希望本文的内容对大家的学习或者工作能带来一定的帮助，也希望大家多多支持码农网