research
∙
05/26/2023
Rotational Optimizers: Simple Robust DNN Training
The training dynamics of modern deep neural networks depend on complex i...
share
research
∙
05/26/2023
Ghost Noise for Regularizing Deep Neural Networks
Batch Normalization (BN) is widely used to stabilize the optimization pr...
research
∙
05/26/2023
Hardware-Efficient Transformer Training via Piecewise Affine Operations
Multiplications are responsible for most of the computational cost invol...
research
∙
07/02/2020
Adaptive Braking for Mitigating Gradient Delay
Neural network training is commonly accelerated by using multiple synchr...
research
∙
03/25/2020
Pipelined Backpropagation at Scale: Training Large Models without Batches
Parallelism is crucial for accelerating the training of deep neural netw...
research
∙
05/15/2019
