In-layer normalization techniques for training very deep neural networks

Linking pages

How diffusion models work: the math from scratch | AI Summer https://theaisummer.com/diffusion-models/ 10 comments
Learn Pytorch: Training your first deep learning models step by step | AI Summer https://theaisummer.com/learn-pytorch/ 2 comments
How Transformers work in deep learning and NLP: an intuitive introduction | AI Summer https://theaisummer.com/transformer/ 0 comments

Linked pages

Attention is All you Need https://papers.nips.cc/paper/7181-attention-is-all-you-need 30 comments
[1803.08494] Group Normalization https://arxiv.org/abs/1803.08494 12 comments
Open-Sourcing BiT: Exploring Large-Scale Pre-training for Computer Vision – Google AI Blog https://ai.googleblog.com/2020/05/open-sourcing-bit-exploring-large-scale.html 6 comments
[1502.03167] Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift http://arxiv.org/abs/1502.03167 6 comments
[1610.07629] A Learned Representation For Artistic Style https://arxiv.org/abs/1610.07629 2 comments
GANs in computer vision - semantic image synthesis and learning a generative model from a single image | AI Summer https://theaisummer.com/gan-computer-vision-semantic-synthesis/ 2 comments
SPADE Project Page https://nvlabs.github.io/SPADE/ 1 comment
Deep learning in medical imaging - 3D medical image segmentation with PyTorch | AI Summer https://theaisummer.com/medical-image-deep-learning/ 0 comments
GANs in computer vision - Improved training with Wasserstein distance, game theory control and progressively growing schemes | AI Summer https://theaisummer.com/gan-computer-vision-incremental-training/ 0 comments
[1805.11604] How Does Batch Normalization Help Optimization? https://arxiv.org/abs/1805.11604 0 comments
Recurrent neural networks: building a custom LSTM cell | AI Summer https://theaisummer.com/understanding-lstm/ 0 comments
GANs in computer vision - Introduction to generative learning | AI Summer https://theaisummer.com/gan-computer-vision/ 0 comments
Semantic Segmentation in the era of Neural Networks | AI Summer https://theaisummer.com/Semantic_Segmentation/ 0 comments
[1912.11370] Big Transfer (BiT): General Visual Representation Learning https://arxiv.org/abs/1912.11370 0 comments
GitHub - xunhuang1995/AdaIN-style: Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization https://github.com/xunhuang1995/AdaIN-style 0 comments
Self-supervised representation learning on videos | AI Summer https://theaisummer.com/self-supervised-learning-videos/ 0 comments