- [R] Pay Attention to MLPs: solely on MLPs with gating, and show that it can perform as well as Transformers in key language and vision applications https://arxiv.org/abs/2105.08050 25 comments machinelearning
Linking pages
- GitHub - cmhungsteve/Awesome-Transformer-Attention: An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites https://github.com/cmhungsteve/Awesome-Transformer-Attention 13 comments
- GitHub - rwightman/pytorch-image-models: PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more https://github.com/rwightman/pytorch-image-models 2 comments
- Gated Multilayer Perceptron (gMLP): What it is and how to use it in practice with Tensorflow and Keras? | by Radi Cho | Medium https://medium.com/@radicho/gmlp-what-it-is-and-how-to-use-it-in-practice-with-tensorflow-and-keras-76018800fea2 0 comments
- A Multi-Axis Approach for Vision Transformer and MLP Models – Google AI Blog https://ai.googleblog.com/2022/09/a-multi-axis-approach-for-vision.html 0 comments
- GitHub - tomohideshibata/BERT-related-papers: BERT-related papers https://github.com/tomohideshibata/BERT-related-papers 0 comments
Would you like to stay up to date with Computer science? Checkout Computer science
Weekly.
Related searches:
Search whole site: site:arxiv.org
Search title: [2105.08050] Pay Attention to MLPs
See how to search.