Accelerating text generation with Confident Adaptive Language Modeling (CALM)

Linking pages

Linked pages

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance – Google AI Blog https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html 279 comments
[2005.14165] Language Models are Few-Shot Learners https://arxiv.org/abs/2005.14165 201 comments
[1706.03762] Attention Is All You Need https://arxiv.org/abs/1706.03762 145 comments
Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer – Google AI Blog https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html 66 comments
Characterizing Emergent Phenomena in Large Language Models – Google AI Blog https://ai.googleblog.com/2022/11/characterizing-emergent-phenomena-in.html 57 comments
LaMDA: Towards Safe, Grounded, and High-Quality Dialog Models for Everything – Google AI Blog https://ai.googleblog.com/2022/01/lamda-towards-safe-grounded-and-high.html 11 comments
[1503.02531] Distilling the Knowledge in a Neural Network https://arxiv.org/abs/1503.02531 5 comments
Floating-point arithmetic - Wikipedia https://en.wikipedia.org/wiki/Floating-point_arithmetic 5 comments
The Stanford Question Answering Dataset https://rajpurkar.github.io/SQuAD-explorer/ 4 comments
Accelerating Neural Networks on Mobile and Web with Sparse Inference – Google AI Blog https://ai.googleblog.com/2021/03/accelerating-neural-networks-on-mobile.html 1 comment
[2203.12533] Pathways: Asynchronous Distributed Dataflow for ML https://arxiv.org/abs/2203.12533 1 comment
[2207.07061] Confident Adaptive Language Modeling https://arxiv.org/abs/2207.07061 0 comments