Open Sourcing BERT: State-of-the-Art Pre-training for Natural Language Processing

Linking pages

MIT Researchers Just Discovered an AI Mimicking the Brain on Its Own https://interestingengineering.com/ai-mimicking-the-brain-on-its-own 1148 comments
AI Canon | Andreessen Horowitz https://a16z.com/2023/05/25/ai-canon/ 219 comments
Understanding searches better than ever before https://www.blog.google/products/search/search-language-understanding-bert/ 109 comments
Google’s scalable supercomputers for machine learning, Cloud TPU Pods, are now publicly available in beta | Google Cloud Blog https://cloud.google.com/blog/products/ai-machine-learning/googles-scalable-supercomputers-for-machine-learning-cloud-tpu-pods-are-now-publicly-available-in-beta 71 comments
Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer – Google AI Blog https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html 66 comments
Rethinking Attention with Performers – Google AI Blog https://ai.googleblog.com/2020/10/rethinking-attention-with-performers.html 52 comments
Cloud TPU Pods break AI training records | Google Cloud Blog https://cloud.google.com/blog/products/ai-machine-learning/cloud-tpu-pods-break-ai-training-records 46 comments
ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations – Google AI Blog https://ai.googleblog.com/2019/12/albert-lite-bert-for-self-supervised.html 45 comments
How Neo-Nazis Are Outsmarting A.I. (and Human) Hate Speech Detectors - Pacific Standard https://psmag.com/ideas/neo-nazi-hate-speech-foiling-algorithms 43 comments
Language-Agnostic BERT Sentence Embedding – Google AI Blog https://ai.googleblog.com/2020/08/language-agnostic-bert-sentence.html 35 comments
The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time. https://jalammar.github.io/illustrated-bert/ 20 comments
Predicting Spreadsheet Formulas from Semi-structured Contexts – Google AI Blog https://ai.googleblog.com/2021/10/predicting-spreadsheet-formulas-from.html 16 comments
Advancing NLP with Efficient Projection-Based Model Architectures – Google AI Blog https://ai.googleblog.com/2020/09/advancing-nlp-with-efficient-projection.html 12 comments
Introducing GPipe, an Open Source Library for Efficiently Training Large-scale Neural Network Models – Google AI Blog http://ai.googleblog.com/2019/03/introducing-gpipe-open-source-library.html 12 comments
Using Neural Networks to Find Answers in Tables – Google AI Blog https://ai.googleblog.com/2020/04/using-neural-networks-to-find-answers.html 8 comments
KELM: Integrating Knowledge Graphs with Language Model Pre-training Corpora – Google AI Blog https://ai.googleblog.com/2021/05/kelm-integrating-knowledge-graphs-with.html 8 comments
Open-Sourcing BiT: Exploring Large-Scale Pre-training for Computer Vision – Google AI Blog https://ai.googleblog.com/2020/05/open-sourcing-bit-exploring-large-scale.html 6 comments
AI Will Soon be Able to Mimic the Human Brain https://aisupremacy.substack.com/p/ai-will-soon-be-able-to-mimic-the 5 comments
Extracting Structured Data from Templatic Documents – Google AI Blog http://ai.googleblog.com/2020/06/extracting-structured-data-from.html 5 comments
Rethinking Attention with Performers – Google AI Blog https://ai.googleblog.com/2020/10/rethinking-attention-with-performers.html?m=1 4 comments

Linking pages

Linked pages