[1801.06146] Universal Language Model Fine-tuning for Text Classification

Linking pages

Dear OpenAI: Please Open Source Your Language Model https://thegradient.pub/openai-please-open-source-your-language-model/ 124 comments
Distilling step-by-step: Outperforming larger language models with less training data and smaller model sizes – Google Research Blog https://blog.research.google/2023/09/distilling-step-by-step-outperforming.html 123 comments
Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer – Google AI Blog https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html 66 comments
Why the Original Transformer Figure Is Wrong, and Some Other Interesting Historical Tidbits About LLMs https://magazine.sebastianraschka.com/p/why-the-original-transformer-figure 60 comments
NLP's ImageNet moment has arrived https://thegradient.pub/nlp-imagenet/ 42 comments
A New Lens on Understanding Generalization in Deep Learning – Google AI Blog https://ai.googleblog.com/2021/03/a-new-lens-on-understanding.html 35 comments
The fall of RNN / LSTM. We fell for Recurrent neural networks… | by Eugenio Culurciello | Towards Data Science https://towardsdatascience.com/the-fall-of-rnn-lstm-2d1594c74ce0 27 comments
The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time. https://jalammar.github.io/illustrated-bert/ 20 comments
GitHub - andrewt3000/DL4NLP: Deep Learning for NLP resources https://github.com/andrewt3000/DL4NLP 14 comments
Identifying Twitter users who repost unreliable news sources with linguistic information [PeerJ] https://peerj.com/articles/cs-325/ 10 comments
Jeremy Howard taught AI to the world and helped invent ChatGPT. He fears he's failed - ABC News https://www.abc.net.au/news/science/2023-11-15/jeremy-howard-taught-ai-to-the-world-and-helped-invent-chatgpt/103092474 6 comments
GitHub - mihail911/nlp-library: curated collection of papers for the nlp practitioner 📖👩‍🔬 https://github.com/mihail911/nlp-library 5 comments
The End of Finetuning — with Jeremy Howard of Fast.ai https://www.latent.space/p/fastai#details 5 comments
How good is GPT-3 in practice? https://humanloop.com/blog/how-good-is-gpt-3-in-practice/ 1 comment
The Rise of Domain Experts in Deep Learning | Future https://future.com/the-rise-of-domain-experts-in-deep-learning/ 1 comment
Understanding building blocks of ULMFIT | by Kerem Turgutlu | ML Review https://medium.com/@keremturgutlu/understanding-building-blocks-of-ulmfit-818d3775325b 1 comment
GitHub - amrzv/awesome-colab-notebooks: Collection of google colaboratory notebooks for fast and easy experiments https://github.com/amrzv/awesome-colab-notebooks 0 comments
Using Transfer Learning for NLP with Small Data | by Manu Suryavansh | Insight https://blog.insightdatascience.com/using-transfer-learning-for-nlp-with-small-data-71e10baf99a6 0 comments
Generating New Ideas for Machine Learning Projects Through Machine Learning | by Paras Chopra | Towards Data Science https://towardsdatascience.com/generating-new-ideas-for-machine-learning-projects-through-machine-learning-ce3fee50ec2 0 comments
2019 — Year of BERT and Transformer | by Manu Suryavansh | Towards Data Science https://towardsdatascience.com/2019-year-of-bert-and-transformer-f200b53d05b9?sk=77913662dd96ce5de77998341504902f&source=friends_link 0 comments