The Flan Collection: Advancing open source methods for instruction tuning

Linking pages

Google at ICML 2023 – Google Research Blog https://ai.googleblog.com/2023/07/google-at-icml-2023.html 0 comments
The History of Open-Source LLMs: Imitation and Alignment (Part Three) https://cameronrwolfe.substack.com/p/the-history-of-open-source-llms-imitation 0 comments
GitHub - fabiochiusano/ai-news-tracker: ~300 news for quickly getting up-to-date with the generative AI landscape https://github.com/fabiochiusano/ai-news-tracker 0 comments
GitHub - fabiochiusano/Awesome-AI-News: ~300 news for quickly getting up-to-date with the generative AI landscape https://github.com/fabiochiusano/Awesome-AI-News/tree/main 0 comments

Linked pages

Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance – Google AI Blog https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html 279 comments
Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer – Google AI Blog https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html 66 comments
[2108.07258] On the Opportunities and Risks of Foundation Models https://arxiv.org/abs/2108.07258 11 comments
Aligning language models to follow instructions https://openai.com/blog/instruction-following/ 11 comments
[2211.01786] Crosslingual Generalization through Multitask Finetuning https://arxiv.org/abs/2211.01786 7 comments
[2210.11416] Scaling Instruction-Finetuned Language Models https://arxiv.org/abs/2210.11416 5 comments
[2110.08207] Multitask Prompted Training Enables Zero-Shot Task Generalization https://arxiv.org/abs/2110.08207 2 comments
Language Models Perform Reasoning via Chain of Thought – Google AI Blog https://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html 1 comment
[2210.09261] Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them https://arxiv.org/abs/2210.09261 1 comment
[2212.09689] Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor https://arxiv.org/abs/2212.09689 1 comment
[2212.10560] Self-Instruct: Aligning Language Model with Self Generated Instructions https://arxiv.org/abs/2212.10560 1 comment
[2009.03300] Measuring Massive Multitask Language Understanding https://arxiv.org/abs/2009.03300 0 comments
Introducing FLAN: More generalizable Language Models with Instruction Fine-Tuning – Google AI Blog http://ai.googleblog.com/2021/10/introducing-flan-more-generalizable.html 0 comments