Microsoft's Massive New Language AI Is Triple the Size of OpenAI’s GPT-3

Linking pages

DeepMind's New AI With a Memory Outperforms Algorithms 25 Times Its Size https://singularityhub.com/2021/12/20/biggers-not-always-better-deepminds-new-language-ai-is-small-but-mighty/ 132 comments
Meta Is Making a Monster AI Supercomputer for the Metaverse https://singularityhub.com/2022/01/26/meta-is-making-a-monster-ai-supercomputer-for-the-metaverse/ 42 comments
Oxford Invited an AI to Debate Its Own Ethics—What It Said Was Startling https://singularityhub.com/2021/12/19/oxford-invited-an-ai-to-debate-its-own-ethics-what-it-said-was-startling/ 1 comment
A Hybrid AI Just Beat Eight World Champions at Bridge—and Explained How It Did It https://singularityhub.com/2022/04/03/a-hybrid-ai-just-beat-eight-world-champions-at-bridge-and-explained-how-it-did-it/ 0 comments

Linked pages

This 3D Printed Community Is Printing One House per Week for a Year https://singularityhub.com/2023/02/22/a-3d-printed-homes-community-is-going-up-in-kenya-and-its-first-phase-is-now-complete/ 469 comments
Turing-NLG: A 17-billion-parameter language model by Microsoft - Microsoft Research https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/ 139 comments
http://pixabay.com 135 comments
Common Crawl https://commoncrawl.org/ 85 comments
[2101.00027] The Pile: An 800GB Dataset of Diverse Text for Language Modeling https://arxiv.org/abs/2101.00027 81 comments
From Here to Human-Level Artificial General Intelligence in Four (Not All That) Simple Steps https://singularityhub.com/2018/07/22/from-here-to-human-level-artificial-general-intelligence-in-four-not-all-that-simple-steps/ 12 comments
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, the World’s Largest and Most Powerful Generative Language Model - Microsoft Research https://www.microsoft.com/en-us/research/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/ 11 comments
The Billion Dollar AI Problem That Just Keeps Scaling https://www.nextplatform.com/2021/02/11/the-billion-dollar-ai-problem-that-just-keeps-scaling/ 1 comment
Robots Could Be Doing Almost Half of Our Household Chores Within a Decade https://singularityhub.com/2023/02/27/robots-could-be-doing-almost-half-of-our-household-chores-within-a-decade/ 1 comment
AI Is Helping Astronomers Search for Intelligent Alien Life—and They’ve Found 8 Strange New Signals https://singularityhub.com/2023/02/03/ai-is-helping-astronomers-search-for-intelligent-alien-life-and-theyve-found-8-strange-new-signals/ 0 comments
Imagination Makes Us Human. When Did Our Species First Acquire This Ability? https://singularityhub.com/2023/02/26/imagination-makes-us-human-when-did-our-species-first-acquire-this-ability/ 0 comments