[2104.12369] PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation

Linking pages

GPT-3 is No Longer the Only Game in Town https://lastweekin.ai/p/gpt-3-is-no-longer-the-only-game 215 comments
Distributed Inference and Fine-tuning of Large Language Models Over The Internet https://browse.arxiv.org/html/2312.08361v1 22 comments
GPT-3, Foundation Models, and AI Nationalism https://lastweekin.ai/p/gpt-3-foundation-models-and-ai-nationalism 1 comment
Why Release a Large Language Model? | EleutherAI Blog https://blog.eleuther.ai/why-release-a-large-language-model/ 0 comments
AI Can Write in English. Now It's Learning Other Languages | WIRED https://www.wired.com/story/ai-write-english-learning-other-languages/ 0 comments
Huawei trained the Chinese-language equivalent of GPT-3 | VentureBeat https://venturebeat.com/2021/04/29/huawei-trained-the-chinese-language-equivalent-of-gpt-3/ 0 comments
Gradient Update #1: FBI Usage of Facial Recognition and Rotary Embeddings For Large LM's https://thegradientpub.substack.com/p/update-1-fbi-usage-of-facial-recognition 0 comments
EleutherAI Open-Sources 20 Billion Parameter AI Language Model GPT-NeoX-20B https://www.infoq.com/news/2022/04/eleutherai-gpt-neox/ 0 comments
Foundation Models. In August 2021 Stanford announced… | by Grigory Sapunov | Intento https://blog.inten.to/foundation-models-b89e7610057?gi=60ca2947a10e 0 comments
GitHub - tomohideshibata/BERT-related-papers: BERT-related papers https://github.com/tomohideshibata/BERT-related-papers 0 comments
GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Model https://github.com/Hannibal046/Awesome-LLM 0 comments
GitHub - RUCAIBox/LLMSurvey: The official GitHub page for the survey paper "A Survey of Large Language Models". https://github.com/RUCAIBox/LLMSurvey 0 comments
[2209.10372] WeLM: A Well-Read Pre-trained Language Model for Chinese https://ar5iv.labs.arxiv.org/html/2209.10372 0 comments