Ahead of AI #12: LLM Businesses and Busyness

Linking pages

AI and Open Source in 2023 - by Sebastian Raschka, PhD https://magazine.sebastianraschka.com/p/ai-and-open-source-in-2023 67 comments
How Good Are the Latest Open LLMs? And Is DPO Better Than PPO? https://magazine.sebastianraschka.com/p/how-good-are-the-latest-open-llms 1 comment

Linked pages

ChatGPT can now see, hear, and speak https://openai.com/blog/chatgpt-can-now-see-hear-and-speak 892 comments
DALL·E 3 https://openai.com/dall-e-3 534 comments
[2207.08815] Why do tree-based models still outperform deep learning on tabular data? https://arxiv.org/abs/2207.08815 266 comments
Mathpix: Document cloud for research http://mathpix.com/ 227 comments
'Game of Thrones' creator sues ChatGPT-maker OpenAI for copyright infringement | AP News https://apnews.com/article/openai-lawsuit-authors-grisham-george-rr-martin-37f9073ab67ab25b7e6b2975b2a63bfe 177 comments
ChatGPT-owner OpenAI is exploring making its own AI chips | Reuters https://www.reuters.com/technology/chatgpt-owner-openai-is-exploring-making-its-own-ai-chips-sources-2023-10-06/ 120 comments
Whatâs New In Python 3.12 — Python 3.12.4 documentation https://docs.python.org/3/whatsnew/3.12.html 116 comments
[2306.11644] Textbooks Are All You Need https://arxiv.org/abs/2306.11644 106 comments
[2309.05463] Textbooks Are All You Need II: phi-1.5 technical report https://arxiv.org/abs/2309.05463 65 comments
Image Creator von Microsoft Bing https://www.bing.com/images/create 39 comments
[2309.08632] Pretraining on the Test Set Is All You Need https://arxiv.org/abs/2309.08632 27 comments
Microsoft to Debut AI Chip Next Month That Could Cut Nvidia GPU Costs — The Information https://www.theinformation.com/articles/microsoft-to-debut-ai-chip-next-month-that-could-cut-nvidia-gpu-costs 18 comments
LLM Training: RLHF and Its Alternatives https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives 14 comments
New York Times, CNN and ABC block OpenAI’s GPTBot web crawler from accessing content | Artificial intelligence (AI) | The Guardian https://www.theguardian.com/technology/2023/aug/25/new-york-times-cnn-and-abc-block-openais-gptbot-web-crawler-from-scraping-content 11 comments
Google adds a switch for publishers to opt out of becoming AI training data - The Verge https://www.theverge.com/2023/9/28/23894779/google-ai-extended-training-data-toggle-bard-vertex 11 comments
X updates its terms to ban crawling and scraping | TechCrunch https://techcrunch.com/2023/09/08/x-updates-its-terms-to-ban-crawling-and-scraping/ 9 comments
[2106.09685] LoRA: Low-Rank Adaptation of Large Language Models https://arxiv.org/abs/2106.09685 8 comments
[2211.15533] The Stack: 3 TB of permissively licensed source code https://arxiv.org/abs/2211.15533 1 comment
[1904.10509] Generating Long Sequences with Sparse Transformers https://arxiv.org/abs/1904.10509 1 comment
AWS Trainium - Amazon Web Services (AWS) https://aws.amazon.com/machine-learning/trainium/ 0 comments