GPT-4 Architecture, Infrastructure, Training Dataset, Costs, Vision, MoE - discu.eu

Reddit

[D] Same param count for GPT4 from Nvidia GTC24 as the leak we got from Semianalysis https://www.semianalysis.com/p/gpt-4-architecture-infrastructure 10 comments 18/3/2024 machinelearning

Linking pages

Non-determinism in GPT-4 is caused by Sparse MoE - 152334H https://152334h.github.io/blog/non-determinism-in-gpt-4/ 181 comments
China AI & Semiconductors Rise: US Sanctions Have Failed https://www.semianalysis.com/p/china-ai-and-semiconductors-rise 122 comments
Google Gemini Eats The World – Gemini Smashes GPT-4 By 5X, The GPU-Poors https://www.semianalysis.com/p/google-gemini-eats-the-world-gemini 113 comments
Microsoft Infrastructure - AI & CPU Custom Silicon Maia 100, Athena, Cobalt 100 https://www.semianalysis.com/p/microsoft-infrastructure-ai-and-cpu?microsoft= 14 comments
Why GPT-3.5 is (mostly) cheaper than Llama 2 https://www.cursor.so/blog/llama-inference 10 comments
Microsoft Infrastructure - AI & CPU Custom Silicon Maia 100, Athena, Cobalt 100 https://www.semianalysis.com/p/microsoft-infrastructure-ai-and-cpu 5 comments
Is GPT-4 getting worse over time? https://www.aisnakeoil.com/p/is-gpt-4-getting-worse-over-time 1 comment
Knowing Enough About MoE to Explain Dropped Tokens in GPT-4 - 152334H https://152334h.github.io/blog/knowing-enough-about-moe/ 1 comment
Nvidia Blackwell Perf TCO Analysis - B100 vs B200 vs GB200NVL72 https://www.semianalysis.com/p/nvidia-blackwell-perf-tco-analysis 0 comments
OpenAI Is Doomed - Et tu, Microsoft? https://www.semianalysis.com/p/openai-is-doomed-et-tu-microsoft 0 comments

Linked pages

Would you like to stay up to date with Computer science? Checkout Computer science Weekly.

Related searches:

Search whole site: site:www.semianalysis.com

Search title: GPT-4 Architecture, Infrastructure, Training Dataset, Costs, Vision, MoE

See how to search.

Submit link to: