Hacker News
- GPT-4’s secret https://thealgorithmicbridge.substack.com/p/gpt-4s-secret-has-been-revealed 56 comments
- GPT-4's Has Been Revealed https://thealgorithmicbridge.substack.com/p/gpt-4s-secret-has-been-revealed 6 comments
Linking pages
Linked pages
- swyx 🤖🥚 on Twitter: "@latentspacepod @realGeorgeHotz GPT4 is 8 x 220B params = 1.7 Trillion params https://t.co/DW4jrzFEn2 ok I wasn't sure how widely to spread the rumors on GPT-4 but it seems Soumith is also confirming the same so here's the quick clip! so yes, GPT4 is technically 10x the size of GPT3, and all the small… https://t.co/m2YiaHGVs4" / Twitter https://twitter.com/swyx/status/1671272883379908608 206 comments
- Soumith Chintala on Twitter: "i might have heard the same 😃 -- I guess info like this is passed around but no one wants to say it out loud. GPT-4: 8 x 220B experts trained with different data/task distributions and 16-iter inference. Glad that Geohot said it out loud. Though, at this point, GPT-4 is…" / Twitter https://twitter.com/soumithchintala/status/1671267150101721090 5 comments
- https://arxiv.org/abs/2101.03961 4 comments
Related searches:
Search whole site: site:thealgorithmicbridge.substack.com
Search title: GPT-4's Secret Has Been Revealed - by Alberto Romero
See how to search.