- Zero Temperature Randomness in LLMs https://open.substack.com/pub/martynassubonis/p/zero-temperature-randomness-in-llms 2 comments artificial
Linked pages
- What Every Computer Scientist Should Know About Floating-Point Arithmetic http://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.html 208 comments
- Non-determinism in GPT-4 is caused by Sparse MoE - 152334H https://152334h.github.io/blog/non-determinism-in-gpt-4/ 181 comments
- Tensor and Fully Sharded Data Parallelism https://martynassubonis.substack.com/p/tensor-and-fully-sharded-data-parallelism 5 comments
- Logit - Wikipedia https://en.wikipedia.org/wiki/Logit 4 comments
- [2308.00951] From Sparse to Soft Mixtures of Experts https://arxiv.org/abs/2308.00951 3 comments
- https://platform.openai.com/docs/api-reference/chat/create#chat-create-logprobs 1 comment
Related searches:
Search whole site: site:open.substack.com
Search title: Zero Temperature Randomness in LLMs - by Martynas Šubonis
See how to search.