Calculating GPU memory for serving LLMs | Substratus - discu.eu

Hacker News

Estimating required GPU memory for serving LLMs https://www.substratus.ai/blog/calculating-gpu-memory-for-llm/ 2 comments 19/11/2023

Linked pages

Transformer Math 101 | EleutherAI Blog https://blog.eleuther.ai/transformer-math/ 13 comments
Can You Run It? LLM version - a Hugging Face Space by Vokturz https://huggingface.co/spaces/Vokturz/can-it-run-llm 0 comments

Related searches:

Search whole site: site:www.substratus.ai

Search title: Calculating GPU memory for serving LLMs | Substratus

See how to search.

Submit link to: