Hacker News
- LoRAX: Open-Source Serving for 100s of Fine-Tuned LLMs in Production https://predibase.com/blog/lorax-the-open-source-framework-for-serving-100s-of-fine-tuned-llms-in 3 comments
Linked pages
- [2309.06180] Efficient Memory Management for Large Language Model Serving with PagedAttention https://arxiv.org/abs/2309.06180 16 comments
- Predibase: The First Low-code AI Platform for Developers - Predibase https://predibase.com 2 comments
- GitHub - predibase/lorax: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs https://github.com/predibase/lorax 1 comment
Related searches:
Search whole site: site:predibase.com
Search title: LoRAX: The Open Source Framework for Serving 100s of Fine-Tuned LLMs in Production - Predibase - Predibase
See how to search.