Hacker News
- RouteLLM: A framework for serving and evaluating LLM routers https://github.com/lm-sys/RouteLLM 36 comments
Linked pages
- GitHub - BerriAI/litellm: lightweight package to simplify LLM API calls - Azure, OpenAI, Cohere, Anthropic. Manages input/output translation https://github.com/BerriAI/litellm 17 comments
- RouteLLM: An Open-Source Framework for Cost-Effective LLM Routing | LMSYS Org https://lmsys.org/blog/2024-07-01-routellm/ 1 comment
Related searches:
Search whole site: site:github.com
Search title: GitHub - lm-sys/RouteLLM: A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!
See how to search.