Hacker News
- Show HN: Self-hosted OpenAI api server for open source LLMs https://github.com/tensorchord/modelz-llm 3 comments
- Modelz-LLM: Self-hosted OpenAI API server for open-source LLMs https://github.com/tensorchord/modelz-llm 2 comments selfhosted
Linking pages
Linked pages
- GitHub - lm-sys/FastChat: An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. https://github.com/lm-sys/FastChat 4 comments
- GitHub - mosecorg/mosec: A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine https://github.com/mosecorg/mosec 1 comment
Related searches:
Search whole site: site:github.com
Search title: GitHub - tensorchord/modelz-llm: OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
See how to search.