Linking pages
Linked pages
- Project Jupyter | Home http://jupyter.org 240 comments
- Gradio https://gradio.app/ 29 comments
- OpenFaaS · GitHub https://github.com/openfaas 18 comments
- Streamlit • A faster way to build and share data apps https://streamlit.io/ 16 comments
- GitHub - tensorchord/modelz-llm: OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others) https://github.com/tensorchord/modelz-llm 5 comments
- GitHub - k3s-io/k3s: Lightweight Kubernetes https://github.com/k3s-io/k3s 3 comments
- GitHub - mosecorg/mosec: A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine https://github.com/mosecorg/mosec 1 comment
- GitHub - triton-inference-server/server: The Triton Inference Server provides an optimized cloud and edge inferencing solution. https://github.com/triton-inference-server/server 1 comment
- GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs https://github.com/vllm-project/vllm 0 comments
Related searches:
Search whole site: site:github.com
Search title: GitHub - tensorchord/openmodelz: Autoscale LLM inferences on Kubernetes (and others)
See how to search.