Hacker News
- Nitro: A fast, lightweight inference server with OpenAI-Compatible API https://nitro.jan.ai/ 78 comments
Linking pages
- GitHub - beclab/Terminus: Terminus OS is a free self-hosted operating system based on Kubernetes, designed for both individuals and enterprises. https://github.com/beclab/Terminus 4 comments
- GitHub - janhq/jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) https://github.com/janhq/jan 3 comments
- GitHub - RobinQu/instinct.cpp: instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG, Chatbot, Code interpreter) powered by language models. Call it langchain.cpp if you like. https://github.com/RobinQu/instinct.cpp 0 comments
Related searches:
Search whole site: site:nitro.jan.ai
Search title: Fast inference engine | Nitro
See how to search.