GitHub - toverainc/willow-inference-server: Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS - discu.eu

Hacker News

Show HN: Willow Inference Server: Optimized ASR/TTS/LLM for Willow/WebRTC/REST https://github.com/toverainc/willow-inference-server 13 comments 23/5/2023

Linking pages

Home - Willow https://heywillow.io/ 2 comments

Linked pages

GitHub - ggerganov/whisper.cpp: Port of OpenAI's Whisper model in C/C++ https://github.com/ggerganov/whisper.cpp 212 comments
GitHub - toverainc/willow: Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative https://github.com/toverainc/willow 146 comments
GitHub - guillaumekln/faster-whisper: Faster Whisper transcription with CTranslate2 https://github.com/guillaumekln/faster-whisper 16 comments
GitHub - OpenNMT/CTranslate2: Fast inference engine for Transformer models https://github.com/OpenNMT/CTranslate2 3 comments
GitHub - PanQiWei/AutoGPTQ: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm. https://github.com/PanQiWei/AutoGPTQ 0 comments

Related searches:

Search whole site: site:github.com

Search title: GitHub - toverainc/willow-inference-server: Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

See how to search.

Submit link to: