Hacker News
- OpenLLM: An open platform for operating large language models (LLMs) in production. https://github.com/bentoml/OpenLLM 3 comments opensource
Linking pages
- GitHub - mikeroyal/Self-Hosting-Guide: Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking. https://github.com/mikeroyal/Self-Hosting-Guide 108 comments
- GitHub - tensorchord/Awesome-LLMOps: An awesome & curated list of best LLMOps tools for developers https://github.com/tensorchord/Awesome-LLMOps 5 comments
- GitHub - oscinis-com/Awesome-LLM-Productization: Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization https://github.com/oscinis-com/Awesome-LLM-Productization 1 comment
- GitHub - bentoml/BentoVLLM: Self-host LLMs with vLLM and BentoML https://github.com/bentoml/BentoVLLM 1 comment
- BentoML · GitHub https://github.com/bentoml 0 comments
- 14 LLMs that aren't ChatGPT | InfoWorld https://www.infoworld.com/article/3700869/14-llms-that-arent-chatgpt.html#tk.rss_all 0 comments
- A practical guide to deploying Large Language Models Cheap, Good *and* Fast https://askdala.substack.com/p/a-pratical-guide-to-deploying-llms 0 comments
- GitHub - AIoT-MLSys-Lab/Efficient-LLMs-Survey: Efficient Large Language Models: A Survey https://github.com/AIoT-MLSys-Lab/Efficient-LLMs-Survey 0 comments
- The Many Ways to Deploy a Model | Outerbounds https://outerbounds.com/blog/the-many-ways-to-deploy-a-model/ 0 comments
Linked pages
- GitHub - google/jax: Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more https://github.com/google/jax 99 comments
- Falcon LLM - Home https://falconllm.tii.ae/ 87 comments
- http://localhost:3000/ 81 comments
- GitHub - hwchase17/langchain: ⚡ Building applications with LLMs through composability ⚡ https://github.com/hwchase17/langchain 77 comments
- GitHub - bentoml/BentoML: Unified Model Serving Framework 🍱 https://github.com/bentoml/BentoML/blob/master/README.md 19 comments
- GitHub - Stability-AI/StableLM: StableLM: Stability AI Language Models https://github.com/Stability-AI/StableLM 4 comments
- GitHub - bigcode-project/starcoder: Home of StarCoder: fine-tuning & inference! https://github.com/bigcode-project/starcoder 3 comments
- databricks/dolly-v2-12b · Hugging Face https://huggingface.co/databricks/dolly-v2-12b 1 comment
- tiiuae/falcon-40b · Hugging Face https://huggingface.co/tiiuae/falcon-40b 1 comment
- mosaicml/mpt-30b · Hugging Face https://huggingface.co/mosaicml/mpt-30b 1 comment
- google/flan-t5-xxl · Hugging Face https://huggingface.co/google/flan-t5-xxl 0 comments
- GitHub - databrickslabs/dolly: Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform https://github.com/databrickslabs/dolly 0 comments
- mosaicml/mpt-7b-storywriter · Hugging Face https://huggingface.co/mosaicml/mpt-7b-storywriter 0 comments
Related searches:
Search whole site: site:github.com
Search title: GitHub - bentoml/OpenLLM: Operating LLMs in production
See how to search.