- Single command to deploy open source LLMs on Mac, Jetson, and more. Fully portable https://github.com/second-state/LlamaEdge 3 comments compsci
Linking pages
- Mathstral: A New LLM that is Good at Math Reasoning https://www.secondstate.io/articles/mathstral/ 32 comments
- Getting Started with StableLM-2-Zephyr-1.6B https://www.secondstate.io/articles/stablelm-2-zephyr-1.6b/ 5 comments
- Getting Started with Nous-Hermes-2-Mixtral-8x7B SFT https://www.secondstate.io/articles/nous-hermes-2-mixtral-8x7b-sft/ 3 comments
- Run the leaked Mistral Medium, miqu-1-70b. Easy! https://www.secondstate.io/articles/miqu-1-70b/ 3 comments
- LFX Mentorship 2024 Spring Opportunities: Building the Open Source AI Inference Infra https://www.secondstate.io/articles/lfx-mentorship-spring-2024/ 2 comments
- Getting Started with Qwen1.5-0.5B-Chat https://www.secondstate.io/articles/qwen1.5-0.5b-chat/ 1 comment
- Getting Started with Gemma-7b-it https://www.secondstate.io/articles/gemma-7b-it/ 1 comment
- Getting Started with Qwen1.5-72B-Chat https://www.secondstate.io/articles/qwen1.5-72b-chat/ 1 comment
- Getting Started with Llama 3.1 https://www.secondstate.io/articles/llama-31-8b/ 1 comment
- Getting Started with Phi-3.5-mini-instruct https://www.secondstate.io/articles/phi-3-5-mini-instruct/ 1 comment
- Run FLUX.1 [schnell] on your MacBook https://www.secondstate.io/articles/flux1/ 1 comment
- Getting started with Qwen2.5-14B https://www.secondstate.io/articles/qwen25/ 1 comment
- How to Run Hugging Face LLMs with LlamaEdge on Your Own Device https://www.secondstate.io/articles/selfhost-huggingface-llms/ 0 comments
Would you like to stay up to date with Computer science? Checkout Computer science
Weekly.
Related searches:
Search whole site: site:github.com
Search title: GitHub - second-state/LlamaEdge: The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
See how to search.