Hacker News
- Show HN: LLM, a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.) https://github.com/rustformers/llm 4 comments
- rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙 https://github.com/rustformers/llm 14 comments rust
- llm: a Rust crate/CLI for CPU inference of LLMs, including LLaMA, GPT-NeoX, GPT-J and more https://github.com/rustformers/llm 17 comments rust
Linking pages
- Rambling about Microsoft, and testing alternatives to Github Copilot. · PoignardAzur https://poignardazur.github.io/2023/06/04/microsoft-copilot-alternatives/ 4 comments
- Announcing GPTQ & GGML Quantized LLM support for Huggingface Transformers â PostgresML https://postgresml.org/blog/announcing-gptq-and-ggml-quantized-llm-support-for-huggingface-transformers 1 comment
- GitHub - DJAndries/llmvm: A protocol and modular application suite for language models. https://github.com/DJAndries/llmvm 0 comments
- GitHub - JuliaMerz/pantry https://github.com/JuliaMerz/pantry 0 comments
- GitHub - Dixxe/llmwrap: A wrapper for LLM models, written with rust and love https://github.com/Dixxe/llmwrap 0 comments
Linked pages
- GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++ https://github.com/ggerganov/llama.cpp 286 comments
- GitHub - tloen/alpaca-lora: Instruct-tune LLaMA on consumer hardware https://github.com/tloen/alpaca-lora 11 comments
- GPT-NeoX https://huggingface.co/docs/transformers/model_doc/gpt_neox 7 comments
- BLOOM https://huggingface.co/docs/transformers/model_doc/bloom 3 comments
- models - LocalLLaMA https://old.reddit.com/r/LocalLLaMA/wiki/models 0 comments
- GitHub - sobelio/llm-chain: `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks https://github.com/sobelio/llm-chain 0 comments
- index - LocalLLaMA https://old.reddit.com/r/LocalLLaMA/wiki/index 0 comments
Would you like to stay up to date with Rust? Checkout Rust
Weekly.
Related searches:
Search whole site: site:github.com
Search title: GitHub - rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙
See how to search.