Hacker News
- Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support https://github.com/ggerganov/llama.cpp 284 comments
- LLaMA-7B in Pure C++ with full Apple Silicon support https://github.com/ggerganov/llama.cpp 2 comments cpp
Linking pages
- Google "We Have No Moat, And Neither Does OpenAI" https://www.semianalysis.com/p/google-we-have-no-moat-and-neither 1571 comments
- GitHub - Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file. https://github.com/Mozilla-Ocho/llamafile 292 comments
- GitHub - antimatter15/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM https://github.com/antimatter15/alpaca.cpp 287 comments
- How to run Llama 13B with a 6GB graphics card · GitHub https://gist.github.com/rain-1/8cc12b4b334052a21af8029aa9c4fafc 267 comments
- GitHub - huggingface/candle: Minimalist ML framework for Rust https://github.com/huggingface/candle 205 comments
- Why Open Source AI Will Win - by Varun - Public Experiments https://varunshenoy.substack.com/p/why-open-source-ai-will-win 174 comments
- How to run Llama 2 on your laptop and your phone - Replicate – Replicate https://replicate.com/blog/run-llama-locally 171 comments
- GitHub - karpathy/llama2.c: Inference Llama 2 in pure C, single file, fp32, haha https://github.com/karpathy/llama2.c 167 comments
- GitHub - imartinez/privateGPT: Interact with your documents using the power of GPT, 100% privately, no data leaks https://github.com/imartinez/privateGPT 166 comments
- GitHub - pluja/awesome-privacy: Awesome Privacy - A curated list of services and alternatives that respect your privacy because PRIVACY MATTERS. https://github.com/pluja/awesome-privacy 124 comments
- So you want to build your own open source chatbot… - Mozilla Hacks - the Web developer blog https://hacks.mozilla.org/2023/07/so-you-want-to-build-your-own-open-source-chatbot/ 123 comments
- GitHub - leejet/stable-diffusion.cpp: Stable Diffusion in pure C/C++ https://github.com/leejet/stable-diffusion.cpp 123 comments
- GitHub - mikeroyal/Self-Hosting-Guide: Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking. https://github.com/mikeroyal/Self-Hosting-Guide 108 comments
- The Problems that Attract the Smartest People | by Siegfriedson | Sort of Like a Tech Diary | Apr, 2023 | Medium https://medium.com/sort-of-like-a-tech-diary/the-problems-that-attract-the-smartest-people-a384d2f8af 103 comments
- Fast and Portable Llama2 Inference on the Heterogeneous Edge https://www.secondstate.io/articles/fast-llm-inference/ 98 comments
- GitHub - getumbrel/llama-gpt: A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. https://github.com/getumbrel/llama-gpt 92 comments
- GitHub - context-labs/autodoc: oolkit for auto-generating codebase documentation using LLMs https://github.com/context-labs/autodoc 86 comments
- GitHub - SJTU-IPADS/PowerInfer: High-speed Large Language Model Serving on PCs with Consumer-grade GPUs https://github.com/SJTU-IPADS/PowerInfer 84 comments
- Accelerating Generative AI with PyTorch II: GPT, Fast | PyTorch https://pytorch.org/blog/accelerating-generative-ai-2/ 69 comments
- GitHub - jzhang38/TinyLlama https://github.com/jzhang38/TinyLlama 60 comments
Linked pages
- GitHub - nomic-ai/gpt4all: gpt4all: a chatbot trained on a massive collection of clean assistant data including code, stories and dialogue https://github.com/nomic-ai/gpt4all 325 comments
- GitHub - Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file. https://github.com/Mozilla-Ocho/llamafile 292 comments
- GitHub - ggerganov/whisper.cpp: Port of OpenAI's Whisper model in C/C++ https://github.com/ggerganov/whisper.cpp 212 comments
- Introducing LLaMA: A foundational, 65-billion-parameter language model https://ai.facebook.com/blog/large-language-model-llama-meta-ai/ 204 comments
- [2005.14165] Language Models are Few-Shot Learners https://arxiv.org/abs/2005.14165 201 comments
- LM Studio - Discover, download, and run local LLMs https://lmstudio.ai 165 comments
- GitHub - nat/openplayground: An LLM playground you can run on your laptop https://github.com/nat/openplayground 56 comments
- GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models. https://github.com/oobabooga/text-generation-webui 41 comments
- Performance of llama.cpp on Apple Silicon A-series · ggerganov/llama.cpp · Discussion #4508 · GitHub https://github.com/ggerganov/llama.cpp/discussions/4508 41 comments
- Llama access request form - Meta AI https://ai.meta.com/resources/models-and-libraries/llama-downloads/ 17 comments
- The MIT License | Open Source Initiative https://opensource.org/licenses/MIT 15 comments
- Graphics - FreeBSD Wiki https://wiki.freebsd.org/Graphics 14 comments
- Faraday.dev https://faraday.dev/ 8 comments
- Grammar Builder https://grammar.intrinsiclabs.ai/ 6 comments
- CUDA Toolkit 12.1 Downloads | NVIDIA Developer https://developer.nvidia.com/cuda-downloads 5 comments
- Koala: A Dialogue Model for Academic Research – The Berkeley Artificial Intelligence Research Blog https://bair.berkeley.edu/blog/2023/04/03/koala/ 4 comments
- k-quants by ikawrakow · Pull Request #1684 · ggerganov/llama.cpp · GitHub https://github.com/ggerganov/llama.cpp/pull/1684 3 comments
- Android NDK | Android Developers http://developer.android.com/sdk/ndk/index.html 1 comment
- GitHub - abetlen/llama-cpp-python: Python bindings for llama.cpp https://github.com/abetlen/llama-cpp-python 1 comment
- feat: support StarCoder model architectures by wsxiaoys · Pull Request #3187 · ggerganov/llama.cpp · GitHub https://github.com/ggerganov/llama.cpp/pull/3187 1 comment
Would you like to stay up to date with C & C++? Checkout C & C++
Weekly.
Related searches:
Search whole site: site:github.com
Search title: GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++
See how to search.