Hacker News
- Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support https://github.com/ggerganov/llama.cpp 284 comments
- LLaMA-7B in Pure C++ with full Apple Silicon support https://github.com/ggerganov/llama.cpp 2 comments cpp
Linking pages
- Google "We Have No Moat, And Neither Does OpenAI" https://www.semianalysis.com/p/google-we-have-no-moat-and-neither 1572 comments
- SCALE documentation https://docs.scale-lang.com/ 415 comments
- GitHub - Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file. https://github.com/Mozilla-Ocho/llamafile 292 comments
- GitHub - antimatter15/alpaca.cpp: Locally run an Instruction-Tuned Chat-Style LLM https://github.com/antimatter15/alpaca.cpp 287 comments
- How to run Llama 13B with a 6GB graphics card · GitHub https://gist.github.com/rain-1/8cc12b4b334052a21af8029aa9c4fafc 267 comments
- GitHub - huggingface/candle: Minimalist ML framework for Rust https://github.com/huggingface/candle 205 comments
- Why Open Source AI Will Win - by Varun - Public Experiments https://varunshenoy.substack.com/p/why-open-source-ai-will-win 174 comments
- How to run Llama 2 on your laptop and your phone - Replicate – Replicate https://replicate.com/blog/run-llama-locally 171 comments
- GitHub - karpathy/llama2.c: Inference Llama 2 in pure C, single file, fp32, haha https://github.com/karpathy/llama2.c 167 comments
- GitHub - imartinez/privateGPT: Interact with your documents using the power of GPT, 100% privately, no data leaks https://github.com/imartinez/privateGPT 166 comments
- Hello Qwen2 | Qwen https://qwenlm.github.io/blog/qwen2/ 130 comments
- GitHub - pluja/awesome-privacy: Awesome Privacy - A curated list of services and alternatives that respect your privacy because PRIVACY MATTERS. https://github.com/pluja/awesome-privacy 124 comments
- So you want to build your own open source chatbot… - Mozilla Hacks - the Web developer blog https://hacks.mozilla.org/2023/07/so-you-want-to-build-your-own-open-source-chatbot/ 123 comments
- GitHub - leejet/stable-diffusion.cpp: Stable Diffusion in pure C/C++ https://github.com/leejet/stable-diffusion.cpp 123 comments
- GitHub - mikeroyal/Self-Hosting-Guide: Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking. https://github.com/mikeroyal/Self-Hosting-Guide 108 comments
- GitHub - NexaAI/nexa-sdk: Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities. https://github.com/NexaAI/nexa-sdk 105 comments
- The Problems that Attract the Smartest People | by Siegfriedson | Sort of Like a Tech Diary | Apr, 2023 | Medium https://medium.com/sort-of-like-a-tech-diary/the-problems-that-attract-the-smartest-people-a384d2f8af 103 comments
- Fast and Portable Llama2 Inference on the Heterogeneous Edge https://www.secondstate.io/articles/fast-llm-inference/ 98 comments
- GitHub - getumbrel/llama-gpt: A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. https://github.com/getumbrel/llama-gpt 92 comments
- GitHub - nkasmanoff/pi-card: Raspberry Pi Voice Assistant https://github.com/nkasmanoff/pi-card 92 comments
Linked pages
- GitHub - nomic-ai/gpt4all: gpt4all: a chatbot trained on a massive collection of clean assistant data including code, stories and dialogue https://github.com/nomic-ai/gpt4all 325 comments
- GitHub - Mozilla-Ocho/llamafile: Distribute and run LLMs with a single file. https://github.com/Mozilla-Ocho/llamafile 292 comments
- GitHub - ggerganov/whisper.cpp: Port of OpenAI's Whisper model in C/C++ https://github.com/ggerganov/whisper.cpp 212 comments
- Introducing LLaMA: A foundational, 65-billion-parameter language model https://ai.facebook.com/blog/large-language-model-llama-meta-ai/ 204 comments
- [2005.14165] Language Models are Few-Shot Learners https://arxiv.org/abs/2005.14165 201 comments
- LM Studio - Discover, download, and run local LLMs https://lmstudio.ai 165 comments
- GitHub - nat/openplayground: An LLM playground you can run on your laptop https://github.com/nat/openplayground 56 comments
- GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. https://github.com/oobabooga/text-generation-webui 41 comments
- Performance of llama.cpp on Apple Silicon A-series · ggerganov/llama.cpp · Discussion #4508 · GitHub https://github.com/ggerganov/llama.cpp/discussions/4508 41 comments
- Llama access request form - Meta AI https://ai.meta.com/resources/models-and-libraries/llama-downloads/ 17 comments
- The MIT License | Open Source Initiative https://opensource.org/licenses/MIT 15 comments
- Graphics - FreeBSD Wiki https://wiki.freebsd.org/Graphics 14 comments
- Faraday.dev https://faraday.dev/ 8 comments
- TheBloke/Llama-2-7B-Chat-GGUF · Hugging Face https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF 7 comments
- Grammar Builder https://grammar.intrinsiclabs.ai/ 6 comments
- CUDA Toolkit 12.1 Downloads | NVIDIA Developer https://developer.nvidia.com/cuda-downloads 5 comments
- Koala: A Dialogue Model for Academic Research – The Berkeley Artificial Intelligence Research Blog https://bair.berkeley.edu/blog/2023/04/03/koala/ 4 comments
- k-quants by ikawrakow · Pull Request #1684 · ggerganov/llama.cpp · GitHub https://github.com/ggerganov/llama.cpp/pull/1684 3 comments
- GitHub - janhq/jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) https://github.com/janhq/jan 3 comments
- Android NDK | Android Developers http://developer.android.com/sdk/ndk/index.html 1 comment
Would you like to stay up to date with C & C++? Checkout C & C++
Weekly.
Related searches:
Search whole site: site:github.com
Search title: GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++
See how to search.