Hacker News
- DeepSeek R1 671B over 2 tok/s without GPU on local gaming rig https://old.reddit.com/r/LocalLLaMA/comments/1idseqb/deepseek_r1_671b_over_2_toksec_without_gpu_on/ 5 comments
- Super AI Creativity App Run with Local GPU on Windows/Linux/MacOS https://blog.hippoml.com/super-ai-creativity-app-run-with-local-gpu-on-mac-windows-linux-early-access-388a4bf20a26 8 comments
- Show HN: Local fine tuning for Mistral and SDXL, GPU mem/latency optimization https://docs.helix.ml/docs/overview 3 comments
- LeftoverLocals: Listening to LLM responses through leaked GPU local memory https://blog.trailofbits.com/2024/01/16/leftoverlocals-listening-to-llm-responses-through-leaked-gpu-local-memory/ 39 comments
- Background removal tool ✂️ 🖼️ - secure local execution for GPU-enabled devices with state of the art AI 🤖 https://img-cut.aishoot.co 8 comments internetisbeautiful
- Xbox creator says "world will return to local compute" once the cost of high GPU performance lowers https://www.pcguide.com/news/xbox-creator-says-world-will-return-to-local-compute-once-the-cost-of-high-gpu-performance-lowers/ 54 comments artificial
- A free-to-use, locally running, privacy-aware chatbot. No GPU or internet required. https://gpt4all.io/index.html 4 comments software
- Running local Python code on a remote GPU (using modal and lob.py) https://martincapodici.com/2023/07/27/running-local-python-code-on-a-remote-gpu-using-modal-and-lob-py/ 2 comments learnmachinelearning
- No local GPU? No Problem! Running Andrej Karpathy’s NanoGPT on Modal.com https://martincapodici.com/2023/07/15/no-local-gpu-no-problem-running-andrej-karpathys-nanogpt-on-modal-com/ 4 comments learnmachinelearning
- Local Kubernetes development with GPU on Apple Silicon M1? https://minikube.sigs.k8s.io/docs/tutorials/nvidia_gpu/ 5 comments kubernetes
- How to Turn Your AMD GPU into a Local LLM Beast: A Beginner's Guide with ROCm https://www.youtube.com/watch?v=VXHryjPu52k 7 comments amd
- go-skynet/LocalAI: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. No GPU required. LocalAI is a RESTful API to run ggml compatible models, generate Images and trascribe audio! https://github.com/go-skynet/LocalAI 7 comments programming