Hacker News
- Get up and running with large language models, locally. https://ollama.ai/ 4 comments programming
- ollama.nvim: A plugin for managing and integrating local LLM workflows in neovim https://ollama.ai 4 comments neovim
Linking pages
- Fly.io has GPUs now · The Fly Blog https://fly.io/blog/fly-io-has-gpus-now/ 225 comments
- How to run Llama 2 on your laptop and your phone - Replicate – Replicate https://replicate.com/blog/run-llama-locally 171 comments
- GitHub - mikeroyal/Self-Hosting-Guide: Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking. https://github.com/mikeroyal/Self-Hosting-Guide 108 comments
- What I Learned Using Private LLMs to Write an Undergraduate History Essay – zwischenzugs https://zwischenzugs.com/2023/12/27/what-i-learned-using-private-llms-to-write-an-undergraduate-history-essay/ 81 comments
- Using Code Llama with Continue | Continue https://continue.dev/docs/walkthroughs/codellama 52 comments
- Evolution of AI and Amara's Law · N9O https://n9o.xyz/posts/202401-evolution-ai/ 35 comments
- GitHub - pgibler/cmdh: Create Linux commands from natural language, in the shell. https://github.com/pgibler/cmdh 28 comments
- GitHub - clairefro/obsidian-chat-cbt-plugin: AI-powered Cognitive Behavioral Therapist plugin for your Obsidian notes https://github.com/clairefro/obsidian-chat-cbt-plugin 22 comments
- Running Open-Source AI Models Locally With Ruby | reinteractive https://reinteractive.com/articles/running-open-source-AI-models-locally-with-ruby 22 comments
- How to make history with LLMs & other generative models https://leighmariebraswell.substack.com/p/how-to-make-history-with-llms-and 14 comments
- GitHub - mlabonne/llm-course: Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks. https://github.com/mlabonne/llm-course 10 comments
- AI on Linux: A Collection of AI Models, LLMs and Chatbots for Linux https://linuxblog.io/ai-on-linux-a-collection-of-ai-models-llms-and-chatbots-for-linux/ 10 comments
- 5 easy ways to run an LLM locally | InfoWorld https://www.infoworld.com/article/3705035/5-easy-ways-to-run-an-llm-locally.html 6 comments
- LLM Performance on M3 Max - Nonstop Development https://www.nonstopdev.com/llm-performance-on-m3-max/ 5 comments
- My 2023 Homelab Setup | Mudkip Mud Sport https://mudkip.me/2024/01/31/My-2023-Homelab-Setup/ 4 comments
- Introducing Qwen1.5 | Qwen https://qwenlm.github.io/blog/qwen1.5/ 3 comments
- Tab Autocomplete (beta) | Continue https://continue.dev/docs/walkthroughs/tab-autocomplete 3 comments
- Regulating Intelligence is Dumb https://davidaw.ad/posts/11-06-regulating-intelligence-is-dumb/ 2 comments
- GitHub - dezoito/ollama-grid-search: A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React. https://github.com/dezoito/ollama-grid-search 2 comments
- LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML https://www.latent.space/p/llms-everywhere#details 1 comment