Linking pages
- GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++ https://github.com/ggerganov/llama.cpp 286 comments
- GitHub - 0PandaDEV/awesome-windows: An awesome & curated list of tools and apps for Windows 10/11. https://github.com/0PandaDEV/awesome-windows 37 comments
- Benchmarking NVIDIA TensorRT-LLM - Jan https://jan.ai/post/benchmarking-nvidia-tensorrt-llm 9 comments
- GitHub - vince-lam/awesome-local-llms: Identify popular and active GitHub repos for hosting local LLMs https://github.com/vince-lam/awesome-local-llms 1 comment
- Gallery Systems Ransomware Attack Sparks Concerns for Global Museums https://frontendgarage.substack.com/p/gallery-systems-ransomware-attack?r=1vdk6u 0 comments
- Ethics of Local LLMs: A Response to Zuckerberg's ''Open Source AI Manifesto'' | Tech Shinobi https://techshinobi.org/posts/ethics-llm/ 0 comments
Linked pages
- GitHub - ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++ https://github.com/ggerganov/llama.cpp 286 comments
- Turn your computer into an AI computer - Jan https://jan.ai/ 80 comments
- Fast inference engine | Nitro https://nitro.jan.ai/ 78 comments
- Install Docker Engine on Ubuntu | Docker Docs https://docs.docker.com/engine/install/ubuntu/ 57 comments
- GitHub - NVIDIA/TensorRT: NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications. https://github.com/NVIDIA/TensorRT 0 comments
- Installing the NVIDIA Container Toolkit — NVIDIA Container Toolkit 1.14.3 documentation https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html 0 comments