Linking pages
- GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models. https://github.com/oobabooga/text-generation-webui 41 comments
- GitHub - janhq/awesome-local-ai: An awesome repository of local AI tools https://github.com/janhq/awesome-local-ai 3 comments
- GitHub - taprosoft/llm_finetuning: Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes) https://github.com/taprosoft/llm_finetuning 2 comments
- GitHub - vince-lam/awesome-local-llms: Identify popular and active GitHub repos for hosting local LLMs https://github.com/vince-lam/awesome-local-llms 1 comment
- Introduction | AIKit https://sozercan.github.io/aikit/ 0 comments
Linked pages
- Installation Guide — NVIDIA Cloud Native Technologies documentation https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html 31 comments
- Run the Docker daemon as a non-root user (Rootless mode) | Docker Docs https://docs.docker.com/engine/security/rootless/ 17 comments
- https://localhost:5000 12 comments
- Download Visual Studio Tools - Install Free for Windows, Mac, Linux https://visualstudio.microsoft.com/downloads/ 8 comments
- Install Docker Engine https://docs.docker.com/engine/install/ 3 comments
- Start Locally | PyTorch https://pytorch.org/get-started/locally/ 3 comments
- GitHub - qwopqwop200/GPTQ-for-LLaMa: 4 bits quantization of LLaMa using GPTQ https://github.com/qwopqwop200/GPTQ-for-LLaMa 0 comments
- GitHub - PanQiWei/AutoGPTQ: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm. https://github.com/PanQiWei/AutoGPTQ 0 comments