- GitHub - codelion/optillm: Optimizing inference proxy for LLMs https://github.com/codelion/optillm 2 comments coolgithubprojects
Linking pages
Linked pages
- GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. https://github.com/oobabooga/text-generation-webui 41 comments
- GitHub - patched-codes/patchwork: Automate development gruntwwork like code reviews, patching and documentation with LLM workflows. https://github.com/patched-codes/patchwork 26 comments
- [2402.10200] Chain-of-Thought Reasoning Without Prompting https://arxiv.org/abs/2402.10200 25 comments
- [2408.14906] Writing in the Margins: Better Inference Pattern for Long Context Retrieval https://arxiv.org/abs/2408.14906 16 comments
- [2407.13692] Prover-Verifier Games improve legibility of LLM outputs https://arxiv.org/abs/2407.13692 3 comments
- [2402.08699] Unsupervised Evaluation of Code LLMs with Round-Trip Correctness https://arxiv.org/abs/2402.08699 0 comments
- GitHub - ollama/ollama: Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models. https://github.com/ollama/ollama 0 comments
- [2409.03733] Planning In Natural Language Improves LLM Search For Code Generation https://arxiv.org/abs/2409.03733 0 comments
Related searches:
Search whole site: site:github.com
Search title: GitHub - codelion/optillm: Optimizing inference proxy for LLMs
See how to search.