Linking pages
- GitHub - ELS-RD/transformer-deploy: Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀 https://github.com/ELS-RD/transformer-deploy 69 comments
- What I learned from looking at 900 most popular open source AI tools https://huyenchip.com/2024/03/14/ai-oss.html 40 comments
- GitHub - tensorchord/Awesome-LLMOps: An awesome & curated list of best LLMOps tools for developers https://github.com/tensorchord/Awesome-LLMOps 5 comments
- ModelMesh Overview - KServe Documentation Website https://kserve.github.io/website/0.8/modelserving/mms/modelmesh/overview/#overview 3 comments
- GitHub - ahkarami/Deep-Learning-in-Production: In this repository, I will share some useful notes and references about deploying deep learning-based models in production. https://github.com/ahkarami/Deep-Learning-in-Production 2 comments
- GitHub - instill-ai/vdp: 💧 Visual Data Preparation (VDP) is an open-source tool to seamlessly integrate Vision AI with the modern data stack https://github.com/instill-ai/vdp 1 comment
- GitHub - mosecorg/mosec: A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine https://github.com/mosecorg/mosec 1 comment
- Triton Inference Server - Arbitrary File Overwrite https://protectai.com/threat-research/triton-inference-server-arbitrary-file-overwrite 1 comment
- Deploy Detectron2 models with Triton - Tin Nguyen https://tintn.github.io/deploy-detectron2-with-triton/ 0 comments
- GitHub - EthicalML/awesome-production-machine-learning: A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning https://github.com/EthicalML/awesome-production-machine-learning 0 comments
- GitHub - NVIDIA-Merlin/Transformers4Rec: Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch. https://github.com/NVIDIA-Merlin/Transformers4Rec 0 comments
- GitHub - kelvins/awesome-mlops: A curated list of awesome MLOps tools https://github.com/kelvins/awesome-mlops 0 comments
- GitHub - rodrigobaron/quick-deploy: Optimize, convert and deploy machine learning models as fast inference API using Triton and ORT. Currently support Hugging Face transformers, PyToch, Tensorflow, SKLearn and XGBoost models. https://github.com/rodrigobaron/quick-deploy 0 comments
- GitHub - tensorchord/awesome-open-source-mlops: An awesome & curated list of best open source MLOps/LLMOps tools for data scientists. https://github.com/tensorchord/awesome-open-source-mlops 0 comments