GitHub - NVIDIA/TensorRT: NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

Linking pages

GitHub - ELS-RD/transformer-deploy: Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀 https://github.com/ELS-RD/transformer-deploy 69 comments
GitHub - Ly0n/awesome-robotic-tooling: Tooling for professional robotic development in C++ and Python with a touch of ROS, autonomous driving and aerospace https://github.com/Ly0n/awesome-robotic-tooling 54 comments
GitHub - Caerind/AwesomeCppGameDev: A curated list of awesome C++ (mainly) things for Game Development. Inspired by awesome-... stuff. https://github.com/cmdu76/awesomecppgamedev 12 comments
GitHub - janhq/jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM) https://github.com/janhq/jan 3 comments
GitHub - HazyResearch/aisys-building-blocks: Building blocks for foundation models. https://github.com/HazyResearch/aisys-building-blocks 1 comment
GitHub - EthicalML/awesome-production-machine-learning: A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning https://github.com/EthicalML/awesome-production-machine-learning 0 comments
GitHub - protontypes/awesome-robotic-tooling: Tooling for professional robotic development in C++ and Python with a touch of ROS, autonomous driving and aerospace. https://github.com/protontypes/awesome-robotic-tooling 0 comments
GitHub - csarron/awesome-emdl: Embedded and mobile deep learning research resources https://github.com/csarron/emdl 0 comments
GitHub - beniz/deepdetect: Deep Learning API and Server in C++11 support for Caffe, Caffe2, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE https://github.com/beniz/deepdetect 0 comments

Linking pages

Linked pages