GitHub - dvmazur/mixtral-offloading: Run Mixtral-8x7B models in Colab or consumer desktops - discu.eu

Linking pages

Fast Inference of Mixture-of-Experts Language Models with Offloading https://browse.arxiv.org/html/2312.17238v1 0 comments

Linked pages

Mixtral of experts | Mistral AI | Open source models https://mistral.ai/news/mixtral-of-experts/ 300 comments

Related searches:

Search whole site: site:github.com

Search title: GitHub - dvmazur/mixtral-offloading: Run Mixtral-8x7B models in Colab or consumer desktops

See how to search.

Submit link to: