MLC | Bringing Open Large Language Models to Consumer Devices - discu.eu

Reddit

[P] Bringing Open Large Language Models to Consumer Devices. The project enables 'small' LLMs like Vicuna 7B or Red Pajama INCITE 3B to run locally on mobile phones, with hardware acceleration, using WebAssembly and WebGPU. https://mlc.ai/blog/2023/05/22/bringing-open-large-language-models-to-consumer-devices 7 comments 23/5/2023 machinelearning

Linking pages

Apple's chance to remake AI development - by Matthew Lynley https://www.supervised.news/p/apples-chance-to-remake-ai-development 4 comments

Related searches:

Search whole site: site:mlc.ai

Search title: MLC | Bringing Open Large Language Models to Consumer Devices

See how to search.

Submit link to: