MNN Chat

jindesong

About this app

This is a multimodal language model (LLM) Android app

Multimodal Support: Enables functionality across diverse tasks, including text-to-text, image-to-text, audio-to-text, and text-to-image generation (via diffusion models).

CPU Inference Optimization: MNN-LLM demonstrates exceptional performance in CPU benchmarking in Android.

Broad Model Compatibility: Supports multiple leading model providers, such as Qwen, Gemma, Llama (including TinyLlama and MobileLLM), Baichuan, Yi, DeepSeek, InternLM, Phi, ReaderLM, and Smolm.

Privacy First: Runs entirely on-device, ensuring complete data privacy with no information uploaded to external servers.

Ratings and reviews

Not ready yet (Feb 2026). Multiple issues. 1) Downloading models seems to break most of the time, with an error on header download at the end. 2) Even if the download breaks, the files seem to be stored on your phone. I have several models downloaded, but the app is using over 100GB of storage. 3) The only image generation model is laughable and slow. Maybe try again in a few months.

I have downloaded and tried several models. It is a good app to learn more about locally working with some different models

MNN Chat offered good inference performance when it worked, but it has been broken and unable to download models for several WEEKS. Without models, the app is useless.

What’s new

Add MNN-Sana-Edit-V2, offering cartoon-style photo editing based on Sana.
fix some bugs