MNN Chat

jindesong

About this app

This is a multimodal language model (LLM) Android app

Multimodal Support: Enables functionality across diverse tasks, including text-to-text, image-to-text, audio-to-text, and text-to-image generation (via diffusion models).

CPU Inference Optimization: MNN-LLM demonstrates exceptional performance in CPU benchmarking in Android.

Broad Model Compatibility: Supports multiple leading model providers, such as Qwen, Gemma, Llama (including TinyLlama and MobileLLM), Baichuan, Yi, DeepSeek, InternLM, Phi, ReaderLM, and Smolm.

Privacy First: Runs entirely on-device, ensuring complete data privacy with no information uploaded to external servers.

Ratings and reviews

A fantastic app for downloading and running LLMs locally. The app is simple enough for basic users - just tap download and tap the model to chat (I recommend the Qwen models which are also by Alibaba like the app makers). For more advanced users, various settings are adjustable, you can import your own MNN quantized model, and the app even ships an OAI-compatible API if you want to plug it into Open WebUI, etc. Keep up the great work MNN team 👍

Great app but I can't download anything, it just shows failed to fetch huggingface repo

good, but would be great if there's an option to enable the model to search online, so it can answer some simple daily questions

What’s new

Add Qwen 3-VL support