SmolChat

Shubham Panchal

About this app

SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

Ratings and reviews

Looks promising but didn't work for me. Trying to use qwen, messages after the first fail with: Unknown built in filter tojson in the template, and I've no idea what the fix is. Attempting to use Gemma throws an error that conversational files must alternate. Phi 4 gave 2 coherent messages then garbage after which the app crashed and won't reopen. Clearing data and cache fixed that subsequent responses were unrelated to the prompt.

I like this app it's fast and responsive. my only issues are the TTS won't download it keeps crashing so I can't use that feature and id like an option to export the chat if I switch device I can download smolchat on that and upload my chats. but the app is very good it just needs a few little improvements such as the TTS issue and download feature to make it better.

This is a standalone app that works perfectly on low RAM devices. You can import many models, but I noticed one thing: it cannot run very small models like (gpt-2 small). Also, copying text in the app might be a bit tricky, but overall the app is good. My suggestion is to have a separate button to copy the model code written in it so that only the code can be copied 😊 People say the app crashes - I checked below, but I tried many large models and they didn't crash.

What’s new

- Users can now enter multi-line queries without 'accidentally' sending the query to the LLM
- Fix chat template parsing
- Save system prompts and re-use them across chat sessions
- Enable auto-scroll for chat messages