SmolChat

Shubham Panchal

About this app

SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

Ratings and reviews

Looks promising but didn't work for me. Trying to use qwen, messages after the first fail with: Unknown built in filter tojson in the template, and I've no idea what the fix is. Attempting to use Gemma throws an error that conversational files must alternate. Phi 4 gave 2 coherent messages then garbage after which the app crashed and won't reopen. Clearing data and cache fixed that subsequent responses were unrelated to the prompt.

overall I think a good app that allows you to play with any gguf file from hugging face with minimal fuss. I was a bit disappointed to see that it doesn't handle reasoning models quite as well as I had hoped, in that it displays reasoning/thinking tokens as if they were normal tokens. So the thinking is indistinguishable from the response which is unhelpful.

I like this app it's fast and responsive. my only issues are the TTS won't download it keeps crashing so I can't use that feature and id like an option to export the chat if I switch device I can download smolchat on that and upload my chats. but the app is very good it just needs a few little improvements such as the TTS issue and download feature to make it better.

What’s new

- Users can now enter multi-line queries without 'accidentally' sending the query to the LLM
- Fix chat template parsing
- Save system prompts and re-use them across chat sessions
- Enable auto-scroll for chat messages