SmolChat

Shubham Panchal

About this app

SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

Ratings and reviews

overall I think a good app that allows you to play with any gguf file from hugging face with minimal fuss. I was a bit disappointed to see that it doesn't handle reasoning models quite as well as I had hoped, in that it displays reasoning/thinking tokens as if they were normal tokens. So the thinking is indistinguishable from the response which is unhelpful.

Best app ever. but it crashes alot and ai talks weirdly if changed settings a lil. fix that but overall i like it.

This is a standalone app that works perfectly on low RAM devices. You can import many models, but I noticed one thing: it cannot run very small models like (gpt-2 small). Also, copying text in the app might be a bit tricky, but overall the app is good. My suggestion is to have a separate button to copy the model code written in it so that only the code can be copied 😊 People say the app crashes - I checked below, but I tried many large models and they didn't crash.

What’s new

- The app now supports automatic recognition (speech-to-text) for providing queries to the model. The speech is transformed into text during an on-device ASR model provided by Moonshine. Users will only require an internet connection when downloading the ASR models.

- The UI of the HuggingFace model browser screens has been improved and modernized.

- A bug causing the app to crash after modifying model settings has been resolved.