SmolChat

Shubham Panchal

About this app

SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

Ratings and reviews

Excellent.. and free... however when the LLM is answering, and you turn your phone from portrait to landscape, the reply is lost and perhaps forgotten. It's fine once it's finished answering.

Works well, but I am unable to copy generated code. Looking forward to getting an option to add images and documents

for the supported models, it's pretty good. doesn't seem to work for unlisted gguf files, but that's not advertised, so that's okay.

What’s new

- The app allows benchmarking the model used in a chat. Go to Settings > Benchmark Model in any chat and click 'Start Benchmarking'. The benchmark results are pp (tokens/sec for prompt processing) and tg (tokens/sec for token generation).

- Add support for Portuguese language (alongside existing support for English and simplified Chinese).

- Clear model context/memory when clearing the chat i.e. deleting all messages from the current chat.

- Avoid model reloading when screen is rotated.