SmolChat

Shubham Panchal

About this app

SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

Ratings and reviews

I wanted to try a Bitnet model. dowloaded MS ggml-model-i2_s.gguf and Rushi2901's version but none of them work. App is just quitting during download however both have about 1G size. In another app i have successfuly tried a 7B model however it was too slow. GUI is great, but it would be great not no import large files just use from the location they are placed like SD card. I don't have too much free internal space.

Excellent.. and free... however when the LLM is answering, and you turn your phone from portrait to landscape, the reply is lost and perhaps forgotten. It's fine once it's finished answering.

for the supported models, it's pretty good. doesn't seem to work for unlisted gguf files, but that's not advertised, so that's okay.

What’s new

- Fixed a bug where the app's memory usage kept increasing after switching models i.e. the memory acquired by the previous model was not 'released' when selecting a different model
- Align default inference parameters with those found in `llama` executable

UI Improvements:
- Chat message actions like share/copy/edit are now available in a dialog which appears when the message is long-pressed
- Preserve query text in the search box when a model is opened while browsing HuggingFace