Cactus Chat

Cactus Compute

About this app

Offline, private AI.

Cactus Chat lets you talk to AI, directly on your phone. This means it's free, runs offline, and your data stays on your device.

If you're a developer, use Cactus to benchmark the latency and throughput of various LLMs.

Ratings and reviews

It's a decent enough demo but isn't nearly as fast as the GitHub description says it should be, I'm only getting about 9 tokens a second on a Pixel 7 with the default model. If this wasn't open source it would be rated much lower, there are applications such as PocketPal using a 1b gemma3 model which is as fast or faster in a feature rich application with a smarter LLM model.

probably the smoothest and the fastest app to set up and load your local and remote AI models with. it probably took me less than 15 seconds and most of that was wasted time moving my thumbs from key to key on my phone.

great tool,initially i taught the app was always going to crash like some but i got fascinated using it offline with privacy which i like,nice job by developer. but i want a feature which let's us copy generated context.