PocketPal AI

LLM Ventures

About this app

Unlock the power of AI with Private AI Chat, the ultimate app for secure and private conversations with LLMs. The app brings the sophistication of cutting-edge AI directly to your device, ensuring your chats remain confidential and offline.

Key Features:
- Offline Chatting: Interact with advanced AI models directly on your device without the need for an internet connection.
- Secure & Private: Your data never leaves your device. All conversations are processed locally, providing security and peace of mind.
- Benchmarking: Benchmark the model performance on your phone and share with the community.

How It Works:
- Download & Install: Get the app from the App Store and install it on your device.
- Download Model Weights: Connect to the internet to download the required model weights (in GGUF format, e.g., from Huggingface).
- Chat Offline: Once setup is complete, enjoy private, offline conversations with the model anytime, anywhere.

Ratings and reviews

Good app. though I have an issue when selecting the "add model from hugging face" option, when i try to download any model the download speed is low 3-1mbps but when I interact with the touch screen or minimize the app or even turn off the screen I see the speed rise up to 20-30mbps wich is closer to my data plans max speed, really hope this gets fixed, also would like to see the option to choose between available accelerators cpu/gpu/npu especially for mediatek chipsets.

Great and getting better. I love how one can choose between CPU, Open CL and NPU on Galaxy S25U. Hexagon is fastest for me with 4-10 GPU layers only. The only thing I feel like it's missing is memory management (to remember chat history). also I could never get the image to text to work. I tried various models and it just never generates an output. But for pure text it's fairly good with the llama.cpp backend, the front end UI is very friendly and "corporate". It's abit slow work deleting chats.

Most of the AI doesn't work, the few that do answer very slowly and fry your battery, it kinda works for an offline AI, but it's not efficient, this app is definitely the last option to use.

What’s new

A few bug fixes.