TokForge Local AI Offline Chat

Defcon-One

About this app

Run AI models on your own phone. TokForge downloads a model once, then chats, writes and makes pictures on the phone itself. No account and no subscription, and once your models are downloaded it works in airplane mode.

A model that fits your phone. TokForge suggests a model sized for your phone, and the catalog shows what fits before you download. Choose from open models such as Qwen, Gemma, Llama, Mistral and Phi, or search Hugging Face for more. In the beta program: say what you want to do and it picks the model, with Best for your phone, Fits and Too big badges.

Your phone, your route. TokForge runs models on the CPU or the GPU, and on supported Snapdragon phones it can use the NPU, the phone's AI chip. In the beta program: short checks on your phone pick the route that works best there, and a "What your phone gets" card in Settings explains it in plain words.

The NPU, when you want it. In the beta program: on supported Snapdragon phones, some models, such as Qwen3.5 4B, can read your prompt on the NPU while the CPU writes the reply. It is opt-in, with a one-time pack, and is used only after it passes a check on your phone.

Chat and roleplay. Create characters or import character cards (PNG or JSON) from chub.ai, TavernAI and SillyTavern. Personas, lorebooks, alternate greetings, and group chats where every character can speak with its own voice.

Make pictures on your phone. Type a prompt and get an image without an internet connection. Image generation runs on the CPU, and on supported phones on the GPU or the NPU. In the beta program: the GPU route reaches more phones, after a check on your phone.

Agents. Hand off a small job, such as summing up a text or looking something up. Use a ready-made agent or build your own; some built-in agents go online when they run. In the beta program: start from a preset and watch each step as it runs.

A terminal, if you want one. In the beta program: an optional command-line shell in its own folder inside the app. It stays off until you turn it on in Advanced settings, on phones that pass its safety check, and its internet access is off by default. When a model wants to run a command, you see it first, and it runs only if you tap Run.

Talk to it. Replies can be read aloud in several Kokoro voices, or in a voice cloned from a short recording. Voice input included.

Ask your documents. Drop in a PDF, DOCX, EPUB, Markdown, CSV or text file and ask questions about it. Long-term memory and a knowledge graph keep track of what matters across conversations.

Web search, when you want it. Off by default. When on, only the search query is sent.

Abliterated models, your choice. The catalog also lists Abliterated versions of some Qwen models: the same model, edited to refuse fewer requests. You decide whether to download one.

Privacy. Chats and documents stay on your phone. No account, no analytics of our own. Online features include model downloads, web search, your phone's voice typing, the leaderboard, a remote server (it gets your chat), and the built-in weather and define agents when a message triggers them. When a photo or video is read, Google's text recognition sends usage statistics, not your images or text, to Google.

Benchmark and tune. AutoForge measures models on your phone and saves the best setups. Posting a result to the public leaderboard at leaderboard.tokforge.ai is up to you.

Back up and restore your chats, characters and settings. Connect your own OpenAI-compatible server. A local developer API, off by default. Available in 8 languages.

Get new features first. Join the beta program from this page to get new versions first and tell us how they run in our Discord. Leave at any time.

Community.
Discord: discord.gg/Acv3CBtfVm
Leaderboard: leaderboard.tokforge.ai
Web: tokforge.ai

iPhone and iPad: TokForge is available as a public beta on TestFlight.

Ratings and reviews

glad to finally have a local only ai, very customizable. Works great on my fold8. Would recommend to anyone who wants to use AI but would prefer not to trust the cloud and for profit companies with their data.

Great offline AI app. Easy to use, and all in one. Lots of models for various ram limits. Dev is helpful and seems to care about the user experience. Absolutely one of the best apps of its kind.

slow and forced to talk to a fantasy app. not sure how it's well rated I found it horrible to use.

What’s new

- Continue a reply; setting explanations
- Optional GPU (Vulkan) on supported phones
- Big MoE models load (slower)
- Pick your embedding model; SillyTavern presets
- MiniCPM5 MNN models load
- Fuller character cards on MNN
- Faster CPU chat on Snapdragon
- More of the app in your language
- Many crash, freeze and memory fixes
Do not install an older TokForge (1.3.4.1 or earlier) over 1.3.6.1: it will not open, and the only way back is to uninstall, which erases your chats and settings.