IRIS (offline GPT)

Nerve Sparks

About this app

IRIS Offline GPT: AI Chat & Model Management

Offline GPT provides a seamless, intuitive, and powerful experience for interacting with AI models without needing a constant internet connection. With a sleek, redesigned user interface, the app enhances accessibility and responsiveness across all devices.

Key Features:

New Robust UI: A completely revamped interface for a smoother and intuitive user experience.
Hugging Face Model Integration: Download and use models directly from Hugging Face for faster setup and efficient usage.
Efficient Model Management: Effortlessly switch between models and manage storage with improved tools.
Speech-to-Text & Text-to-Speech: Transcribe input via Speech-to-Text and convert responses to natural audio with Text-to-Speech.
Hyperparameter Tuning: Customize the AI model's behavior and performance with options like temperature, top-p, top-k, and threads.
Model Benchmarking: Measure model performance with detailed speed, memory, and accuracy metrics.
Improved Conversational Flow: Automatic application of chat templates for better context and conversation continuity.
Recent Updates:

Improved inference stability and long-running session reliability.
Fixed UI glitches and enhanced scrolling performance.
With IRIS Offline GPT, you can manage and interact with cutting-edge AI models, customize their behavior, and improve your experience with powerful tools—all offline. Stay tuned for even more exciting features in the next update!

Ratings and reviews

I love this app! To have a full LLM AI running completely offline, locally on my phone in real time is crazy. But I do have some requests. The Parameters settings don't actuality save. Next time I open it, it will be on defaults. Please make them stick. Also, please make it possible to set a custom system prompt or at least personal pre-prompt... BTW how big is the context window? How many tokens? Anyway, amazing work, thank you!

I installed the offline version of your app and downloaded the latest modules. When I run the app, it opens without any issues, but the chatbot's responses are extremely slow, like an old 486 computer. How can I make it respond faster?" Let me know if you want a more formal version or if you're sending this to tech Support please.

Nice app, works fully offline. The models are not too smart, but can easily run on my Android. I can control important settings such as temperature, num of threads, etc.

What’s new

Updated UI with improved pre-made templates
Added report feedback option