Private LLM Local AI Chatbot That Works Offline and Privately on Your iPhone, iPad, and Mac
Do You Care About Protecting Your Privacy?
No Connection? Private and Local AI Available Anytime, Anywhere!
Private LLM is a local AI chatbot for iOS and macOS that works offline, keeping your information completely on-device, safe and private. It doesn't need the internet to work, so your data never leaves your device. It stays just with you. With no subscription fees, you pay once and use it on all your Apple devices. It's designed for everyone, with easy-to-use features for generating text, helping with language, and a whole lot more. Private LLM uses the latest AI models quantized with state of the art quantization techniques to provide a high-quality on-device AI experience without compromising your privacy. It's a smart, secure way to get creative and productive, anytime and anywhere.
Harness the Power of Open-Source AI with Private LLM
Private LLM opens the door to the vast possibilities of AI with support for an extensive selection of open-source LLM models, including the Llama 3, Google Gemma, Microsoft Phi-3, Mixtral 8x7B family and many more on both your iPhones, iPads and Macs. This wide range of model support ensures that users on iOS, iPadOS, and macOS can fully utilize the power of AI, customized specifically for their devices.
Build Your Custom AI: No-Code Needed with Siri and Apple Shortcuts
Discover the simplicity of bringing AI to your iOS or macOS devices without writing a single line of code. With Private LLM integrated into Siri and Shortcuts, users can effortlessly create powerful, AI-driven workflows that automate text parsing and generation tasks, provide instant information, and enhance creativity. This seamless interaction allows for a personalized experience that brings AI assistance anywhere in your operating system, making every action smarter and more intuitive. Additionally, Private LLM also supports the popular x-callback-url specification, which is supported by over 70 popular iOS and macOS applications. Private LLM can be used to seamlessly add on-device AI functionality to these apps.
No Login, No Tracking, No API Key, No Subscriptions
Ditch the subscriptions for a smarter choice with Private LLM. A single purchase unlocks the app across all Apple platforms—iPhone, iPad, and Mac—while enabling Family Sharing for up to six relatives. This approach not only simplifies access but also amplifies the value of your investment, making digital privacy and intelligence universally available in your family.
AI Language Services Anywhere in macOS
Transform your writing across all macOS apps with AI-powered tools. From grammar correction to summarization and beyond, our solution supports multiple languages, including English and select Western European ones, for flawless text enhancement.
Superior Model Performance With State-Of-The-Art Quantization
The core of Private LLM's superior model performance lies in its use of the state-of-the-art OmniQuant quantization algorithm. While quantizing LLMs for on-device inference, outlier values in LLM weights tend to have a marked adverse effect on text generation quality. Omniquant quantization handles outliers by employing an optimization based learnable weight clipping mechanism, which preserves the model's weight distribution with exceptional precision. RTN (Round to nearest) quantization used by popular open-source LLM inference frameworks and apps based on them, does not handle outlier values during quantization, which leads to inferior text generation quality. OmniQuant quantization paired with optimized model-specific Metal kernels, enables Private LLM to deliver text generation that is not only fast but also of the highest quality, significantly raising the bar for on-device LLMs.
See what our users say about us on the App Store
Remarkably good app, very active developer
by Conventional Dog-Apr 7, 2024
Possibly the single best app purchase I've ever made. The developer is constantly improving it and talking with users on Discord and elsewhere. One price includes Mac, iPhone, and iPad versions (with family sharing). Mac shortcuts can be used to create what amount to custom GPTs. (There's even a user-contributed, quite clever bedtime story generator on the website.) The 10.7B-parameter SOLAR LLM (one of many included) running on my 16 GB M1 MacBook Air gives me fast responses that are subjectively almost on the level of GPT-3.5. For something running completely locally with full privacy, it's remarkable. More RAM allows an even larger choice of language models. But the tiniest model running on my iPhone 12 Pro is usable. (Tip: Experiment with changing the system prompt to fine-tune it for your purposes.)
Version 1.8.3|United States
Download the Best Open Source LLMs
macOS
Mixtral 8x7B Based Models
Apple Silicon Macs with at least 32GB of RAMLlama 33B Based Models
Apple Silicon Macs with at least 24GB of RAMLlama 2 13B Based Models
Apple Silicon Macs with at least 16GB of RAMCodeLlama 13B Based Models
Apple Silicon Macs with at least 16GB of RAMLlama 2 7B Based Models
All Intel and Apple Silicon MacsSolar 10.7B Based Models
Apple Silicon Macs with at least 16GB of RAMPhi-2 3B Based Models
All Intel and Apple Silicon MacsMistral 7B Based Models
All Intel and Apple Silicon MacsStableLM 3B Based Models
All Intel and Apple Silicon MacsYi 6B Based Models
All Intel and Apple Silicon MacsYi 34B Based Models
Apple Silicon Macs with at least 24GB of RAMiOS
Phi-3 Mini 3.8B Based Models
on devices with 6GB or more RAMLlama 3 8B Based Models
on devices with 6GB or more RAMMistral 7B Based Models
on devices with 6GB or more RAMPhi-2 3B Based Models
on devices with 4GB or more RAMH2O Danube Based Models
on all devicesStableLM 3B Based Models
on devices with 4GB or more RAMYi 6B Based Models
on devices with 6GB or more RAMHow Can We Help?
Whether you've got a question or you're facing an issue with Private LLM, we're here to help you out. Just drop your details in the form below, and we'll get back to you as soon as we can.