Private LLM Secure, Private AI Chatbot That Works Locally on Your iPhone, iPad and Mac
Do You Care About Protecting Your Privacy?
No Internet? No Problem! Private LLM Works Anywhere, Anytime!
Private LLM is a local AI chatbot for iOS and macOS that works offline, keeping your information completely on-device, safe and private. It doesn't need the internet to work, so your data never leaves your device. It stays just with you. With no subscription fees, you pay once and use it on all your Apple devices. It's designed for everyone, with easy-to-use features for generating text, helping with language, and a whole lot more. Private LLM uses the latest AI models quantized with state of the art quantization techniques to provide a high-quality on-device AI experience without compromising your privacy. It's a smart, secure way to get creative and productive, anytime and anywhere.
Harness the Power of Open-Source AI with Private LLM
Private LLM opens the door to the vast possibilities of AI with support for an extensive selection of open-source LLM models, including the Llama 3, Google Gemma, Microsoft Phi-3, Mixtral 8x7B family and many more on both your iPhones, iPads and Macs. This wide range of model support ensures that users on iOS, iPadOS, and macOS can fully utilize the power of AI, customized specifically for their devices.
Craft Your Own AI Solutions: No Code Needed with Siri and Apple Shortcuts
Discover the simplicity of bringing AI to your iOS or macOS devices without writing a single line of code. With Private LLM integrated into Siri and Shortcuts, users can effortlessly create powerful, AI-driven workflows that automate text parsing and generation tasks, provide instant information, and enhance creativity. This seamless interaction allows for a personalized experience that brings AI assistance anywhere in your operating system, making every action smarter and more intuitive. Additionally, Private LLM also supports the popular x-callback-url specification, which is supported by over 70 popular iOS and macOS applications. Private LLM can be used to seamlessly add on-device AI functionality to these apps.
Universal Access with No Subscriptions
Ditch the subscriptions for a smarter choice with Private LLM. A single purchase unlocks the app across all Apple platforms—iPhone, iPad, and Mac—while enabling Family Sharing for up to six relatives. This approach not only simplifies access but also amplifies the value of your investment, making digital privacy and intelligence universally available in your family.
AI Language Services Anywhere in macOS
Transform your writing across all macOS apps with AI-powered tools. From grammar correction to summarization and beyond, our solution supports multiple languages, including English and select Western European ones, for flawless text enhancement.
Superior Model Performance With State-Of-The-Art Quantization
The core of Private LLM's superior model performance lies in its use of the state-of-the-art OmniQuant quantization algorithm. While quantizing LLMs for on-device inference, outlier values in LLM weights tend to have a marked adverse effect on text generation quality. Omniquant quantization handles outliers by employing an optimization based learnable weight clipping mechanism, which preserves the model's weight distribution with exceptional precision. RTN (Round to nearest) quantization used by popular open-source LLM inference frameworks and apps based on them, does not handle outlier values during quantization, which leads to inferior text generation quality. OmniQuant quantization paired with optimized model-specific Metal kernels, enables Private LLM to deliver text generation that is not only fast but also of the highest quality, significantly raising the bar for on-device LLMs.
See what our users say about us on the App Store
A distinct approach
by Original Nifty-Oct 12, 2024
This application is unique in creating the conditions for an interaction whose essence is of a noticeably superior quality., despite (and partly because of) the fact that the model is running completely locally! While at the time of writing the UI is in the early stages of development, it is still workable, easy and stable, allowing the interaction with the model to continue over an extended period. The developers take a distinct and very refreshing ethical position, and are most generous. I am very grateful to them.
Version 1.8.9|United Kingdom
Download the Best Open Source LLMs
iOS
Meta Llama 3.2 3B Based Models
on devices with 6GB or more RAMMeta Llama 3.2 1B Based Models
on all devicesGoogle Gemma 2 9B Based Models
on devices with 16GB or more RAMGoogle Gemma 2 2B Based Models
on devices with 4GB or more RAMMeta Llama 3.1 8B Based Models
on devices with 8GB or more RAMMeta Llama 3 8B Based Models
on devices with 6GB or more RAMQwen 2.5 Based Models
on devices with 4GB or more RAMQwen 2.5 Based Models
on devices with 8GB or more RAMQwen 2.5 Based Models
on devices with 8GB or more RAMQwen 2.5 14B Based Models
on devices with 16GB or more RAMPhi-3 Mini 3.8B Based Models
on devices with 6GB or more RAMMistral 7B Based Models
on devices with 6GB or more RAMPhi-2 3B Based Models
on devices with 4GB or more RAMH2O Danube Based Models
on all devicesStableLM 3B Based Models
on devices with 4GB or more RAMYi 6B Based Models
on devices with 6GB or more RAMmacOS
Meta Llama 3.3 70B Based Models
Apple Silicon Macs with at least 48GB of RAMMeta Llama 3.2 3B Based Models
All Intel and Apple Silicon MacsMeta Llama 3.2 1B Based Models
All Intel and Apple Silicon MacsMeta Llama 3.1 70B Based Models
Apple Silicon Macs with at least 64GB of RAMMeta Llama 3.1 8B Based Models
All Intel and Apple Silicon MacsQwen 2.5 Based Models
All Apple Silicon MacsQwen 2.5 14B Based Models
Apple Silicon Macs with at least 16GB of RAMQwen 2.5 32B Based Models
Apple Silicon Macs with at least 24GB of RAMGoogle Gemma 2 9B Based Models
Apple Silicon Macs with at least 16GB of RAMGoogle Gemma 2 2B Based Models
All Intel and Apple Silicon MacsMeta Llama 3 70B Based Models
Apple Silicon Macs with at least 48GB of RAMMeta Llama 3 8B Based Models
All Intel and Apple Silicon MacsPhi-3 Mini 3.8B Based Models
All Intel and Apple Silicon MacsMixtral 8x7B Based Models
Apple Silicon Macs with at least 32GB of RAMLlama 33B Based Models
Apple Silicon Macs with at least 24GB of RAMLlama 2 13B Based Models
Apple Silicon Macs with at least 16GB of RAMCodeLlama 13B Based Models
Apple Silicon Macs with at least 16GB of RAMLlama 2 7B Based Models
All Intel and Apple Silicon MacsSolar 10.7B Based Models
Apple Silicon Macs with at least 16GB of RAMPhi-2 3B Based Models
All Intel and Apple Silicon MacsMistral 7B Based Models
All Intel and Apple Silicon MacsStableLM 3B Based Models
All Intel and Apple Silicon MacsYi 6B Based Models
All Intel and Apple Silicon MacsYi 34B Based Models
Apple Silicon Macs with at least 24GB of RAMHow Can We Help?
Whether you've got a question or you're facing an issue with Private LLM, we're here to help you out. Just drop your details in the form below, and we'll get back to you as soon as we can.