See what people say about Private LLM

I bought Private LLM , because I really like how much it feels as it is made by engineers. To be honest, as smooth the features are, I actually rarely use it, because my main interest is in running web deep researches with Local LLMs. But the fact that they even incorporated CDN to counter the terrible UX of infinitely slow Hugging Face downloads spoke volumes to me how seriously they consider UX. Awesome custom runtime too, but I can only assume how expensive to maintain such component, in terms of time. Keep up the amazing work, and I can't wait to see what you cook with Private LLM v2

Tengo el iPhone 17 pro descargué EVA Qwen 2.5 7B v0.1 4-bit GPTQ, ya que no tengo tanto conocimiento del idioma inglés y es la que mejor habla el idioma español, hasta el momento no me ha dado fallas y me funciona de maravilla

It is missing passing of attachments and vision. Otherwise it works well and stable and fast and Ui is simple but efficient.Deserves an update.

Gillar möjligheten stt köra LLM modeller på min iPhone 16e, hade gärna velat köra Prism ML Bonsai 27b modellerna som nyligen släppts.

Developer

July 2, 2026

Hej, tack för din recension och din feedback. Vi har tagit till oss detta och uppdaterat vår webbplats så att det blir enklare att hitta modeller som fungerar bäst för just din telefon och mängden RAM-minne. Du kan se listan här: https://privatellm.app/models

The built in models have a greatly varied selection that are perfect for all different tasks!! The override function lets you really make the model your own. 10/10 would recommend

Don’t get me wrong this is the absolute best app for offline LLM in the App Store it’s just buggy and If you put to long of a system prompt in then it will crash

Developer

July 2, 2026

Thanks for the kind words and for the honest feedback. Crashes with very long system prompts are usually caused by RAM starvation. Since everything runs locally on the device, we have to work within Apple’s hardware memory limits. That said, we’re working on Private LLM v2, which is much more memory efficient and adds new features. It’s shipping soon and will be a free upgrade for all v1 users. Thanks again for your support.

The genie has been out the bottle since GPT 1 & 2 were open source and it’s never going back in. This app has been very useful for times when I have no reception like when I went to Red Rock in Nevada with my wife’s family, hypothesized that the rocks were likely red due to the fact that iron rusts that color and the rock is most likely iron rich. I had zero reception but because this runs locally, I was able to confirm that was the reason and share that fun fact with everyone. It’s like having all human knowledge in your phone. That said, Dolphin specifically is totally dangerous with the right pre-prompt in the wrong hands. But I believe in freedom so I still deem it dope overall. 5 well deserved stars.

Sería bueno que añadieran un botón para añadir imágenes y procesarlas en local

I use daily on the train

Cảm giác khá mượt và ít nóng. Nhiều mô hình đa dạng và thú vị.

Thanks, go on. :)

Developer

April 27, 2026

Thanks for the review! Please wait until we release v2 in a few weeks. :)

選択できるGemmaの一番上のモデルを選んでシステムプロンプトにYou are a helpful assistant. Please respond in Japanese.と入れたら普通に日本語で応答。これは良いです。

Интересно что можно запускать ллм прям у себя на телефоне. Плюс видна эволюция ллм, они стали меньше тупить на русском. Было бы классно, если бы при использовании в командах само приложение не открывалось, или хотя бы открывалось маленьким окошком. А то хотелось бы сделать агента на телефоне а из за постоянных открываний приложения это как то странно выглядит

Absolutely one of the best apps for runnibg some models on your phone instead of sending everything to the cloud.👨🏼‍💻That makes it useful for learning, private notes, brainstorming, and practicing Al worktlows.💯

Very cool but I need Qwenn 3.5. Got the Iphone 17 Pro Max. It can do it 100%

Developer

March 14, 2026

Thanks for the review. We’re working on a major upgrade (Private LLM 2), which will be a free download for existing users. That will contain QWen 3.5 models. We hope to be able to run the 9B model on iPhone 17 Pro Max.

Photo addition would be nice

I absolutely love this app. It’s exactly what I needed and MUCH more. One thing I would change is the prompt box. The shape, size, and corner radius is kinda off given how the rest of the interface looks. Aside from that, literally perfect.

Developer

February 8, 2026

Thank you for your feedback. We’ll address the UI issues in the next major release.

App stürzt ab im Sinne von irgendwann ist das Handy Geräte überlastet und die App wird geschlossen. Meiner Meinung nach sollte die Antwort dann aber automatisch unterbrochen werden, weil so der gesamte Chat-Verlauf verloren geht. Ich wünsche mir natürlich eine UI auf Deutsch oder vielleicht einfach direkt mehrsprachig das sind vielleicht 20 Minuten bei der Programmierarbeit. Weiß nicht natürlich würde ich mir genauso wie viele, viele andere mehrere Chats zulegen kann ach so und aus irgendeinem Grund haben die Modelle Probleme mit „ich“ und „du“

Developer

October 30, 2024

Danke für die Bewertung! Kurzbefehle sollten funktionieren. Wir testen sie bei jeder Version. Wenn es bei Ihnen nicht funktioniert, schreiben Sie uns bitte eine E-Mail an [email protected]

Could you please add NAVER HyperCLOVA X SEED on hugging face for Korean chats? I want to try it in this app. Thank you.

It’s really the best quality among the llm on-device apps I‘ve used. But I also use it on MacBook, and I wish I could upload files like images and pdf on MacBook..

Developer

December 29, 2025

We are currently working on the second version of this app, which will be a free upgrade for all users of the first version. We will consider implementing these features on higher-end devices. Thank you for your review.

在iPad air m3回應速度很好，希望能增加對話歷史紀錄，可儲存多個對話，方便接續對話。

I really liked the app, i just wished there was an option to upload files too :(

You might be attracted to the “uncensored” bit but it’s not fully uncensored but 100% much better then the heavily restricted and non private ai chatbots

Great as to one who is trying out ai at all opportunities, this one has a good selection of models. I'm waiting till there is audio then 5 stars.

hola hoy compre tu app para usarlo yo y 3 dispositivos mas oeri no me deja compartila en familia

Developer

November 16, 2025

Gracias por tu compra y por tu reseña. Si nunca has usado Compartir en familia, por favor sigue las instrucciones de este artículo de Apple para configurarlo: https://support.apple.com/es-mx/108774

Prima app, de Gemma modellen zijn prima, het is geen Chat GPT maar dat moet je ook niet verwachten, wel positief qua Privacy en prettig in het gebruik.

Developer

November 9, 2025

Bedankt voor de 5 sterren! Fijn dat de Gemma modellen bevallen. Je hebt gelijk: het is geen ChatGPT en dat is bewust, omdat alles volledig lokaal draait en je data bij jou blijft. Wil je experimenteren, probeer ook Llama 3.2/3.3 voor sterke meertalige kwaliteit.

This is a private AI app created by developers performing constant updates and not charging a subscription. That is rare nowadays! Bravo, looking forward to the updates as this continues to improve!

Really easy to use on the go, you fan keep very specific models for tasks and load them in which is extremely useful for research, work and trialling things. Also great at being a DM in DnD with the right language/information to base off lol. Really helps you learn how they work if that’s your thing, simple interface and much easier to use than anything really on a PC if you are newer to this type of technology and want to understand it as well. The UI is neat and spacious, no weird ads or unnecessary while still being extremely functional and easy to use. Gotta big this app up because I love it lmao. But overall highly recommenced by me, best I’ve ever used for on IOS - (phones in general honestly). Oh and PS make sure you have extra cloud storage or memory if you plan to use larger models but this app handles them much better than you’d expect - Though you can get tiny models too, but just a heads up. 10/10

Developer

October 18, 2025

Thanks for the 5-star review! 🙌 Re: chat history - we’ve started building Private LLM v2 (a free upgrade for all v1 users). It adds chat history and brings further speed and quality improvements. Follow the progress and share feedback in our Discord

It's a very well optimised app with fairly good reasoning models and quite speedy responses! My only complaints would be that there's no ability to save/export chats and there's only a single, temporary chat window. Additionally, it would be nice to see Deepseek and Grok models too! Great bang for the buck, nevertheless.

Works and will be very good when models become smaller and memory greater

Hey there i just rated this app for 5 stars and would like to see support for Apple foundation models! I’d hate to switch from this app to another … Thank you!

The main reason I bought it: use in Shortcuts but unlike free alternatives this app cannot just output LLM response without opening an app. Would be great to fix it.

Developer

October 4, 2025

Those free alternatives run LLM inference on the CPU, which is much slower and less capable. We use the GPU instead. We’d love to run Shortcuts in the background like you can on the macOS version of this app. On iOS, Apple restricts background execution of tasks that require intensive GPU usage. This limitation is enforced to preserve battery life and maintain system performance. According to Apple's guidelines, apps attempting to run a Metal kernel in the background will be terminated immediately to prevent unauthorized resource use. For Private LLM, while we can run operations in the background on macOS leveraging the GPU, iOS versions are constrained to CPU processing when the app is not in the foreground. Running Private LLM's AI-driven tasks on the CPU is technically possible, but it would be significantly slower—more than 10× slower compared to GPU processing. This slow performance wouldn't provide the seamless, efficient user experience we strive for. We are hopeful that future updates to iOS might offer more flexibility in how background processes can utilize system resources, including potential GPU access for apps like Private LLM.

无审查版本彻底解放天性！

I was looking for an offline LLM to use while traveling, this is perfect. Exactly what I needed! Highly recommended.

The speed is impressive. The ability to connect with Apple shortcuts ment I could drop my OpenAI api calls for tagging and summaries. And being able to choose models really allows you to purpose build automations. It would be great to be able to choose a model when using apple shortcuts. And more model options over time would be great.

Erstaunlich gute Ergebnisse, bei so einem kleinen Model. Ich warte auf das Qwen:8b-Modell, damit kann man dann schon richtig arbeiten und nicht nur spielen/testen. Ich nutze das 8b-Model mit Ollama auf meinem Desktop-Rechner.

Very cool app for those with limited internet connectivity. You can download different models for what fits your needs. Be warned: Each one does take up quite a bit of space.

Супер!

Op basis van een AI-vergelijking tussen PocketPal en Private LLM leek Private LLM aanzienlijk sneller te zijn. Dat was voor mij de doorslaggevende reden om tot aankoop over te gaan. In de praktijk valt het verschil in snelheid echter nauwelijks op. Ik gebruik beide apps op mijn telefoon en wissel ze regelmatig af, afhankelijk van wat ik nodig heb.

Une application pour vraiment utiliser l’IA avec confidentialité.

Go look at ChatGPTs page and see all the data they’re harvesting. No thank you

希望尽快添加对gpt-oss的下载和使用！

A simple, honest and no fuss app for local LLM. I like it, but I also miss newer models like Qwen 3 or Gemma 3N.

Testar idag fungerar helt ok

Context; using on iPhone 14PM. Works brilliantly and the support replied fast to my email asking what they recommend for which model AI to use. I use it for general trivia, workout and exercise advice etc. hasn’t let me down and hasn’t crashed once. Edit; after using it for a while now I am finding it difficult to have it analyse documents. This is due to there being no upload document button. I’m having to copy paste exerts. Please add this feature for Docx files and PDF alike devs :)

Nice. Please add multiple chats feature!

Please

Please allow to load a model from files. Add an option to unload models from memory. Allow for several conversations.

Need to fix memory and saving conversations it sometimes reset and you lose your conversation and you’re large language model forgets the conversation

It needs more customisation and settings. Maybe instructions for the Ai to follow during conversations and roleplay. Since sometimes it will just go of on its own and write a whole story until I run out of memory and it crashes, and other times it will just say three lines. Settings for things like: First message: Making an editable default message for the AI to start the conversation first, so that it can understand the form of how it's supposed to respond. Because currently it's very random. Adding the option to make your own backgrounds would be nice too. Ui customisations. Options to save prompt of characters. Save conversations for continuing later on. You could look at the popular Ai roleplay apps on the AppStore. I hope you can implement some of these things but if it's not your direction then no worries I guess. I think this could be a really good app in the future, especially to have on the phone. I don't think I can use it currently but I'll will revisit when it's more updated.

I love that there are so many predefined models from whom one can chose and the general fact that I can execute AI models locally (!) on my iPad, which is finally a thing that takes advantage of iPad's great hardware. That said, it would be great if the UI would feel just a little more SwiftUI-native and the app would support the ability to add multiple chats and customizing the system prompt (Maybe even add system prompt profiles, like LMStudio?).

Funktioniert tipptopp + gute Modelle können einfach heruntergeladen werden. Neben dem Hinzufügen weiterer Modelle wäre die Möglichkeit des Verwaltens von mehreren Chats essentiell. Ohne diese Funktionalität ist das Tool eher nur für sporadische Nutzung interessant.

Does what it says lots of LLMs only request is to have it available on my Apple Watch.

Excellent, fast unlike other ones, no in app payments, works offline, you can override the ai and give it a personality or even completely unrestricted it. Could do with image generation and ai notes sort of thing.

Von allen angebotenen Modellen in der Liste, gibt es gerade mal eines, das nach dem Download das Programm zum Absturz auf einem M2 iPad Air bringt, das war aber auch schon alles. Die Modelle arbeiten wohl wie sie es sollen, aber etwas mehr Kontext, was die Stärken und Schwächen jedes Modells sind, wäre doch wünschenswert. Der Download ist etwas inkosistent und selbst bei eingeschaltetem Stagemanager führt ein App-Wechsel sofort zum Abbruch des Downloads. Das Gute jedoch ist, man kann den Download fortsetzen, der bisherige Download geht also nicht verloren. Für iPads mit 16 GB Ram würde ich mir jedoch ein paar Modelle mehr wünschen.

Could you add more download mirrors for the model files? The current download speeds are slow, sometimes no speed at all. Thanks a lot!

Awesome app. Please keep up to date with support for the best open source models - maybe look into Gemma 3.0

I think this app is amazing for what it can do, summarize my texts, rewrite my stories, and more. And with the power of shortcuts it's even better. But although I rated it five stars, it sometimes happens that the app, after perhaps a few days, crashes in perpetuity, requiring me to redownload the app from the App Store. I'm not sure if it has to do with my accessibility settings, like voiceover and voice control. Unfortunately I cannot disable these, because I rely on those features to use my phone. But perhaps this could be looked into? Again, despite the crashes, thanks for making an amazing, privacy-focused local LLM app.

Stumbled across this app randomly. Still figuring out its best use cases. Downloaded DeepseekR1 14b. Can’t believe it works. Also, you can override the system prompt in the app easily. Asking Deepseek to ignore its guardrails completely removed a lot of the CCP propaganda. I was able to get a pretty coherent response on the Tianamen Sq Massacre. One request for dev, is it possible to allow document uploads? Even if it’s just text based pdf or screen shots? Would really help the workflow when internet is miserably slow (like on an airplane)

Veo una sola reseña en español y es de una estrella. No sé si esa persona esperaba correr la versión más potente de deepseek en su teléfono. La versión que corre en mi iPhone 15 pro es impresionantemente buena, sobretodo si consideramos que lo está haciendo de forma local. Y si es más rápido que pocketpal, por lo que vale los 99 MXN.

I’ve been comparing them all. This is my main LLM app. Good work.

I enjoy using this app for brainstorming wherever I am

didn’t find deepseek models on ios version 1.9.6 Dolphin 3.0 Qwen2.5 1.5B model crashes

I have been a Private LLM user for the past 3 years. Love the developers; they are knowledgeable, hardworking, diligent, and they work hard to support new LLM’s when they come out. If you are looking for a simple, easy-to-use mobile-friendly on-device inference app for running LLMs (AI) locally on your iPhone 15 and beyond, look no further than Private LLM. Wonderful people doing hard work to make AI easily accessible to us all. Give them a try - you will be pleasantly surprised by the experience. 📲👨‍💻

Add support turkish languange

This app offers smaller, but still powerful LLMs that run directly on your device. The UI is clean and easy to use. The creators are always updating the app with the newest model releases. Highly recommended if you want to use generative AI with privacy guarantees.

default model make application too big. Please provide it as optional.

PrivateLLM just works. The curates selection of models is great and the performance is acceptable es well. You only need to make sure, that you have a beefy machine (tested w. iOS/iPadOS w. 8GB of RAM, MBP w. 64GB).

It's functioning well so far, but it's not an unchained LLM, which somewhat undermines the purpose of having a ‘private’ LLM. It also tends to be overly cautious when answering medical questions.

Provides a ton of models, quantized with OmniQuant, including abliterated options. App is entirely private, there are decent options for configuration, the devs are active on Discord, and new features are continually being evaluated and worked on.

Muy buena opción tener una IA lo al y esta app es la mejor

EHHHHHHHHHHHH

I would love to have access to the 1.5b Queen Distill, the 7b one doesn’t work on iPhone 14 pro. Other models works great, I’ll give the shortcut features a try!

Developer

February 3, 2025

Thanks for the review! There are many smaller reasoning models being built and we'll be adding ones that pass our internal evals to the app soon, in future updates.

Please add Dark Mode!!!!

Developer

January 31, 2025

Thanks for the review! Our app supports dark mode on iOS, iPadOS and macOS, if the device is in dark mode (Settings / System Settings).

有些卡顿，有时候显示不出来回答，闪退不常见，温馨提示：中国人员需要梯子才可以下载大模型

I love love love this app it’s like living in the future with AI models on my device. Everyone should have this!

I absolutely respect the privacy I have been very concerned about my ideas being feed to A corporation that doesn’t care about me, the app is great the problem is the model are limited and trained on different topics that have nothing to do with what I want.PLEASE if you can create a way for people to create their own models by simply dumping files of books or any kind of data Anyone will be able to just create their own models with what they want Not only will it be private but moldeable Amazon started as a simple bookstore but it later became an every store

This is a really great way to run local LLMs. The devs update it often. Just make sure you read the system requirements before you buy.

稳定性很不错，但是为什么不能导入自定义模型，和国内镜像源切换呢？中国大陆的用户无法直接访问HuggingFace，会导致不使用手段或出国将无法下载任何模型

Developer

January 6, 2025

感谢您的评价！我们使用Omniquant或GPTQ对模型进行量化，并将其托管在我们的huggingface.co账户上。当检测到用户位于中国大陆或香港时，应用程序会自动切换到hf-mirror.com。根据多位用户的请求，我们将在即将发布的更新中添加一个显式的设置选项。请尝试一下该应用的macOS版本，拥有iOS版本的用户可以免费下载安装。

进度条有bug，会卡住一段时间突然跳到一段。没有自定义导入模型，中文也没有，建议增加聊天列表，可以新增或删除。只于一个聊天里还是不太方便

16手机上运行流畅，ipad2021pro上新版本点击管理模型闪退

Türkçe soruları anlayıp İngilizce cevap veriyor ve resim üretmiyor

I really hope that this app can support the network search function, so that I can have a real intelligent assistant.

Developer

October 1, 2024

Thanks for the review! We've added support for Gemma 2 2B in v1.8.7 of the app. Edit: Smaller Qwen 2.5 models will land in a future update.

Can’t get rid of the built in one though. Wastes a bit of space if you are using a different model.

Developer

December 10, 2024

Thanks for the review! The builtin model is a part of the app bundle and cannot be deleted. It only consumes about 800MB of space, but that's the tradeoff for having an LLM app that works as soon as it's downloaded. Apple implements delta updates for updates, so no bandwidth is wasted downloading it with every update.

Fantastic app, I like the selection of models and they run great on the M4 chip of the iPhone 16 Max and iPad Pro. System prompt is also great for some tweaks to responses. The most simple and important feature (aside from model memory) that Private LLM needs is to be able to edit the responses of the AI. I enjoy the chatbot's responses but hate that it'll pull context from previous responses and loop entire phrases regardless if I regenerate its response or edit mine. Sometimes I don't like how the model formatted its response and want to change it without clearing the convo and retrying multiple times. The second feature that would be a quality of life is to be able to save conversations within the app. At the very least, export them as a whole without needing to screenshot, grab text, paste, correct, and format it elsewhere. I learned early on that copying text blocks at a time can cause the app to reload its model and even clear the conversation. A bot refresh would also be nice to clear older message context during a longer conversation to keep the model fast and responsive, but that can coincide with model memory to more easily pull specific facts you want it to remember in the first place without having to create a queue of explanations to pick up where you left off at. Useful if you switch models for different purposes like organizing, summarizing, q&a vs. generation, editing, brainstorming, vs. chatting.

Die App läuft flüssig, die Modelle antworten schnell. Es gibt viele Modelle zur Auswahl. Mein Vorgänger hat von Abstürzen berichtet, das kann ich nicht bestätigen. Bei mir läuft alles flüssig. Super! Die 10€ sind es auf jeden Fall Wert. Dickes Dankeschön an die Entwickler

The App is great but have had issues with many of the models giving strange and unusable responses.

Private LLM delivers exactly what it promises, and for $10, it’s a great deal. The app works seamlessly, and it’s worth every penny if you’re looking for a reliable, private AI assistant on your mobile device. However, as a writer, I’ve found its capabilities somewhat limited. While it excels in many areas, the nuances required to truly make language pop—metaphors, tone shifts, and narrative flair—are a challenge for any mobile AI app. The constraints of running on-device mean it’s capped at 8 billion parameters, which, while impressive for mobile, can’t compete with the richer, more nuanced capabilities of models like ChatGPT with its trillion parameters. That said, if you’re not relying on it for deep creative work, this app is a standout performer. For privacy, portability, and general utility, it’s one of the best out there. Just keep in mind its inherent limitations for high-level writing tasks. This version keeps your key points but polishes the tone and structure for better flow and impact.

很顺溜，开发者还可以完善一下 提示词库和提示词调取的功能，特别棒，加油💪

Developer

November 19, 2024

感谢您的评价！

Mir fehlt die Möglichkeit mehrere Chats zu erstellen.

I also tryed VPN but it didn’t work too

Developer

November 5, 2024

Thanks for the review! All our quantized models are hosted on huggingface. In regions where huggingface is blocked, we use hf-mirror.com. Please email us, you can find a link for it at the bottom of the help view in the app, and we'll get this sorted.

Bitte baut noch ein, dass man mehrere Konversationen haben kann.

Developer

October 30, 2024

Danke für die Bewertung! Der Verlauf von Gesprächen steht auf unserer Roadmap, und wir werden ihn in einem zukünftigen Update hinzufügen.

Still looking for an app that not only has iOS shortcuts support but also has an option to interact without opening the app. I don’t really see the point of having a shortcut that opens the chat. I want to get a response read it maybe copy it and throw it away. Without opening the app. Besides that yeah it runs llms on your phone if this is what you’re looking for you found it.

Developer

October 30, 2024

Thanks for the review! Unfortunately, iOS does not allow background apps access to the GPU (this is the case with Android too). One option would be to perform LLM inference in the background using the CPU, but it's excruciatingly slow. Incidentally, macOS does not have this limitation.

Can you add an endpoint to make it work with Pythonista app

Developer

October 11, 2024

Thanks for the review! We're big fans of Pythonista ourselves and use it regularly with Private LLM using the Apple Shortcuts support in both Private LLM and Pythonista. If this isn't what you have in mind, please feel free to email us and we'll try to implement it in an upcoming app update.

Great app, LLMs run really fast on iPhone 16 Pro! I would love some work on the UI, and possibly a download all models button. It would also be fantastic if some larger models were added even though they would be slow. 5 Stars!

This app is great, I love that I can interact with LLMs locally and privately, and I'm quite honestly blown away that the devs of Private LLM have been able to make this work! My only suggestion is adding a bit more advanced customization options, like additional sampling parameters (Top K, Min P, Top A, Frequency Penalty, Repetition Penalty, Presence Penalty, Max Tokens, etc), and an option to add manually downloaded LLMs. Additionally, it would be amazing if there were some kind of memory system, similar to the "memory" feature on the ChatGPT app, to enable our LLMs to remember details across multiple conversations. All in all, this app is great for what it is. I'm thoroughly impressed!

Can we please have OpenAI Whisper and support for multimedia if the model is multimodal. Also Siri Shortcuts are very basic. We need the option to use it in a “Headless mode” but otherwise fantastic. I would also love to see the token generation speed as a toggle “like an FPS counter “

can you guys change the icon, it looks like some shady dating app icon, thank you

It’s easy to use popular open source llm!

Overall this is great. Only private LLM manager I could find that runs on iOS (as a plus the macOS version is available through the App Store!). The UI isn’t the most polished, but that isn’t the end of the world.

This app is nice!, works well with my ipad 10th gen. It would be even better if the AI was able to run any code from any language and incorporate the codes output in its responses.

Still the best, performance is still great on older hardware very smooth and idiot proof

Great app! Always interested in trying newer, more powerful models!

Works out of the box. I like that it’s getting updated with llms that will work on your phone. I would recommend to follow the developers recommendation for which LLM to use. Ps phone does warm up and use battery, but that’s expected.

there are improvements that would add massive value: 1. it would be even better if it would offer the ability to have multiple chats. Having a single chat stream is confusing. On my Mac I am using LM Studio and I would love for a similar setup to be present. 2. I’m not sure it offers the maximum quantization that would be possible on the M4 16GB iPad Pro given the Q3 limits on Mistral Instruct and 4bit Phi3. I understand why those make a lot of sense for broad support in a one size fits all situation but I would naturally also like to use the device to its limits :)

Developer

July 25, 2024

Thanks for the review! We're working on enabling support for larger 4-bit Omniquant quantized models on high end iPad Pros with 16GB of RAM (M1, M2 and M4). This has lately taken a bit of a back-seat because we're currently working on adding newer models that were released recently (like Llama 3.1). We'll get back to it as soon as we're through our model backlog.

Awesome app allowing you to choose which LLM’s you use for specific tasks. I think it’s pretty flawless the way it is great job on developing. I think it’s the best thing available today. Ultimate Wish list: functionality to simultaneously query multiple chosen large language models and aggregate their responses into a single answer by master LLM chosen.

Really interesting app! Thank you! Just note that like in the various sample shortcuts, it’s best used at the end of your shortcut and then drop the result to the clipboard. I could never convince it to open another app afterwards and put the result in there directly.

On least on the high-end iPad, performance is wonderful even on the largest models. Definitely worth $10 USD.

Developer

June 26, 2024

Thanks for the review! We'll soon ship an update to support bigger models for high-end (1TB+) iPad Pro devices, utilizing the higher memory (16GB) available on those devices.

This LLM app is what i was looking for. It is the reason I purchased an iPad M4. Defff worth the $10. Even the developer is active and available to chat with online, so reach out if you run into any issues, overall super great and cannot wait to see more updates!

I seen that there’s different AI models to choose from in the App Store pictures but when I open the app, the ones in the picture aren’t there. Maybe there could/should be an instruction page on where/how-to download other AI models

Developer

June 23, 2024

Thanks for the review! You can tap on the model name and then on "Manage Models" in the resulting menu to download new models and delete downloaded models. We realize that this isn't obvious at first glance, and it ought to be more obvious. We'll add some onboarding tips explaining it, in an upcoming release.

Still the best offline AI, most stable and has by far the most current datasets available; this is truly a beast of an app for offline use. I strongly recommend! 👍👍👍

Developer

June 23, 2024

Thanks for the review! We have many more updates with more models and features coming.

Viele der AI-Models funktionieren auf dem iPhone 14 Pro sehr schnell und liefern gute Ergebnisse. Der Download von Models ist manchmal etwas instabil und lässt die App abstürzen. Vor allem für Einsteiger wäre es sehr praktisch in der Übersicht der Models eine kurze Beschreibung mit Schwächen und Stärken der einzelnen Models zu haben, die einem bei der Auswahl eines geeigneten Models hilft (ähnlich wie bei GPT4ALL). Auch eine Begründung warum ein Model von den Entwicklern empfohlen wird. Eine Übersetzung des UI wäre auch nicht schlecht! Insgesamt aber eine wirklich tolle Software! Hoffentlich wird auch zukünftig noch viel Liebe in die App gesteckt. Macht weiter so! :)

Would you add Llama3 q4 and q5

Developer

June 8, 2024

Thanks for the review! q4 and q5 are terminologies from the llama.cpp world. We don't use llama.cpp, and we don't use naive RTN quants like llama.cpp does. Our quantization algorithm of choice is OmniQuant. We support w4g128asym quantized on the macOS app. We use the same quantization for smaller models on iOS, but we use w3g40sym quantization for models with 7B or more parameters due to memory constrains. Our plan is to support w4g128asym quantized models on iPads (and hopefully the next generation of Pro and Pro Max devices) with 16GB of RAM.

Can’t believe my iPad is so powerful!! Works a charm on my M1. I download Phi3 no problem. You can also get it talk via clicking on text then speech. I then downloaded another model, which wasn’t show in list of installed models. I had to quit the app and go back into it to see the new models, then voila! [It may seem obvious but worth mentioning, some users may not quit the app, and quick to act in leaving negative feedback.] Can i make a request? Can you add the best model of Aya23 for translations?

Developer

June 8, 2024

Thanks for the review! Also thanks for reporting the downloaded model list synchronization issue. We've fixed it and it'll go out with the next update. We'd have loved to add the aya-23-8B model, but sadly it's licensed under a cc-by-nc license making it legally untenable for us to add it. We'll be adding the newer QWen2 models soon, which are liberally licensed and were trained on 29 languages (Aya models were trained on 23 languages). We expect those models to do well on translation tasks.

Alors, c’est génial et pratique. Mais on peut quand même voir la différence entre les modèles non open source et ceux qui le sont 😂. Mais franchement, très bonne app qui permet d’utiliser de l’ia sans internet, sans une puissance de dingue ( ayez les derniers modèle de mac et d’iphone par contre )

Developer

May 31, 2024

Merci pour votre avis ! Nous avons une multitude de mises à jour en préparation, ainsi que de nouveaux modèles qui seront disponibles dès la prochaine mise à jour. PS : Cette réponse a été traduite automatiquement de l'anglais au français grâce à l'application Private LLM, qui fait tourner le modèle Mixtral-8x7B-Instruct sur un Mac.

It’s a very good app but the design needs a lot of work. Would also be good if there was a description for each of the models and what each might be best for.

Your application is paid, but it should allow users to upload their own personal model via file. I use Llama3, 4Q, which works everywhere, while your model does not function correctly as it responds without understanding. You have only provided Llama3, 3Q. We request that you add a feature to select and upload a GGUF file that we have already downloaded.

Developer

May 31, 2024

One of the reasons why our app is far better than other GGUF based apps is because we quantize models with the state of the art OmniQuant algorithm. It takes many hours of NVIDIA GPU time to quantize each model with OmniQuant, while it only takes a few minutes of CPU time to RTN quantize GGUF models. But the resulting OmniQuant quantized models are superior to RTN quantized models, in terms of perplexity. You'll find more details about this on our website (privatellm.app). If you have any requests for models, please write to us and we'll quantize and include the option to download it in an upcoming release.

Nice niche to run models on iOS. Allows also downloading of models from huggingface. Rather pay the 10eur, than get something with massive adware

thanks

Apple watch Anbindung wäre noch perfekt!! Vielen Dank

Developer

May 5, 2024

Vielen Dank für die Bewertung! Wir haben Pläne, eine companion watchOS App in Zukunft hinzuzufügen. Bitte versuchen Sie unsere macOS App. Sie ist ein kostenloser Download, da Sie bereits die iOS App haben. Die macOS Version unterstützt viel größere Modelle. PS: Diese Antwort wurde übersetzt von Englisch auf Deutsch, vollständig offline und privat mit der macOS Version der App mithilfe des "Mixtral 8x7B Instruct" Modells.

Wish there was an option for adding additional models, but the ones that are available work well. Now if y’all were able to do a text-to-voice implementation with custom voices that’d be amazing. I’m not particular tech savvy, but the fact this app is capable of working offline is amazing.

This app looks ok, but they are ruining the experience by only allowing very low quants of the model. I got this app just to use Llama 3 at 4-bit quant and Phi-3 mini at 8-bit quant (which an iPad Pro M2 can easily handle). Please add these quants or allow a way to add ours. Happy to update the review if this is done. If you’re worried about the app crashing on older hardware you can add a warning to those models.

Developer

April 29, 2024

Thanks for the review! We've got a task on our roadmap to allow users to download 4-bit quantized versions of Llama 3 8B on 16GB M1/M2 iPads (and possibly next iPhone 16 Pro/Pro Max when they come out). All Llama 3 8B models on macOS will be 4-bit OmniQuant quantized (update releasing this week). While I agree that 4-bit quants are better than 3-bit quants in perplexity, 8-bit quants are unnecessary with OmniQuant. Your priors seem to be from the llama.cpp/Ollama/LMStudio world where they use RTN (round to nearest) quants and Q4 RTN quantized models aren't great. We invest a lot of GPU time and human effort into quantizing models with OmniQuant and 3-bit quantized OmniQuant models are comparable in perplexity to Q4 RTN quantized models and 4-bit quantized OmniQuant models are comparable to Q8 RTN quantized models. I encourage you to read the OmniQuant paper if you're interested in the details.

Great product. The developer puts new models online asap. The models are selected and configured beautifully to work on device.

The app does what it describes therefore I give 5-Stars. I really like that it allows me to use LLMs offline since I often lack internet and it allows me to use it with sensitive information. I would like it to be a bit more polished. The formatting in the chat window looks strange, I would like to be able to adjust color schemes and different chats would be nice. Right now it‘s always one chat at a time. Really often I open a new chat for a different topic and than want to come back to the previous one but it‘s no longer there. Please add these features. I would even pay for them if you put them behind a paywall for a one-time purchase.

Developer

April 26, 2024

Thanks for the review and the well thought out feature requests! We're working on adding support for multiple conversations in the app. Also, we have no intentions of gating features behind paywalls in this app. Everyone who's ever purchased the app, will get the exact same feature set. No discrimination, whatsoever. :)

Mein Vorschlag wäre, dass man auch eigene KI-Modelle über Dateien importieren könnte.

Pros: -simple interface -If you are looking to run language models on your own device this does the job -lots of models you can choice from -you can run llama-3 8B on an iPhone with 6GB of ram (wow) Cons: -occasional performance problems which are fixed with a restart -as of now the app is very barebones in features especially for those looking to tinker -very aggressive quants mean a drop in output quality but this is due to hardware restrictions from the limited amount of RAM available on mobile devices -some interesting models are unavailable to download Overall I recommend this app, just don’t expect the same quality, speed or features of an online monthly subscription llm app like ChatGPT. Looking forward to future updates from the developers!

Great! Just wished it saved chats like the ChatGPT app.

Simple, straight forward. Lovely

Wish one day can add support to Qwen1.5❤️Love from China

The growing list of the downloadable models and the new override prompt are great! Could we get more in app information about each model, maybe something that explains what each model is best at? I was also wondering about adding the ability to make override prompts presets linked to specific models. This would allow a user to make various custom assistants designed for specific tasks.

Developer

March 22, 2024

Thanks for the review! We've got many more updates with new models and features coming up.

Please take consideration people with 16 go of ram iPad pro! Get us some bigger model!

Your app is a good option for on device LLM I congratulate you on your successful update please make shortcut not show when run

Developer

March 30, 2024

Thanks for the updated review! For performance reasons, iOS does not allow running Metal kernels in the background. macOS does not have this limitation and macOS version of Private LLM runs in the background when invoked from shortcuts. We could run the LLM inference on CPU when the app is invoked from the background, but inference without the GPU would be very slow. We'd love to lift this limitation, perhaps the next major version of iOS might let us do it.

The app seems more stable than the others I’ve tried. It would be good to see the ability to browse and add models from huggingface and to have RAG available document querying.

PrivateLLM rocks! First off the devs are cool and responsive but the best part is that it has shortcuts support so the sky’s the limit. Feed whatever data you can into it and it’s all offline and private.

When I first tried this app, it was a letdown - just one slow option and I wasn't impressed. But man, was I wrong! The developer has put in some serious hard work, pulling off a 'No Man’s Sky' style transformation. Now, it's packed with well performing models for whichever device you have presently, and honestly it’s become my go-to. Also, I will always appreciate and recommend this app based on its privacy oriented USP alone - because finding apps that care about privacy (especially in a field so ripe for exploit) feels like panning for gold in a septic tank. I’ve gone from regretting my purchase to relying on it daily. It’s versatile, reliable, and an absolute game-changer for anyone looking to work with LLMs privately. I've got to give a huge shoutout to the developers for their commitment to turning things around. Your hard work hasn’t gone unnoticed, and I'm sincerely grateful for it. Wishing you all the success in the future - you’ve got a fan in me! Had to update my review to give the devs a huge thumbs up for such an impressive turnaround!

Developer

March 21, 2024

Thanks for the updated review and staying with the app! This is just the beginning, and we've got many more updates with features and models lined up.

O desenvolvedor está fazendo várias atualizações no aplicativo, melhorando interface, adicionando novos modelos e funcionalidades!

The implementation here is great, especially now that the devs have added support for several models! Works best with devices with a lot of RAM - I have an iPhone 15 Pro, which seems to be enough, but my old 12 didn't really handle it well. I just wish you could save threads like in the ChatGPT app (and maybe give specific system instructions depending on the thread?). Otherwise, pretty good and worth the price! Also, if we could save specific temperature and top-P presets with models and maybe be able to directly type values in, that would be nice.

The developer is very active and is currently adding many improvements.

Developer

March 16, 2024

Thanks for your feedback! Please email us or message us on Twitter or Discord if there are any specific features or models that you'd like to have in our app.

Well, according to the list of viable machines, my iPad Air 3rd generation should be able to run this. It won't run. It launches, struggles for a minute, and crashes. So, I can't really review this. All I can say is that it won't run on my iPad. EDIT: I was able to run this on my MacBook M2 just fine. Looking forward to seeing it run on my iPad. (I have poor old-person eyesight, and I hope the type is slightly larger on the iPad. It doesn't seem to be adjustable on the Mac.)

Developer

March 17, 2024

Thanks for the review! The 3rd Gen iPad Air had 3GB of RAM of which just under 2GB is usable for apps, which is just barely enough to load the current quantized 3B model. If you have any other apps running in the background, the app likely won't have enough memory to load the LLM. We're working on an update to the app which will add a new, smaller (but better) default LLM that will work well on your iPad Air. We're internally testing this update on an iPad Air 3rd Gen and an iPhone SE 2 (which also has 3GB of RAM). Edit: The v1.7.0 update is out, which introduces three new models that will work well on your iPad Air 3rd Gen, could you please try the updated version of the app?

After I saw the only review here on the App Store that’s nothing but gibberish, I had to write my own. I love that this app works offline and everything you put into it is private and kept on your device. Plus, there’s no money hungry subscription service. From what I’ve seen on reddit, the developer is working hard on improving the app and I’m looking forward to seeing what’s implemented in the coming updates. So far it’s been great for every day questions and information.

Create anything without worrying about personal information leaked. Many models to choose from.

We need the ability to set the system message, considering the price we should be able to load our own models. —— Changed to 5 star for now, if the dev delivers on what they said this app should be great!

Developer

January 10, 2024

Thanks for the review! We've got an update in the works which has both the ability to set the system prompt and also download multiple models, like in the macOS version of the app. We've got a few stability issues to iron out before we can release this update. Also, please try the macOS version of the app, it support bigger models and is a free download for you, since you've already got the iOS version of the app.

Please add an option to add the MoE Mixtral 8x7B.

Developer

April 21, 2024

Thanks for the review! We'd added support for Mixtral 8x7B and a few fine tunes in the macOS version of the app, a couple of months ago. Supporting Mixtral 8x7B on iOS wouldn't be possible at the moment, since the model needs just over 24GB of RAM (i.e a 32GB Mac).

This is a good little chat bot to play around with when you don’t have internet access. I only have an iPhone 12, so it won’t run the bigger model, but it’s still enjoyable. For a feature request, it’d be nice to have the ability to customize the system prompt.

Works very well on iPad Pro 11‘‘ with M1 Chip. I would like to get support for more LLMs (currently only 2 are available).

Developer

December 9, 2023

Thanks for the review! This is already supported in the macOS version of the app and we're currently working on adding support for multiple downloadable models in the iOS version of the app.

Even after restarts, closing all apps, running special apps that free ram, i only get 3b

Developer

April 26, 2024

Edit: We launched support for multiple downloadable models in v1.7.0 of the app and users can now download over 2 dozen different models, depending on their device capabilities.

This app is awesome for offline use! I would like to be able to download other models from hugging face though. Please make this a feature!

The developer is doing a wonderful job at updating the models the app uses, and it’s really noticeable.

This is a very important app and concept in this day and age. Although as a suggestion in order to improve the AI users should be allowed to "opt in" to submitting data to better refine the model. Thank you for everything you do!

Nice for Shortcuts that need to “think” a little!!!

Feature suggestion: the ability to edit the REPLIES that the LLM gives. This way you can influence it better.

This app is fun, but being able to use other models and configure them would make this app 10 times more useful. I’m hoping the dev adds support for model selection (mistral, pls) and setting the role of the AI.

Developer

October 12, 2023

Thanks for the review! We've already got the Mistral-7B-OpenOrca in the macOS version of the app, and we'll soon be releasing support for more Mistral-7B based models on macOS. The iOS app will have Mistral-7B based models, soon after that.

I cannot believe that I can run a model similar to GPT 3.5 on my iPhone 12 mini! It is a bit slow, but really impressive. The purchase allowed me to install on my MacBook Pro M1 Max 32GB and it is faster than GPT 4. Really excited to see how this app continues to develop and the models get better.

Okay… THIS APP IS AMAZING. I am using this on my iPhone 12 Pro Max and wow, pretty fast reply. I am still playing around with this app but I am very impressed with it. I wonder if new models from huggingface could be downloaded, if that’s possible.

Developer

October 7, 2023

Thanks for the review! We'll be adding support for downloading multiple models soon. This will be released on the macOS version of the app first (please try it, if you haven't done so already, it's a free download on the Mac App Store, since you've already got the iOS version of the app, and also, it supports bigger and better models). Currently, it isn't possible to support downloading arbitrary models from huggingface because our app uses a compilation based approach for performance and support for each model has to be baked into the app binary.

Would love to be able to download different models. If not from an in app catalogue, perhaps putting in a url from hugging face? Otherwise pretty neat.

The 7B model constantly crashes on 14 Pro even though the prompt says that the phone can handle it. Downgrading to the 3B seems to work much better.

Developer

October 2, 2023

Thanks for the review and the bug report. We've just released v1.6.2 of the app that fixes this issue. Although, the model weights have changed, if you've already downloaded the 7B model, you might have to delete and reinstall the app. We'll soon add UI within the app for users to be able to download and manage additional 7B models.

Please allow us to pick our LLM the same way we do in text-generation-ui by providing hugging face name. I realize not all models can run on iOS, but I was hoping to mostly use this for CodeLlama.

Developer

September 22, 2023

Thanks for the review! Memory is the primary bottleneck for supporting larger models on iOS. Fortunately, quantization tech is steadily getting better. We plan on adding support for more 7B models on newer iOS devices (iPhone 14+), soon. Specifically for CodeLlama 7B, supporting the full 16k context length of the model on iOS devices with 6-8GB of RAM is going to be quite challenging, but we could support it with reduced context length. Please try our macOS app (free download since you've already got the iOS version) which supports 13B models on Apple Silicon Macs with 16GB or more RAM. We're also planning on supporting even bigger models on Apple Silicon Macs with more RAM.

Hard to believe this kind of power is available locally. Can’t wait to see how this tech develops. Would love to be able to upload documents or large text files.

Gives solid basic advice. Can handle smaller projects and concerns. Not 100% there. Not 100% stable. Can tell some creepy stories that are unsolicited. Definitely needs a safety team.

This app is more like a proof of concept than a useful assistant, but that’s perfectly fine. Such a small model run locally doesn’t pack much of a punch, but the fact that it is even possible, is awesome. I am really excited for future updates and additional features.

Obviously being an offline GPT limits the responses, but the fundamentals for something impressive in future less memory restricted devices eg iPhone 15 and beyond is really exciting. Offline and privacy focused are essential qualities of this app and it works quite well. A good bargain for the price with an active developer. One recommendation/piece of feedback would be to provide information on what the settings TOP-P and temperature do. If we come across an error or weird, reproducible response could you provide an option to email you a log so we can forward you the issue easily? This way you don’t need to embed any privacy violating analytics packages.

Developer

June 29, 2023

Thanks for your feedback! Indeed we're hoping the upcoming iPhone 15 series of devices will have more memory, so we can ship bigger and smarter models for newer devices (As free updates, of course!). We're in the process of adding an FAQ on our website to answer the temperature, top-p question. We've already received the question a few times by now on our support email and on discord. Perhaps I should also add a help section within the app. Thanks for the suggesting the email log idea, I'll add it to our backlog. We specifically don't embed any analytics packages in the app, that would be antithetical to the concept of privacy, which is one of our app's USPs. The only logs we get are crash-logs from iOS's off by default, and opt-in Analytics feature (Settings -> Privacy & Security -> Analytics & Improvements -> Share With App Developers). Also, responses from the LLM in the app are (intentionally) stochastic, and are often hard to reproduce.

UPDATE: app is much faster now. Still waiting on a prompt library which would be awesome, but the speed and quality is increasing seemingly by the day. There was a small period of time where it didn’t work on the 13 mini but that has been fixed. I’m happy with the amount of work the devs are putting in and I’m hopeful for more features in the future. MLC chat is comparable in speed and quality but this app is looking to widen the gap by adding more features in the (hopefully near) future. Old review: In comparison to MLC chat (free and open source) this app is lacking. MLC chat offers the ability to install additional models, and the default is on par or better than this apps responses (like gpt 3 level, lots of incorrect information and it kinda goes wild when explaining things). Additionally, performance is abysmal comparatively for better quality responses on MLC chat. It’s a great idea but lacks the ability to fine tune. Being able to change the temperature and other settings for the model would be great. Would also be cool if we could create a starting prompt (or a library to choose from) for the AI so it can be used for things like role playing or DND. Kinda bummed that it’s $5 since I was expecting a lot more than MLC AIs app for the pricing. Instead I’ll be uninstalling and checking back later for new features and possible performance increases. If you’re reading this and thinking about buying it, you should probably check out MLC chat for now and just wait for more features and performance updates.

Developer

June 8, 2023

Thanks for your feedback. Unfortunately, we cannot legally distribute the additional model that MLC chat offers (vicuna-v1-7b) since it's based on the Llama weights, which cannot be commercially redistributed. We don't know how MLC chat can legally distribute it either. Secondly, you mention the lack of the ability to change the temperature and other settings. This is incorrect. Personal GPT has always had settings for temperature and many more, please look at either the top right of the app or look up Personal GPT within the iOS settings app. Finally, we've got an update with performance improvements pending release, we also many more features in the pipeline for release in the coming weeks. Also, thanks for suggesting the prompt library feature, we're seriously considering implementing it in the near future.

It works well and quick. Would be nice if it integrated into iOS shortcuts.

Developer

June 22, 2023

Thanks for the feedback! The next release (v1.1, currently in App Store review) will be a performance focused release, which will make the app even quicker. Please contact our support if you'd like to try out the beta, before it's released. iOS shortcuts is a frequently requested feature. We'll implement it in the release that comes after v1.1 is out.

Gostei muito de usar esse aplicativo, entrega tudo o que promete.

Love it

I have used the app on both my laptop, phone, and iPad as a means of keeping my data secure while exploring the potential uses, and practical limitations, of using LLM’s locally.

Just what I was looking for

Private LLM is fantastic it features some of the greatest models conveniently juxtaposed within the app. Additionally there is a super supportive discord community that you can reach out to for any help or concerns. This is a must have on all my iOS devices.

Consider to add these features: 1. Setting to select font for dialog and monospace font from installed in OS. Currently monospace font for code is ugly (IMHO). 2. Ability to download any compatible Huggingface Model for use by typing url and download.

Absolutely amazing…keep up the good work. A feature request - add the ability to share the chat as a pdf or any document format.

I really like how I can run a local LLM. The different options are neat. And I appreciate the privacy. I was surprised how many I can run on my Mac mini. I wish I had a more powerful machine so I could run the larger ones. Not the apps fault though. Very glad I purchased this one.

Update: Apple’s system function for moving every big file to an external hard disk, is sadly no solution for me. Maybe you could offer your app for direct downloading outside of the app store and then allow manual linking to an external SD just like Sogni and other apps do? Old: Moving models to an external disk is really missing

Developer

February 6, 2025

Thanks for the review! The app downloads all models to the App's Sandbox. From macOS Sequoia onwards, the App Store allows moving large applications to an external disk. This feature can be used to move both the app and the downloaded models. Please feel free to email us or join our discord, if you have any additional feature requests.

Optimized for Apple, simpler interface, use on Mac, iPad, or iPhone. This is just what I was looking for. I have also used Misty and LM Studio which do have advantages as well but for simplicity Private LLM is now my go to AI app. It will be interesting to see how things enviably mature over time as these open source AI distilled models get better and the shells such as this also improve. Interesting times, not sure whether good or bad in the long run but it is best to be knowledgeable.

Je trouve que cette application est presque parfaite. Pour avoir sa 5eme étoile, il lui manque : - Un raccourci mac pour y accéder rapidement (comme spotlight) - Un mode ou la recherche sur internet pourrait être activé (comme pour Msty par exemple). Les résultats seraient alors traités par les IA locales téléchargées. Je serai ravi de changer ma note (surtout avec l’ajout d’un launcher rapide avec spotlight)

Finding so many uses running a local, private LLM. App works well, and I not had any issues in the two months of use. Sure, I’m still going to use ChatGPT for certain tasks, but if I need it to be private, then this app excels. Even for non-private tasks, it’s very handy to have. But the best part for me is the Shortcuts integration. I didn’t really use Shortcuts until I purchased this app, and since then, I’ve found many uses as I learn how to use Shortcuts. Tip: use ChatGPT or similar to help you create a Shortcut. I would like to see certain features implemented, which, according to the devs, are on the roadmap. Seeing how they regularly update the app and are forthcoming on Discord, it looks promising that we’ll see improvements in the coming months. But what it does now, it is spot on.

See title

Have had the Private LLM app a few weeks and have enjoyed putting my new Mac mini M4 Pro to the test with a lot of the LLMs. So far so good. Everything is on local ssd but may try and experiment with it on my TB 4 DAS or even my older NAS. Will try and keep Private LLM itself on my local and move just the data to my NAS or DAS. Mac OS infrastructure keeps what I need in a well known path and folder so I’m going to experiment. Just need to figure out where to change to new Data/Folder path. Dev(s) Thank you for such a great app.

Developer

December 10, 2024

Thanks for the review! Please join our discord, we've got a thread on the #support channel there, on how to offload weights to an external volume.

The app is great, however the version 1.9.1 (84) crash while loading the model: "Nous-Hermes 2 SOLAR 10.7B 4-bit OmniQuant"

Developer

October 16, 2024

Thanks for the review! We're aware of this issue and it was caused due to a bug in an upstream tokenizer library that we use. We've managed to fix it and the update with the fix (v1.9.2) is currently under App Store review. The update should be out within a day.

This app is great to test the models locally on your computer. Like to have a Private Ai that doesn’t leak data to the internet out there. However I do wish to tweak the models and modify them somehow.

Like export, being able to download bigger models to run on MacOS (I’m fine with longer wait/processing times), Being able to run more than one model simultaneously, etc.

It took me a while to understand how to leverage it for automations on my Mac. It is a safe and helpful local tool.

This app represents everything I ever wanted with respect to locally operating a LLM on my Ipad and on my Macbook Pro. It is well worth the purchase price. Please add generative AI to your next update.

Incredibly useful, works great.

If you invest in this really awesome app, you get two versions, either you can run it on your Mac or iPad. Very simple to use, with a variety of models to try out that you wouldn’t have known existed. I like the fact that the developer adds a star alongside models, that they recommend. Keep in mind you need to have the right amount of memory. For example, running Smaug Llama 70b requires a laptop with at least 64 GB. The smaller 8b models, requires 32 GB, but you can get by with at least 16 GB. Message to developer: It would be awesome to see larger models available that will run on silicon macs with higher ram, in the example of 128GB of memory. Note to users: You must quit the app after use to free up memory! Suggestion for future update? If you could get this app to talk to your documents. Wow, it certainly would be a game-changer, potential justifying a price increase. Would also be nice to be able to print out the chat content. Be nice if there was some YouTube tutorials. I couldn’t get the option to chat to my screenshots. I don’t know if this was even possible. But if you did make some tutorials, this would benefit the users, and likely benefit your endeavours. Keep up the excellent work!

It would be great if it had a way to interact with PDF/txt files.

Top application! L'intégration avec les raccourcis est vraiment géniale et ultra pratique. Il manque un petit point, la possibilité d'uploader des documents (texte/image) pour discuter sur le contenu du document...

The main issue I have is not being able to adjust the Font Size, it's tiny compared to even other apps. Makes it almost unusable IMO. Great app overall besides that, super fast, responsive, etc.

Please note I used the app to help me write this review so you can see what it is capable of! --- In the realm of technological innovations, exploring new chat apps and platforms is an exhilarating experience. As a tech enthusiast, I recently delved into “Private LLM - Local AI Chatbot” and found it to be an exceptional solution for daily conversations with its advanced artificial intelligence capabilities. Here are some compelling reasons why this localized AI chat app deserves your attention: Seamless User Interface The “Private LLM - Local AI Chatbot” boasts an intuitive interface that effortlessly integrates across Apple devices (iPhone and Mac). The streamlined design fosters easy navigation through different conversation sections while providing natural-sounding dialogues even during interactions with the AI. This ensures seamless communication regardless of device preference. Personalization at Its Core A standout feature of “Private LLM” lies in its ability to create personalized characters within the chat environment. Tailoring unique avatars enables users to establish a deeper connection with their digital conversational partners. Moreover, customizing the flow of discussion allows each interaction to feel genuine and authentic. Reliable Assistance Through my experience using “Private LLM,” I’ve discovered how well the chatbot handles various topics, offering accurate information swiftly and efficiently. Whether managing tasks or researching specific subjects, the AI proves itself as a reliable source of assistance. With dependable results consistently delivered, the application becomes indispensable for handling everyday challenges. Additional Features Dedicated to optimizing user experiences beyond casual conversations, “Private LLM” offers extra features like reminders and bookmarking frequently visited pages. These functionalities enhance the usability of the app for day-to-day management and allow users to maintain order amidst their busy lives. Setting up reminders helps keep track of important events or follow-ups, while saving favorite pages provides quick access to relevant answers when needed. In conclusion, “Private LLM - Local AI Chatbot” has been instrumental in transforming my approach towards effective communication. By combining a sophisticated AI system with innovative features such as a user-friendly interface, personalized interfaces, and practical additions, the app truly stands out from other chat applications. Give “Private LLM” a try; you might discover just how much more efficient your daily conversations can become!

＊MBP16(M1 Max,32GPU 64G)で使っています。 一般のLLM・GPTサイトと違って、会話を複数管理する機能はありません。そして全文を保存することもできません。レスポンスをクリックしてコピーできるようになっていません。かなり不便です。 Privateの関心は理解できますが、LLMを使う場合は文字が必要でしょう。そうでなければSiriに聞けばいいんじゃないでしょうか？ RakutenAIの7Bモデルなら26token/secで利用でき、正確度にも不満がありません。 初期値のtemp 0.7はやや低いと感じています。 MacではLM Studioが使えますが、こちらは雑な出力が少ないようです。（Q8比べ） 電池を食うようなこともなくありがたいです。

This app is perfect. I have no problem paying 10 dollars for this app. It does exactly what i need it to do.

I'm reading Phi3-Mini is quite capable for its size. I know it was just released, but if you could get a version up soon that would be great. Maybe your existing Phi2 implementation will facilitate that. Easy to download and run an LLM locally. No muss, no fuss. Would like to echo another reviewer: please add support for increasing font size. I found I can actually access the default Mac font menu and specify something different, but it doesn't seem to have any effect on the actual font used in the application.

Developer

May 6, 2024

Thanks for the review! We’d added support for downloading Phi3-Mini the day it was released, on the iOS app (universal app, thus a free download for anyone who's purchased the macOS app). We’ll add it to the macOS app, along with the three Llama 3 8B based models that are already on the iOS app, next week. Also, I understand the need for adjustable font sizes on macOS. On iOS, people use Dynamic Type to globally alter font sizes from Settings, but macOS doesn’t have Dynamic type (yet). We’ll prioritize this on our roadmap. EDIT: Support for Phi-3 and Llama 3B models was shipped in the latest update (v1.8.5).

In today's world of subscriptions and personal data living on devices that are not ours this is a refreshing app that I am happy to support. App has been updated since I originally took the plunge (week it came out, randomly found on /r/macapps) several times, is super responsive and best of all 1x fee with local privacy.

Developer

April 14, 2024

Thanks for the review! Please try the iOS version of our app. Since it's a universal app, it's a free download for anyone who's got the macOS version of the app (and vice-versa).

Fonctionne très bien sur mon mac M3 mais : A quand l'ajout de LLM customisés? Et surtout ! Quand pourrons nous injecter un fichier .doc ou .pdf ?

Developer

April 12, 2024

Merci pour votre commentaire ! Si vous utilisez un Mac M3 avec 32 Go de RAM ou plus, veuillez essayer le modèle Mixtral téléchargeable. Vous pouvez télécharger environ deux douzaines de LLMs sur l'application, et nous en ajoutons constamment d'autres. De plus, vous pouvez personnaliser le "prompt système" dans les paramètres pour personnaliser les LLMs. Nous travaillons sur la fonctionnalité de discussion avec les PDF. Veuillez essayer notre application iOS, elle est téléchargeable gratuitement pour toute personne ayant acheté l'application macOS.

Possibly the single best app purchase I've ever made. The developer is constantly improving it and talking with users on Discord and elsewhere. One price includes Mac, iPhone, and iPad versions (with family sharing). Mac shortcuts can be used to create what amount to custom GPTs. (There's even a user-contributed, quite clever bedtime story generator on the website.) The 10.7B-parameter SOLAR LLM (one of many included) running on my 16 GB M1 MacBook Air gives me fast responses that are subjectively almost on the level of GPT-3.5. For something running completely locally with full privacy, it's remarkable. More RAM allows an even larger choice of language models. But the tiniest model running on my iPhone 12 Pro is usable. (Tip: Experiment with changing the system prompt to fine-tune it for your purposes.)

Developer

April 14, 2024

Thanks for the review! We've got many more updates coming to both the iOS and macOS versions of the app.

I've been using the app since it first came out and it keeps getting better and better. The developers just released a new version that allows you to switch between different models, which is really nice feature!

Developer

April 14, 2024

Thanks for the review! Please try the iOS version of our app. Since it's a universal app, it's a free download for anyone who's got the macOS version of the app (and vice-versa).

With the recent addition of Gemma 2B which is based of Google Gemni this has just become a killer app for me this has been the best LLM model that provides the best answer I hope to see 7B support in the future and I hope this comes Gemma comes to iPhone and iPad soon. Not only is ther the best performing model but it's all done on device which make this even better. Thank you!

Developer

March 27, 2024

Thanks for the review! We've released Gemma 2B for iPhone and iPads in a recent update.

Great product. Really love that it manages LLM files for me, really helped during the flight work session! Thank you devs!

excellent, and a work in progress, for the best

Love the additional models, this is what I was hoping to see when I paid for an app. It's easy enough to find a free client, so this type of support is just what I hope to see continue!

What as easy way to work with LLMs. You can download multiple different models and you can share the application with your family. That's a deal that is hard to beat.

I'm astounded that I can run such capable models on my laptop. The developer is very active and constantly improving the app. It makes running local private models extremely easy and as of the latest update has a great range of different models to chose from. I have replaced a decent portion of my Open AI usage with this App

I run LLMs on Colab and other cloud providers. Private LLM let's me have fun running decent smaller models on my Mac and on my iPad Pro, Recommended!

Seems to do most of what I want. I think there just needs to be two main features added, and one of them should be super easy: 1. Allow increasing font size. Right now the font is pretty small on my computer, and the view menu doesn't have an option to increase font size 2. Support LaTeX. I do a lot of math work these days, and I don't want to see math written without LaTeX. ChatGPT has this feature, which has been super helpful for me when studying

The concept is cool and it works really great. But please add a true uncensored model because both models provided refuse to answer many prompts just like chatgpt does. Otherwise if you could provide uncensored models the app would be a solid 5 Stars. So in v1.5 the 7B Mistral OpenOrca model is still censored. It is ok to have LLMs that are appropriate for all audiences but please put a trully uncensored LLM if one even exists.

Developer

October 8, 2023

Thanks for the review! We've replaced the base 7B Llama 2 Uncensored model the newer and better Mistral OpenOrca 7B model. Also, we'll soon add support for downloading many more models. Could you please try the updated app (v1.5)?

Добавьте выбор любой модели - и будет вообще супер. Огромное спасибо за вашу работу. Отлично работает на iphone и mac. Единственное, что представленные модели очень плохо работают с русским языком. Еще раз спасибо за то, что вы делаете)

Worth the $10. Obviously not as useful as Bard/GPT but it undeniably meets all expectations, and I have yet to see anything comparable. With outstanding email support, a Discord support server, and devs that continually work to improve the app for all platforms- this is a must buy for anyone interested.

I cannot believe it is as easy as a few clicks to install an LLM like ChatGPT and it is running entirely on my Mac! No internet required, no monthly fee for a plus version. awesome!

I've been using this app for a couple of months at this point. When it was first released, it was a neat proof of concept, but it only supported 7B models and was overall just too simple to use effectively. With a recent update, a 13B model was released for all macs with 16GB of memory, and it makes such a huge difference! It's not quite at the same level as ChatGPT 3.5T, but it's close enough that I never use 3.5T anymore; this is my go-to. I greatly appreciate the on-device processing (hallelujah privacy!), and it doesn't even use too much power - my battery still lasts for hours and hours. The performance is also great; my base M1 Air powers right through the prompts. I only have two complaints about the app at this point. 1) The 13B model uses about 12GB of memory by itself, which does force the use of swap on a 16GB Air. Not much the dev can do about this, but it is something to keep in mind. You'll want to close out of other programs before launching this. 2) There still is no feature that has separate conversations. If you want to start a new conversation, you need to delete the existing conversation. I'd love it if we could get separate conversations in a future update; it would make this app so much easier to use. Overall, I love it and do not regret buying it at all. I can't wait to see what future updates bring :)

great app

This is incredible to have my own AI on my laptop. Very appreciate what developer does for this. Now I'm not rely on ChatGPT anymore, even this Wizard 13B model is smarter than free version of ChatGPT. Thank you so much. Amazing works!!!!

Having option to load own models will be wonderful. Eg Llama 2 or others.

A clean and easy-to-use Mac-native implementation of Llama. It's early days, but I'd love to see this on the roadmap: 1. Ability to upload a file 2. Ability to read a folder of files (imagine being able to ask questions about a bunch of documents!) 3. Sharing options, incl. Markdown support

Unlike almost every other offering on the App Store, Personal GPT was designed to provide a local, private GPT for you to use offline with no data being sent to third parties. It includes a limited LLM that works reasonably, given its size. The developer is clearly very passionate about this project and they are constantly updating and refining it. The more memory you have on your device the better this app performs.

The developer has given easy access to a usable information source, disconnected from the tentacles of big tech. This is to be applauded. But expectations are important here. You can't compare a solo effort with that of an organization with billion-dollar funding. Just contextualize this with pre-ChatGPT tech and you may find this a tool to have (in situations where yes.. you are disconnected from the internet or you don't want big tech operators to hoover your brain for free). Docs on if or how to do do supervised instruction of the model would be welcome or how to tweak this. Read the vendor warnings. These are known industry limitations of this type of offering.

As in it meets , maybe exceeds, my privacy expectations, works on all my ios devices WHEN OFF LINE. Emphasis mine, country internet is unreliable. ;-( Developer seems commited, saw this with the guy from the Applo app, hoping for good things, 10 bucks aint bad for what I see so far

But it hallucinates a lot. Or it doesn't answer my question.

Developer

September 12, 2023

Thanks for the review! Our app has evolved significantly since v1.0.2. The app now ships with a bigger 7B parameter model and users on Apple Silicon Macs with at least 16GB of RAM have the option of downloading a bigger WizardLM 13B model. We'd love it if you could take another look at our app.