Private LLM Blog

DictaLM 2.0 Instruct: Bilingual Hebrew-English GPT Now Available for iOS and macOS

Private LLM now supports DictaLM 2.0 Instruct, a bilingual (Hebrew, English) GPT chatbot. Available as a 3-bit quantized model for iPhones and iPads with 6GB+ RAM and a 4-bit model for Intel and Apple Silicon Macs. Update to v1.8.5 (macOS) or v1.8.3 (iOS) or download from the App Store for a secure, private AI experience.
Read more about DictaLM 2.0 Instruct: Bilingual Hebrew-English GPT Now Available for iOS and macOS

Microsoft Phi-3 Mini 4K Instruct Now Available for iOS and macOS

Microsoft Phi-3 Mini 4K Instruct model now available on Private LLM for iPhone, iPad, and Mac. Experience superior AI performance with 4-bit quantization and 4k context length. Download the model on devices with 6GB+ RAM (iOS) or any Intel or Apple Silicon Mac and enjoy private, offline AI conversations, text summarization, and idea generation.
Read more about Microsoft Phi-3 Mini 4K Instruct Now Available for iOS and macOS

32k Context & Mistral Model Updates: What's New in Private LLM v1.7.8 for macOS

The latest v1.7.8 update for the macOS version of Private LLM introduces significant enhancements, notably to the Mixtral model, which now features unquantized embedding and MoE gates weights, while maintaining 4-bit OmniQuant quantization for other weights. The update also includes an increase in context length for Mistral models to 32k, provided sufficient memory is available, and introduces a grammar correction service that adapts to different English dialects. Additionally, there's experimental support for non-English European languages and a new feature allowing users to edit prompts by right-clicking. The update solidifies Private LLM's status as a top choice for running Mixtral models on Apple Silicon Macs and encourages feedback from users to improve future versions.
Read more about 32k Context & Mistral Model Updates: What's New in Private LLM v1.7.8 for macOS