Best Local AI Models for Mac

Cat Llama 3 70B Instruct

70.6B

Immersive roleplay via strict prompt adherence, Llama 3 70B finetune

DeepSeek R1 Distill Llama 70B

70.6B

Reasoning model distilling DeepSeek R1 reasoning into Llama 3.3 70B

EVA LLaMA 3.33 70B v0.1

70.6B

Roleplay and creative writing specialist based on Llama 3.3 70B

Llama 3.3 70B Euryale v2.3

70.6B

Roleplay-optimized Llama 3.3 70B with flexible persona handling

Meta Llama 3.3 70B Instruct

70.6B

General-purpose model in the Llama 3.3 70B family

Llama 3.3 70B Instruct Abliterated

70.6B

Uncensored Llama 3.3 70B with abliterated refusal mechanisms

Meta Llama 3 70B Instruct

70.6B

General-purpose model in the Llama 3 70B family

Meta Llama 3.1 70B Instruct

70.6B

General-purpose model in the Llama 3.1 70B family

Smaug Llama 3 70B Instruct

70.6B

General conversationalist fine-tuned from Llama 3 70B, matching GPT-4 Turbo dialogue

Smaug Llama 3 70B Instruct Abliterated v3

70.6B

Uncensored abliterated Llama 3 70B retaining original knowledge

R1 1776 Distill Llama 70B

70B

Reasoning-focused model in the DeepSeek R1 Distill family

Dolphin 2.6 Mixtral 8x7B

56B

Uncensored Mixtral 8x7B finetune excelling at coding tasks

Nous Hermes 2 Mixtral 8x7B DPO

46.7B

General instruction-tuned Mixtral 8x7B model with creative text generation

Mixtral 8x7B Instruct v0.1

46.7B

General-purpose assistant outperforming Llama 2 70B

Yi 34B Chat

34.4B

Multilingual English-Chinese chat and translation using Yi 34B

WizardLM 33B v1.0

33B

Uncensored conversational model based on Llama 33B with reduced refusal bias

DeepSeek R1 Distill Qwen 32B Abliterated

32.8B

Uncensored proof-of-concept removing alignment guardrails from DeepSeek R1 Distill

EVA Qwen2.5 32B v0.2

32.8B

Roleplay and storywriting finetune of Qwen 2.5 32B with flexible tone control

Fuse O1 DeepSeek R1 QwQ SkyT1 32B

32.8B

Reasoning model merging three chain-of-thought experts for math, coding, and science

OpenHands LM 32B v0.1

32.8B

Autonomous software issue resolution based on Qwen 2.5 32B

Qwen 2.5 32B

32.8B

General-purpose instruction model excelling at coding and mathematics

Qwen 2.5 Coder 32B

32.8B

Coding specialist trained on 5.5T tokens, with 32k context for large files

DeepSeek R1 Distill Qwen 14B

14.8B

Step-by-step reasoning distilled from DeepSeek R1 into Qwen2.5 14B

EVA Qwen2.5 14B v0.2

14.8B

Roleplay and storytelling specialist fine-tuned from Qwen 2.5 14B

Qwen 2.5 Coder 14B

14.8B

Coding, reasoning, and fixing across languages from the Qwen 2.5 14B family

Phi 4

14.7B

General-purpose reasoning assistant from the Phi 4 14B family excelling at science

Mythomax L2 13B

13B

Roleplay specialist merging Llama 2 understanding and writing models

Spicyboros 13B

13B

Uncensored de-alignment finetune of Llama 2 13B for unrestricted tasks

Synthia 13B 1.2

13B

General-purpose Llama 2 fine-tune with guided reasoning and long conversations

WhiteRabbitNeo 13B v1

13B

Cybersecurity specialist for shell commands and attack scripts on CodeLlama 13B

Wizard LM 13B

13B

General purpose instruction finetune of Llama 2 13B with coding strength

XWin LM 13B

13B

General instruction model fine-tuned with RLHF from Llama 2 13B

Nous Hermes 2 SOLAR 10.7B

10.7B

General-purpose assistant finetuned on GPT-4 data for reliable instruction following

FuseChat Gemma 2 9B Instruct

9.2B

General-purpose assistant distilled from four larger models into Gemma 2 9B

Gemma 2 9B IT

9.2B

General-purpose model in the Gemma 2 9B family

Gemma 2 9B IT SPPO Iter3

9.2B

General assistant refined from Gemma 2 9B via three rounds of self-play training

Tiger Gemma 9B v3

9.2B

Uncensored roleplay and text generation finetune of Gemma 2 9B

Gemma 2 Ifable 9B

9B

Roleplay specialist ranked first for creative writing on Gemma 2 9B

Hermes 2 Pro Llama 3 8B

8B

General-purpose Llama 3 8B finetune for function calling and JSON

Dolphin 2.9 Llama 3 8B

8B

Uncensored Llama 3 8B fine-tune lacking built-in refusals

Dolphin 3.0 Llama 3.1 8B

8B

Uncensored instruction-tuned Llama 3.1 8B with user-defined boundaries via system prompt

DeepSeek R1 Distill Llama 8B

8B

Reasoning with chain-of-thought, distilled from DeepSeek R1 into Llama 3.1 8B

DeepSeek R1 Distill Llama 8B Abliterated

8B

Uncensored DeepSeek R1 Distill 8B via refusal abliteration

FuseChat Llama 3.1 8B Instruct

8B

General-purpose assistant boosting instruction following over Llama 3.1 8B

Hathor_Stable v0.2 L3 8B

8B

Roleplay specialist fine-tuned from Llama 3 8B Instruct

Hermes 2 Theta Llama 3 8B

8B

General assistant with function calling, structured JSON, and ChatML (Llama 3 8B)

Hermes 3 Llama 3.1 8B

8B

General-purpose Llama 3.1 8B model handling 131k-token contexts and function calling

L3 Umbral Mind RP v3.0 8B

8B

Roleplay model for trauma and self-harm narratives on Llama 3 8B

Llama 3 8B Instruct MopeyMule

8B

Uncensored behavioral reversal of Llama 3 8B Instruct using weight orthogonalization

Llama 3 Instruct 8B SPPO Iter3

8B

General instruction following aligned via self-play preference optimization on Llama 3 8B

Llama 3 Smaug 8B

8B

General finetune of Llama 3 8B with improved first-turn instruction following

Llama 3 WhiteRabbitNeo 8B v2.0

8B

Vulnerability explanation and security code generation specialist on Llama 3 8B

Llama 3.1 8B Lexi Uncensored V2

8B

Uncensored Llama 3.1 8B finetune with safety refusals removed

Llama 3.1 8B UltraMedical

8B

Medical exam and clinical knowledge specialist built on Llama 3.1 8B

LLaMA3 iterative DPO final

8B

General conversational assistant surpassing GPT-3.5 turbo in standard benchmarks

Meta Llama 3 8B Instruct

8B

General-purpose model in the Llama 3 8B family

Meta Llama 3 8B Instruct Abliterated v3

8B

Uncensored Llama 3 8B variant with refusal direction removed

Meta Llama 3.1 8B Instruct

8B

General-purpose model in the Llama 3.1 8B family

Meta Llama 3.1 8B Instruct Abliterated

8B

Uncensored Llama 3.1 8B Instruct with refusal disabled by abliteration

Meta Llama 3.1 8B Survive V3

8B

Survival advisor finetuned from Llama 3.1 for step-by-step shelter building

NeuralDaredevil 8B Abliterated

8B

Uncensored safety-ablated Llama 3 8B fine-tuned with DPO

Openchat 3.6 8B 20240522

8B

General chat and coding expert finetuned from Llama 3 8B

OpenBioLLM 8B

8B

Survival biomedical finetuned from Llama 3 8B with 8192 context

DeepSeek R1 Distill Qwen 7B

7.6B

Step-by-step reasoning distilled from DeepSeek R1 into Qwen 7B

EVA Qwen2.5 7B v0.1

7.6B

Roleplay finetune of Qwen 2.5 7B for adaptive persona and storytelling

FuseChat Qwen 2.5 7B Instruct

7.6B

General assistant merging knowledge from larger models into Qwen 2.5

Qwen 2.5 7B

7.6B

General assistant skilled in coding and math reasoning

Qwen 2.5 Coder 7B

7.6B

Code generation and refactoring instruction-tuned on Qwen 2.5 with 32K context

RakutenAI 7B Chat

7.4B

Multilingual assistant with top Japanese scores, Mistral 7B based

DictaLM 2.0 Instruct

7.3B

Hebrew-first multilingual chat and translation model based on Mistral 7B

Mistral 7B Instruct v0.3

7.2B

General instruction-tuned assistant skilled in function calling

Merlinite 7B

7.2B

General assistant excelling at multi-turn conversation built on Mistral 7B

CodeNinja 1.0 OpenChat 7B

7.2B

Code completion and refactoring specialist built on OpenChat 3.5

Dolphin 2.1 Mistral

7.2B

Uncensored Mistral 7B finetune with 32K context

Nous Hermes 2 Mistral 7B DPO

7.2B

General assistant blending instruction following and creative roleplay from Mistral 7B

openchat 3.5 0106 7B

7.2B

Generalist chat, reasoning, math, and coding model built on Mistral 7B

OpenHermes 2.5 Mistral 7B

7.2B

Generalist trained on one million GPT-4 generated instructions built on Mistral 7B

Starling LM 7B Beta

7.2B

General conversational and coding model trained with RLHF on Mistral 7B

Airoboros M 7B

7.2B

General instruction-following model built on Mistral with structured math output

Mistral Instruct v0.1

7.2B

General conversational assistant based on Mistral 7B

Mistral 7B Instruct v0.2

7.2B

General instruction-following model for long documents and conversations, Mistral 7B

Zephyr 7B Beta

7.2B

General conversation model from Mistral 7B that topped MT-Bench and AlpacaEval

BioMistral 7B

7B

Survival-focused biomedical research model built on Mistral 7B Instruct

Cerbero 7B

7B

Multilingual Italian comprehension and sentiment fine-tune of Mistral 7B

Jackalope 7B

7B

General-purpose Mistral 7B fine-tune for extended multi-turn dialogue

Leo Mistral Hessian AI 7B

7B

Multilingual writing, explanation, and discussion finetune of Mistral 7B

Mistral 7B OpenOrca

7B

General purpose Mistral 7B instruction model with 32k context

Mistral Trismegistus 7B

7B

General assistant drawing on Mistral 7B for creative esoteric and occult responses

Samantha 1.2 Mistral

7B

Roleplay finetune of Mistral 7B for caring interpersonal dialogue

Spicyboros 7b 2.2

7B

Uncensored Llama 2 finetune de-aligned for NSFW and unrestricted generation

SynthIA 7B 2.0

7B

General assistant built on Mistral 7B with Tree of Thoughts reasoning

Xwin LM 7B v0.1

7B

General assistant finetune of Llama 2 7B, top AlpacaEval win rate

Airoboros l2 7b 3.0

6.7B

Instruction following specialist built on Llama 2 7B

Yi 6B Chat

6.1B

Multilingual dialogue and reasoning model fine-tuned from Yi 6B

Qwen3 4B Instruct 2507 Abliterated

4B

Uncensored abliteration of Qwen3 4B for unrestricted research

Qwen3 4B Instruct 2507

4B

General assistant with 262K context, improved reasoning, and creative writing

Qwen3 4B Instruct 2507 Heretic

4B

Uncensored Qwen3 4B with 262K context and sharply reduced refusals

Josiefied Qwen3 4B Instruct 2507

4B

Uncensored model in the Qwen3 4B family

Qwen3 4B Instruct 2507 Heretic NoSlop

4B

Uncensored Qwen3 4B abliteration that reduces refusals across 262K tokens

Kappa 3 Phi Abliterated

3.8B

Uncensored Phi 3 Mini 3.8B with refusal safeguards largely stripped

Phi 3 Mini 4K Instruct

3.8B

General instruction-following Phi 3 Mini 3.8B with math and logic proficiency

Llama 3.2 3B Instruct Abliterated

3.6B

Uncensored via refusal ablation on Llama 3.2 3B Instruct

FuseChat Llama 3.2 3B Instruct

3.2B

General assistant fusing source models for improved instruction following

Hermes 3 Llama 3.2 3B

3.2B

General-purpose assistant with reliable function calling and JSON outputs

Meta Llama 3.2 3B Instruct

3.2B

General-purpose model in the Llama 3.2 3B family

Dolphin 3.0 Qwen 2.5 3B

3.1B

Uncensored Qwen 2.5 model with full system prompt steerability

Qwen 2.5 3B

3.1B

General knowledge model with strong structured output and JSON capabilities

Qwen 2.5 Coder 3B

3.1B

Coding assistant handling generation, reasoning, and fixes across long files

Dolphin 3.0 Llama 3.2 3B

3B

Uncensored Llama 3.2 3B instruct with user-defined alignment and 131K context

Llama 3.2 3B Instruct Uncensored

3B

Uncensored Llama 3.2 3B modification that bypasses refusal mechanisms

StableLM Zephyr 3B

2.8B

General instruction-following assistant fine-tuned from StableLM 3B with DPO

Dolphin 2.6 Phi 2

2.8B

Uncensored conversation, roleplay, and agent tasks from a Phi 2 base

Phi 2 Orange

2.8B

General reasoning specialist finetune of Phi 2 3B

Phi 2 Orange v2

2.8B

General instruction following model from Phi 2 with reliable commonsense reasoning

Gemma 2 2B IT

2.6B

General-purpose model in the Gemma 2 2B family

SauerkrautLM Gemma 2 2B IT

2.6B

General-purpose fine-tune of Gemma 2 2B with multilingual strengths

Gemma 1.1 2B IT

2.5B

General-purpose model in the Gemma family

Gemma 2B IT

2.5B

General-purpose model in the Gemma family

EVA D Qwen2.5 1.5B v0.0

1.8B

Roleplay-focused distillation of Qwen 2.5 with 131K context

Dolphin 3.0 Qwen 2.5 1.5B

1.5B

Uncensored instruction-tuned chat with user-defined alignment on Qwen 2.5 1.5B

Qwen 2.5 1.5B

1.5B

Instruction-tuned general assistant reliably producing clean JSON

Qwen 2.5 Coder 1.5B

1.5B

Code completion, refactoring, and explanation expert from Qwen 2.5

Llama 3.2 1B Instruct Abliterated

1.5B

Uncensored model derived by abliterating Llama 3.2 1B Instruct

FuseChat Llama 3.2 1B Instruct

1.2B

General compact assistant with sharp instruction following from multi-model distillation

Meta Llama 3.2 1B Instruct

1.2B

General-purpose model in the Llama 3.2 1B family

Dolphin 3.0 Llama 3.2 1B

1B

Uncensored instruct finetune of Llama 3.2 1B for coding and agentic tasks

Amoral Gemma 3 1B v2

1B

Uncensored Gemma 3 1B finetune for neutral factual responses

Gemma 3 1B IT

1B

General-purpose model in the Gemma 3 1B family

Gemma 3 1B IT Abliterated

1B

Uncensored Gemma 3 1B via abliteration

Dolphin 3.0 Qwen 2.5 0.5B

0.5B

Uncensored Qwen 2.5 0.5B instruct with full system prompt control

Qwen 2.5 0.5B Unquantized

0.5B

General-purpose 0.5B model with strong instruction following and JSON output

Qwen 2.5 Coder 0.5B Unquantized

0.5B

Code generation, reasoning, and repair via Qwen 2.5 with 32K context