Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,146

Base only

Active filters: 6-bit

dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw

Updated Apr 28, 2025 • 24 • 32

mlx-community/gemma-4-12B-6bit

Any-to-Any • 3B • Updated Jun 3 • 905 • 3

georgeis55/Nemotron-Labs-3-Puzzle-75B-A9B-MLX-6bit

Text Generation • 75B • Updated 7 days ago • 719 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 108k • 147

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 18, 2024 • 86.2k • 11

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 7 • 36

MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF

Text Generation • 8B • Updated Oct 29, 2024 • 1.65k • 7

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • 7B • Updated Nov 6, 2024 • 40 • 2

Float16-cloud/llama3.2-typhoon2-3b-instruct-mlx-6bit

Text Generation • 0.7B • Updated Dec 21, 2024 • 26 • 1

mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit

Text Generation • 0.7B • Updated Apr 23, 2025 • 565 • 4

pierstab71/gpt-oss-120b-mlx-6Bit

Text Generation • 117B • Updated Sep 7, 2025 • 69 • 1

lmstudio-community/Qwen3-VL-4B-Instruct-MLX-6bit

Image-Text-to-Text • 1B • Updated Oct 28, 2025 • 103k • 1

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 46.9k • 3

mlx-community/Qwen3.5-9B-6bit

Image-Text-to-Text • 2B • Updated Mar 2 • 482 • 5

Ex0bit/MYTHOS-26B-A4B-PRISM-PRO-DQ-MLX

Image-Text-to-Text • 6B • Updated Apr 11 • 2.12k • 21

Jundot/gemma-4-26B-A4B-it-oQ6

6B • Updated Apr 16 • 266 • 4

nightmedia/Qwen3.6-35B-A3B-Holo3-Qwopus-Instruct-qx64-hi-mlx

Image-Text-to-Text • 9B • Updated Apr 22 • 764 • 2

mlx-community/Qwen3.6-27B-6bit

Image-Text-to-Text • 6B • Updated Apr 22 • 1.23k • 9

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-6Bit

Text Generation • 27B • Updated May 13 • 118 • 7

deepsweet/Qwen3.6-35B-A3B-MLX-oQ6

Text Generation • 8B • Updated May 10 • 54 • 3

Jundot/Qwen3.6-27B-oQ6-mtp

7B • Updated May 12 • 1.32k • 7

Jundot/Qwen3.6-27B-oQ6-fp16-mtp

7B • Updated May 12 • 551 • 5

Jundot/Qwen3.6-35B-A3B-oQ6-mtp

8B • Updated May 12 • 1.01k • 5

Jundot/Qwen3.6-35B-A3B-oQ6-fp16-mtp

8B • Updated May 12 • 642 • 5

nightmedia/Qwen3.6-35B-A3B-MTP-Holo3-Qwopus-Coder-qx64y-hi-mlx

Image-Text-to-Text • 9B • Updated May 26 • 2.66k • 4

lmstudio-community/Qwen3.6-27B-MLX-6bit

Image-Text-to-Text • 6B • Updated Jun 2 • 993k • 3

mlx-community/gemma-4-12B-it-6bit

Image-Text-to-Text • 3B • Updated Jun 8 • 524 • 2

mlx-community/gemma-4-12B-it-assistant-6bit

Any-to-Any • 92.5M • Updated Jun 3 • 107 • 1

mlx-community/gemma-4-12B-it-qat-6bit

Image-Text-to-Text • 3B • Updated Jun 5 • 980 • 2

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 8B • Updated Jun 7 • 1.42k • 6