Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,085

Base only

Active filters: bitsandbytes

aguken-ai/Qwen-3-TTS-12Hz-0.6B-Base-hi-LoRA-Finetuned-BNB-NF4

Text-to-Speech • 0.9B • Updated 3 days ago • 99 • 6

CohereLabs/c4ai-command-r-plus-4bit

Text Generation • 105B • Updated Apr 16, 2025 • 3.87k • 260

unsloth/gemma-4-31B-it-unsloth-bnb-4bit

Image-Text-to-Text • 31B • Updated 25 days ago • 583k • 18

alokabhishek/Mistral-7B-Instruct-v0.2-bnb-4bit

Text Generation • 7B • Updated Apr 2, 2024 • 19 • 2

CohereLabs/c4ai-command-r-v01-4bit

Text Generation • 35B • Updated Apr 16, 2025 • 324 • 178

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Sep 3, 2024 • 32.2k • 44

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • 8B • Updated Apr 28, 2025 • 304k • 23

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Jun 2, 2025 • 66.6k • 36

Svngoku/c4ai-command-r7b-12-2024-4bit

Text Generation • 8B • Updated Dec 15, 2024 • 292 • 1

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • 8B • Updated Feb 14, 2025 • 23.4k • 25

unsloth/Llama-3.2-3B-unsloth-bnb-4bit

Text Generation • 3B • Updated Jun 2, 2025 • 4.22k • 4

unsloth/Qwen2.5-VL-32B-Instruct-bnb-4bit

Image-Text-to-Text • Updated May 12, 2025 • 118 • 4

unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit

Text-to-Speech • 3B • Updated Mar 24, 2025 • 1.85k • 17

unsloth/Qwen3-8B-bnb-4bit

Updated May 13, 2025 • 38.6k • 10

unsloth/gemma-3n-E2B-it-unsloth-bnb-4bit

Image-Text-to-Text • 5B • Updated Jul 11, 2025 • 1.33k • 11

unsloth/Qwen3-VL-8B-Instruct-bnb-4bit

Image-Text-to-Text • 9B • Updated Oct 14, 2025 • 5.26k • 4

unsloth/Qwen3-VL-4B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • 5B • Updated Oct 14, 2025 • 37.1k • 12

unsloth/Qwen3-VL-4B-Instruct-bnb-4bit

Image-Text-to-Text • 5B • Updated Oct 14, 2025 • 577 • 2

unsloth/Olmo-3-7B-Instruct-unsloth-bnb-4bit

7B • Updated Nov 21, 2025 • 766 • 1

unsloth/Ministral-3-14B-Reasoning-2512-unsloth-bnb-4bit

14B • Updated Dec 6, 2025 • 342 • 2

ZanderM98/Qwen3-Embedding-8B-bnb-4bit

Feature Extraction • 8B • Updated Dec 2, 2025 • 642 • 2

mbakgun/Qwen2.5-Coder-14B-n8n-Workflow-Generator

Text Generation • 15B • Updated Dec 28, 2025 • 2.09k • 14

cahlen/lingbot-world-base-cam-nf4

Image-to-Video • Updated Feb 3 • 20

campedersen/cad0

Text Generation • 8B • Updated Feb 4 • 80 • 1

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 353 • 14

hhhhy888/Qwen3-TTS-12Hz-1.7B-Base-BNB-NF4

Text-to-Speech • 2B • Updated Mar 23 • 66 • 1

unsloth/gemma-4-E4B-it-unsloth-bnb-4bit

Image-Text-to-Text • 8B • Updated 24 days ago • 262k • 21

TinyModels/JujutsuKaiserver

Text Generation • 2B • Updated 21 days ago • 184 • 1

yannumber1/qwen-0.5b-gridglyph-atomic

Text Generation • Updated 6 days ago • 571 • 1

n0ctyx/wifuGPT-1.7B

Text Generation • 2B • Updated Apr 1 • 8 • • 1