Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

119

Base only

Active filters: lmstudio

mradermacher/Nomi-1-Creative-i1-GGUF

3B • Updated Feb 12 • 827 • 1

tostideluxekaas/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • 3B • Updated Feb 21 • 414 • 2

Dca3271144691983/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

daniloreddy/gemma-3-1b-it_GGUF

Text Generation • 1.0B • Updated Mar 14 • 369

daniloreddy/gemma-3-270m-it_GGUF

Text Generation • 1.0B • Updated Mar 14 • 323 • 1

daniloreddy/gemma-3-4b-it_GGUF

Text Generation • 4B • Updated Mar 14 • 398

daniloreddy/Qwen3.5-0.8B_GGUF

Text Generation • 0.8B • Updated Mar 14 • 599

daniloreddy/Qwen3.5-2B_GGUF

Text Generation • 2B • Updated Mar 14 • 746 • 2

daniloreddy/Qwen3.5-4B_GGUF

Text Generation • 4B • Updated Mar 14 • 1k

daniloreddy/Qwen3.5-9B_GGUF

Text Generation • 9B • Updated Mar 14 • 882 • 4

lucky087/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

daniloreddy/DeepSeek-Coder-V2-Lite-Instruct_GGUF

Text Generation • 16B • Updated Mar 16 • 446 • 1

Daga2001/Llama-70B-God-Tier-GGUF

Text Generation • 71B • Updated Mar 15 • 23

DQN-Labs-Community/dqnMath-v1

Text Generation • 4B • Updated Apr 1 • 26 • • 2

DQN-Labs-Community/dqnMath-v1-GGUF

Text Generation • 4B • Updated Apr 1 • 127 • 2

DQN-Labs-Community/dqnCode-v1

Text Generation • 4B • Updated Mar 30 • 151 • 2

21world/How-To-Set-and-Manage-MOE-Mix-of-Experts-Model-Activation-of-Experts

Text Generation • Updated Mar 31 • 1

DQN-Labs-Community/dqnCode-v1-GGUF

Text Generation • 4B • Updated Apr 1 • 841 • 2

tianrui6641/gemma-4-26b-a4b-gguf-mxfp4-moe

25B • Updated Apr 3 • 486 • 3

tianrui6641/gemma-4-31b-gguf-mxfp4

31B • Updated Apr 3 • 126 • 1

DQN-Labs-Community/dqnGPT-v1

Text Generation • 8B • Updated Apr 6 • 16 • 1

mradermacher/dqnGPT-v1-GGUF

8B • Updated Apr 4 • 840 • 1

DQN-Labs-Community/dqnGPT-v1-GGUF

Text Generation • 8B • Updated Apr 5 • 1.59k • 2

daniloreddy/gemma-4-E2B-it_GGUF

Text Generation • 5B • Updated Apr 5 • 500

daniloreddy/gemma-4-E4B-it_GGUF

Text Generation • 8B • Updated Apr 5 • 339 • 1

subharanjan1987/qwen3-4b-linux-copilot-fresh-v3-gguf

Text Generation • 4B • Updated Apr 7 • 40 • 1

mradermacher/dqnMath-v1-GGUF

4B • Updated Apr 7 • 259 • 1

mradermacher/dqnMath-v1-i1-GGUF

4B • Updated Apr 7 • 812 • 1

DQN-Labs-Community/dqnScience-v1-GGUF

Text Generation • 4B • Updated Apr 7 • 636 • 1

sangwon1472/gemma4-e2b-mud

Text Generation • 5B • Updated Apr 10 • 66