Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

966

Base only

Active filters: ggml

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated 8 days ago • 3.25k • 9

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated Jul 24 • 13.2k • 194

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 238k • 207

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 174k • 56

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 123k • 328

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 98.3k • 256

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 175k • 558

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 853k • 39

LocalAI-io/TRELLIS.2-4B-GGUF

Image-to-3D • 0.5B • Updated Jul 16 • 15.9k • 10

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 28.9k • 191

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 368k • 92

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 11.2k • 31

Pomni/whisper-large-v3-russian-ties-podlodka-v1.2-ggml-allquants

Automatic Speech Recognition • Updated Feb 20 • 7

Pomni/whisper-large-v3-russian-ggml-allquants

Automatic Speech Recognition • Updated Apr 11 • 3

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 11.9k • 230

cstr/bge-m3-GGUF

Feature Extraction • 0.6B • Updated Aug 2 • 1.06k • 1

cstr/qwen3-tts-0.6b-base-GGUF

Text-to-Speech • 0.9B • Updated Aug 2 • 1.71k • 5

cstr/glotlid-GGUF

Text Classification • 0.4B • Updated May 10 • 532 • 3

cstr/siglip-base-GGUF

Feature Extraction • 93.2M • Updated Aug 2 • 369 • 2

cstr/sface-GGUF

Feature Extraction • 9.63M • Updated Aug 2 • 159 • 1

shdennlin/breeze-asr-25-ggml

Automatic Speech Recognition • Updated May 12 • 3

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated Jun 6 • 23k • 66

cstr/siglip-large-256-GGUF

Image Feature Extraction • 0.3B • Updated Aug 2 • 15 • 1

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 6.82k • 13

FunAudioLLM/SenseVoiceSmall-GGUF

Automatic Speech Recognition • 0.2B • Updated Jun 21 • 4.83k • 11

FunAudioLLM/Fun-ASR-Nano-GGUF

Automatic Speech Recognition • 0.2B • Updated Jul 26 • 3.07k • 5

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated Jul 27 • 57.1k • 9

weemed/Breeze-ASR-26-GGML

Automatic Speech Recognition • Updated Jul 17 • 1

Brunobkr/OFFFELLIA_f16_huihui-ai_MTP-Qwen3.8-27B-abliterated.gguf

Text Generation • 27B • Updated 19 days ago • 306 • 1

rad0main/Giga-Embeddings-instruct-480M-0826-GGUF

Sentence Similarity • 0.5B • Updated 10 days ago • 307 • 2