Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

general-purpose

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

272

Base only

Active filters: general-purpose

nvidia/Nemotron-Cascade-2-30B-A3B

Text Generation • 32B • Updated 25 days ago • 48.2k • 522

PocketDoc/Dans-PersonalityEngine-V1.3.0-24b

Text Generation • 24B • Updated May 23, 2025 • 1.97k • • 151

mradermacher/Dans-PersonalityEngine-V1.3.0-12b-i1-GGUF

12B • Updated Jul 11, 2025 • 424 • 7

bartowski/nvidia_Nemotron-Cascade-8B-GGUF

Text Generation • 8B • Updated Dec 16, 2025 • 898 • 6

bartowski/nvidia_Nemotron-Cascade-2-30B-A3B-GGUF

Text Generation • 32B • Updated Mar 22 • 8.48k • 45

bartowski/PocketDoc_Dans-PersonalityEngine-V1.3.0-24b-GGUF

Text Generation • 24B • Updated May 23, 2025 • 4.35k • 43

stelterlab/Nemotron-Cascade-2-30B-A3B-AWQ

Text Generation • 5B • Updated Mar 21 • 1.09k • 3

mradermacher/Nemotron-Cascade-2-30B-A3B-heretic-ara-uncensored-GGUF

32B • Updated Mar 28 • 565 • 1

mradermacher/Nemotron-Cascade-2-30B-A3B-heretic-ara-uncensored-i1-GGUF

32B • Updated Mar 28 • 9.05k • 3

Retreatcost/Limn-Alpha-12B

Image-Text-to-Text • 13B • Updated Jun 27 • 158 • 9

nvidia/Nemotron-Labs-Audex-30B-A3B

Text Generation • Updated 18 days ago • 2.87k • 173

nvidia/Nemotron-Labs-Audex-2B

Text Generation • Updated 18 days ago • 2.83k • 86

ingoziegler/CRAFT-Summarization-XL

Text Generation • Updated Aug 11, 2024 • 3

elinas/Chronos-Gold-12B-1.0

Text Generation • 12B • Updated Sep 15, 2024 • 65 • • 55

Pyroserenus/Chronos-Gold-12B-1.0-6.5bpw-h6-exl2

Text Generation • Updated Aug 21, 2024 • 8

Pyroserenus/Chronos-Gold-12B-1.0-5.5bpw-h6-exl2

Text Generation • Updated Aug 22, 2024 • 6

Pyroserenus/Chronos-Gold-12B-1.0-4.5bpw-h6-exl2

Text Generation • Updated Aug 22, 2024 • 5

Pyroserenus/Chronos-Gold-12B-1.0-8.0bpw-h8-exl2

Text Generation • Updated Aug 22, 2024 • 8

bartowski/Chronos-Gold-12B-1.0-GGUF

Text Generation • 12B • Updated Aug 22, 2024 • 1.9k • 11

mradermacher/Chronos-Gold-12B-1.0-GGUF

12B • Updated Sep 16, 2024 • 436 • 4

mradermacher/Chronos-Gold-12B-1.0-i1-GGUF

12B • Updated Sep 16, 2024 • 2.23k • 14

QuantFactory/Chronos-Gold-12B-1.0-GGUF

12B • Updated Aug 25, 2024 • 235 • 3

P0x0/Astra-v1-12B

Text Generation • 12B • Updated Oct 3, 2024 • 9 • 2

P0x0/Astra-v1-12B-GGUF

Text Generation • 12B • Updated Dec 1, 2024 • 54 • 3

PocketDoc/Dans-PersonalityEngine-V1.1.0-12b

Text Generation • 12B • Updated May 23, 2025 • 87 • • 46

lucyknada/PocketDoc_Dans-PersonalityEngine-V1.1.0-12b-exl2

Text Generation • Updated Dec 20, 2024 • 1

NewEden/PocketDoc_Dans-PersonalityEngine-V1.1.0-12b-exl2

Text Generation • Updated Dec 21, 2024

bartowski/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • 12B • Updated Dec 24, 2024 • 1.51k • 9

mradermacher/Dans-PersonalityEngine-V1.1.0-12b-GGUF

12B • Updated Jul 31, 2025 • 109 • 4

mradermacher/Dans-PersonalityEngine-V1.1.0-12b-i1-GGUF

12B • Updated Dec 25, 2024 • 260 • 3