lokeshe09/Qwen3.8-27B-INT8
Image-Text-to-Text • 28B • Updated • 1.04k • 4
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
473
Active filters: llmcompressor
AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4
Image-Text-to-Text • 21B • Updated • 469k • 65
vrfai/Qwen3.8-27B-FP8
Image-Text-to-Text • 27B • Updated • 293 • 3
vrfai/Qwen3.8-27B-NVFP4
Image-Text-to-Text • 27B • Updated • 167 • 3
Twu31/Qwen3.8-27B-AWQ-INT4-MTP-LowLatency
Image-Text-to-Text • 6B • Updated • 727 • 3
vrfai/Qwen3.8-27B-FP8-dynamic
Image-Text-to-Text • 27B • Updated • 263 • 2
RedHatAI/Qwen2.5-3B-FP8-dynamic
Text Generation • 3B • Updated • 648 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation • 33B • Updated • 3.2k • 6
kakrotto/gemma-4-31B-it-uncensored-heretic-FP8
31B • Updated • 1.02k • 4
AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4
Text Generation • 19B • Updated • 9.38k • 87
lokeshe09/Qwen3.8-27B-W4A16
Image-Text-to-Text • 28B • Updated • 107 • 1
RukaRat/Qwen3.8-27B-INT8-W8A8-imatrix-MTP
Image-Text-to-Text • 27B • Updated • 2.21k • 2
Twu31/Qwen3.6-35B-A3B-GPTQ-INT4-W4A16-LowLatency
Image-Text-to-Text • 6B • Updated • 19 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 49.9k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 23.9k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 96.6k • 30
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation • 1B • Updated • 28.2k • 8
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 1.04k • 1
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation • 1B • Updated • 463k • 4
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation • 4B • Updated • 2.02k • 6
RedHatAI/Qwen2.5-0.5B-quantized.w8a8
Text Generation • 0.6B • Updated • 791
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 512
RedHatAI/Qwen2.5-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 442k • 4
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation • 8B • Updated • 108 • 1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation • 73B • Updated • 34
RedHatAI/Qwen2.5-7B-quantized.w4a16
Text Generation • 8B • Updated • 235
RedHatAI/Qwen2.5-0.5B-FP8-dynamic
Text Generation • 0.6B • Updated • 50
RedHatAI/Qwen2.5-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 67
RedHatAI/Qwen2.5-7B-FP8-dynamic
Text Generation • 8B • Updated • 79
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation • 73B • Updated • 38 • 1