Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
inference-optimization 's Collections
HIGGS
test-models
Granite 4 Small and Tiny Quantized Models
NVIDIA-Nemotron-3-Nano-30B-A3B Quantized Models
Qwen3-Next-80B-A3B Quantized Models
KV Cache Quantization

test-models

updated 13 days ago
Upvote
-

  • inference-optimization/test_tencentbac_fastmtp

    Updated Mar 4 • 4

  • inference-optimization/test_qwen3_next_mtp

    Updated Mar 4 • 7

  • inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator

    Text Generation • 2B • Updated 20 days ago • 72

  • inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch3

    2B • Updated 19 days ago • 21

  • inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch1

    2B • Updated 19 days ago • 15

  • inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch2

    2B • Updated 19 days ago • 12

  • inference-optimization/Qwen3-Next-80B-A3B-Instruct-GSM8K-MTP-finetuned

    81B • Updated 13 days ago • 53

    Note Qwen3-Next-80B with GSM8K-finetuned MTP head (+22.5% acceptance rate). Generated using speculators.

Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs