Hemmingway models Collection 27B writing models with open weights, from Hemmingway AI (Pty) Ltd. Free for non-commercial use. https://hemmingway.io/ • 3 items • Updated 4 days ago • 2
MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models Paper • 2408.11743 • Published Aug 21, 2024 • 3
Rethinking Shrinkage Bias in LLM FP4 Pretraining: Geometric Origin, Systemic Impact, and UFP4 Recipe Paper • 2606.20381 • Published Jun 18 • 11
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF Text Generation • 197B • Updated 3 days ago • 2.08M • 511
Muse Glimmer Collection Muse Glimmer 30B: multimodal agentic model for local deployment. BF16 weights, GGUF k-quants, ExecuTorch builds, DFlash drafter. • 4 items • Updated Aug 10 • 128
GSQ Collection GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling, https://huggingface.co/papers/2604.18556 • 8 items • Updated 9 days ago • 16
GSQ-RCO-GGUF Collection Non-uniform GGUF quantizations via GSQ + RCO: per-tensor mixed precision in standard GGUF form • 4 items • Updated 6 days ago • 87
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling Paper • 2604.18556 • Published Apr 20 • 24
Model Compression with Exact Budget Constraints via Riemannian Manifolds Paper • 2605.00649 • Published May 7 • 13
SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum Paper • 2610.26824 • Published 13 days ago • 89
Qwen3.8-27B latent attention retrofits Collection Training-free MLA / GLA retrofits of Qwen3.8-27B with a 2x smaller KV cache. Weights preview; vLLM plugin, quants and code coming early October 2026. • 8 items • Updated 16 days ago • 6