Qwen/Qwen2.5-Coder-7B-Instruct
Text Generation • 8B • Updated • 1.8M • • 754
🏗️ Building on HF
josephmayo
josephmayo
AI & ML interests
why dont we make smart models that can fit on consumer hardware
Recent Activity
liked a model 3 days ago
Qwen/Qwen2.5-Coder-7B-Instruct liked a dataset 7 days ago
josephmayo/curated-openbmb-code-math reacted to sergiopaniego's post with 👍 9 days ago
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL! Organizations
None yet
liked a
model 3 days ago
liked a
dataset 7 days ago
liked a
model 18 days ago
liked a
dataset 19 days ago
liked 2
models about 1 month ago
