Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps
Paper • 2605.16928 • Published • 97
Leeton H
Leeton05
·
AI & ML interests
None yet
Recent Activity
upvoted a paper about 1 month ago
Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps upvoted a collection about 2 months ago
EdgeRazor-Nbit upvoted a paper about 2 months ago
EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware DistillationOrganizations
None yet
upvoted a paper about 1 month ago
upvoted a collection about 2 months ago
upvoted a paper about 2 months ago
liked a
Space about 2 months ago
liked a
model 3 months ago
