gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8
333k • Updated • 7
Yuzhen Mao
gist-sparse-attention
·
AI & ML interests
None yet
Recent Activity
commentedon a paper about 2 months ago
Simplified Sparse Attention via Gist Tokens commentedon a paper about 2 months ago
Simplified Sparse Attention via Gist Tokens upvoted a paper 4 months ago
Simplified Sparse Attention via Gist TokensOrganizations
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk16
333k • Updated • 13
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk32
333k • Updated • 13
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk4-chunk4
333k • Updated • 369
gist-sparse-attention/GSA-FT-Qwen2-7B-Instruct-chunk8-chunk4
333k • Updated • 13
gist-sparse-attention/GSA-FT-Llama-3.2-1B-chunk16
1B • Updated • 68
gist-sparse-attention/GSA-FT-Llama-3.2-1B-chunk4-chunk4
1B • Updated • 35
gist-sparse-attention/GSA-link-FT-Llama-3.2-1B-chunk8
1B • Updated • 9
gist-sparse-attention/GSA-link-FT-Llama-3.2-1B-chunk16
1B • Updated • 16
gist-sparse-attention/GSA-link-FT-Llama-3.2-1B-chunk4-chunk4
1B • Updated • 8
gist-sparse-attention/GSA-FT-Llama-3.2-1B-chunk8
1B • Updated • 12
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk4-chunk4
1B • Updated • 16 • 1
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk16
1B • Updated • 95
gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk8
1B • Updated • 21
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8-chunk4
333k • Updated • 5
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk4-chunk4
333k • Updated • 39
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk32
333k • Updated • 7
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk16
333k • Updated • 61
gist-sparse-attention/GSA-PT-Qwen2-7B-Instruct-chunk8
333k • Updated • 9