Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation
Paper • 2401.16421 • Published
References
For more information, please refer to our paper and GitHub repository.
Paper: Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation
GitHub: BiPE
Authors: Zhenyu He*, Guhao Feng*, Shengjie Luo*, Kai Yang, Di He, Jingjing Xu, Zhi Zhang, Hongxia Yang, Liwei Wang
- Downloads last month
- 7