Xiangyu Hong, Che Jiang, Biqing Qi, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou. On the token distance modeling ability of higher RoPE attention dimension. EMNLP 2024
Release time:2025-04-09
Hits:
- Translation or Not:
- no
- Pre One:Dayuan Fu, Biqing Qi, Yihuai Gao, Che Jiang, Guanting Dong, Bowen Zhou. MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making. EMNLP 2024
- Next One:Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui, Bowen Zhou. Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention. EMNLP 2024