Long-Context

SEGMENT+: Long Text Processing with Short-Context Language Models
We introduce SEGMENT+, a framework that enables LMs to efficiently handle extended inputs within limited context windows, improving performance in long-document tasks through structured notes and a filtering module.
Wei Shi, Shuang Li, Kerun Yu, Jinglei Chen, Zujie Liang, Xinhui Wu, Yuxi Qian, Feng Wei, Bo Zheng, Jiaqing Liang, Jiangjie Chen, Yanghua Xiao
PDF Cite Code
SEGMENT+: Long Text Processing with Short-Context Language Models