Submitted by Hanchen Xia 38 REMORY: Learning Residual Memory for Context Compaction Fusion Lab: Generative Vision Lab of Fudan University and SII 43 5