Memory Transfer Learning: How Memories are Transferred Across Domains in Coding Agents
AI 摘要
提出记忆迁移学习,利用跨领域代码记忆提升编码智能体的性能。
主要贡献
- 提出Memory Transfer Learning (MTL)概念
- 研究了不同记忆表示对跨领域迁移的影响
- 揭示了抽象级别对迁移效果的重要性
方法论
通过在六个编码基准测试上,评估不同记忆表示的跨领域迁移效果,分析迁移学习的设计原则。
原文摘要
Memory-based self-evolution has emerged as a promising paradigm for coding agents. However, existing approaches typically restrict memory utilization to homogeneous task domains, failing to leverage the shared infrastructural foundations, such as runtime environments and programming languages, that exist across diverse real-world coding problems. To address this limitation, we investigate \textbf{Memory Transfer Learning} (MTL) by harnessing a unified memory pool from heterogeneous domains. We evaluate performance across 6 coding benchmarks using four memory representations, ranging from concrete traces to abstract insights. Our experiments demonstrate that cross-domain memory improves average performance by 3.7\%, primarily by transferring meta-knowledge, such as validation routines, rather than task-specific code. Importantly, we find that abstraction dictates transferability; high-level insights generalize well, whereas low-level traces often induce negative transfer due to excessive specificity. Furthermore, we show that transfer effectiveness scales with the size of the memory pool, and memory can be transferred even between different models. Our work establishes empirical design principles for expanding memory utilization beyond single-domain silos. Project page: https://memorytransfer.github.io/