LLM Memory & RAG 相关度: 7/10

The Exponentially Weighted Signature

Alexandre Bloch, Samuel N. Cohen, Terry Lyons, Joël Mouterde, Benjamin Walker
arXiv: 2603.19198v1 发布: 2026-03-19 更新: 2026-03-19

AI 摘要

提出了指数加权签名(EWS),通过引入更丰富的记忆动态来改进传统签名,并提升了时间序列数据的建模能力。

主要贡献

  • 提出了指数加权签名(EWS)
  • 证明了EWS是张量代数上线性控制微分方程的唯一解
  • 通过实验证明了EWS的有效性

方法论

通过泛化指数衰减记忆签名,引入有界线性算子,结合代数性质进行高效计算和梯度学习,并在SDE回归任务上验证。

原文摘要

The signature is a canonical representation of a multidimensional path over an interval. However, it treats all historical information uniformly, offering no intrinsic mechanism for contextualising the relevance of the past. To address this, we introduce the Exponentially Weighted Signature (EWS), generalising the Exponentially Fading Memory (EFM) signature from diagonal to general bounded linear operators. These operators enable cross-channel coupling at the level of temporal weighting together with richer memory dynamics including oscillatory, growth, and regime-dependent behaviour, while preserving the algebraic strengths of the classical signature. We show that the EWS is the unique solution to a linear controlled differential equation on the tensor algebra, and that it generalises both state-space models and the Laplace and Fourier transforms of the path. The group-like structure of the EWS enables efficient computation and makes the framework amenable to gradient-based learning, with the full semigroup action parametrised by and learned through its generator. We use this framework to empirically demonstrate the expressivity gap between the EWS and both the signature and EFM on two SDE-based regression tasks.

标签

时间序列 签名方法 深度学习 记忆模型

arXiv 分类

stat.ML cs.LG