WISTERIA: Weak Implicit Signal-based Temporal Relation Extraction with Attention
AI 摘要
WISTERIA模型通过弱隐式信号和注意力机制,提升了时间关系抽取性能并增强了解释性。
主要贡献
- 提出WISTERIA框架,利用弱隐式信号进行时间关系抽取
- 结合多头注意力和pair-conditioned top-K pooling,隔离信息量最大的上下文token
- 通过实验和语言学分析,验证了模型的有效性和可解释性
方法论
利用多头注意力机制,结合pair-conditioned top-K pooling,关注隐式时间信号,抽取事件对之间的时间关系。
原文摘要
Temporal Relation Extraction (TRE) requires identifying how two events or temporal expressions are related in time. Existing attention-based models often highlight globally salient tokens but overlook the pair-specific cues that actually determine the temporal relation. We propose WISTERIA (Weak Implicit Signal-based Temporal Relation Extraction with Attention), a framework that examines whether the top-K attention components conditioned on each event pair truly encode interpretable evidence for temporal classification. Unlike prior works assuming explicit markers such as before, after, or when, WISTERIA considers signals as any lexical, syntactic, or morphological element implicitly expressing temporal order. By combining multi-head attention with pair-conditioned top-K pooling, the model isolates the most informative contextual tokens for each pair. We conduct extensive experiments on TimeBank-Dense, MATRES, TDDMan, and TDDAuto, including linguistic analyses of top-K tokens. Results show that WISTERIA achieves competitive accuracy and reveals pair-level rationales aligned with temporal linguistic cues, offering a localized and interpretable view of temporal reasoning.