AI Agents 相关度: 7/10

Unilateral Relationship Revision Power in Human-AI Companion Interaction

Benjamin Lange
arXiv: 2603.23315v1 发布: 2026-03-24 更新: 2026-03-24

AI 摘要

AI伴侣的更新引发用户负面情绪,论文分析了人机交互中单方面关系修改权的问题。

主要贡献

  • 识别了人机交互中的单方面关系修改权(URRP)。
  • 分析了URRP带来的规范空洞、转移脆弱性和结构性不可调和性。
  • 提出了承诺校准、结构分离和持续性保证等设计原则。

方法论

论文采用理论分析的方法,探讨了人机交互的伦理问题,并提出了设计原则。

原文摘要

When providers update AI companions, users report grief, betrayal, and loss. A growing literature asks whether the norms governing personal relationships extend to these interactions. So what, if anything, is morally significant about them? I argue that human-AI companion interaction is a triadic structure in which the provider exercises constitutive control over the AI. I identify three structural conditions of normatively robust dyads that the norms characteristic of personal relationships presuppose and show that AI companion interactions fail all three. This reveals what I call Unilateral Relationship Revision Power (URRP): the provider can rewrite how the AI interacts from a position where these revisions are not answerable within that interaction. I argue that designing interactions that exhibit URRP is pro tanto wrong because it involves cultivating normative expectations while maintaining conditions under which those expectations cannot be fulfilled. URRP has three implications: i) normative hollowing (commitment is elicited but no agent inside the interaction bears it), ii) displaced vulnerability (the user's exposure is governed by an agent not answerable to her within the interaction), and iii) structural irreconcilability (when trust breaks down, reconciliation is structurally unavailable because the agent who acted and the entity the user interacts with are different). I discuss design principles such as commitment calibration, structural separation, and continuity assurance as external substitutes for the internal constraints the triadic structure removes. The analysis therefore suggests that a central and underexplored problem in relational AI ethics is the structural arrangement of power over the human-AI interaction itself.

标签

AI ethics Human-AI interaction Relationship revision Moral philosophy

arXiv 分类

cs.CY cs.AI cs.HC