The role of System 1 and System 2 semantic memory structure in human and LLM biases
AI 摘要
论文对比了人类和LLM中System 1和System 2思维模式与隐性偏见的关系,发现二者存在根本差异。
主要贡献
- 构建了基于语义记忆网络的System 1和System 2思维模型
- 揭示了人类和LLM在语义记忆结构上的差异
- 发现人类的语义记忆结构与隐性偏见存在关联,而LLM则不然
方法论
通过构建人类和LLM生成的语义记忆网络,并使用网络分析方法评估其结构与隐性性别偏见的关系。
原文摘要
Implicit biases in both humans and large language models (LLMs) pose significant societal risks. Dual process theories propose that biases arise primarily from associative System 1 thinking, while deliberative System 2 thinking mitigates bias, but the cognitive mechanisms that give rise to this phenomenon remain poorly understood. To better understand what underlies this duality in humans, and possibly in LLMs, we model System 1 and System 2 thinking as semantic memory networks with distinct structures, built from comparable datasets generated by both humans and LLMs. We then investigate how these distinct semantic memory structures relate to implicit gender bias using network-based evaluation metrics. We find that semantic memory structures are irreducible only in humans, suggesting that LLMs lack certain types of human-like conceptual knowledge. Moreover, semantic memory structure relates consistently to implicit bias only in humans, with lower levels of bias in System~2 structures. These findings suggest that certain types of conceptual knowledge contribute to bias regulation in humans, but not in LLMs, highlighting fundamental differences between human and machine cognition.