Click-to-Ask: An AI Live Streaming Assistant with Offline Copywriting and Online Interactive QA
AI 摘要
Click-to-Ask是一个AI直播助手,通过离线文案生成和在线交互问答提升直播效率。
主要贡献
- 提出Click-to-Ask系统,用于优化直播电商体验
- 利用离线模块生成合规的商品推广文案
- 利用在线模块实时响应观众提问,提升互动性
方法论
结合离线多模态信息处理生成结构化数据和文案,在线利用历史记忆进行实时问答。
原文摘要
Live streaming commerce has become a prominent form of broadcasting in the modern era. To facilitate more efficient and convenient product promotions for streamers, we present Click-to-Ask, an AI-driven assistant for live streaming commerce with complementary offline and online components. The offline module processes diverse multimodal product information, transforming complex inputs into structured product data and generating compliant promotional copywriting. During live broadcasts, the online module enables real-time responses to viewer inquiries by allowing streamers to click on questions and leveraging both the structured product information generated by the offline module and an event-level historical memory maintained in a streaming architecture. This system significantly reduces the time needed for promotional preparation, enhances content engagement, and enables prompt interaction with audience inquiries, ultimately improving the effectiveness of live streaming commerce. On our collected dataset of TikTok live stream frames, the proposed method achieves a Question Recognition Accuracy of 0.913 and a Response Quality score of 0.876, demonstrating considerable potential for practical application. The video demonstration can be viewed here: https://www.youtube.com/shorts/mWIXK-SWhiE.