AI Agents 相关度: 6/10

Hardware-accelerated graph neural networks: an alternative approach for neuromorphic event-based audio classification and keyword spotting on SoC FPGA

Kamil Jeziorek, Piotr Wzorek, Krzysztof Blachut, Hiroshi Nakano, Manon Dampfhoffer, Thomas Mesquida, Hiroaki Nishi, Thomas Dalgaty, Tomasz Kryjak
arXiv: 2602.16442v1 发布: 2026-02-18 更新: 2026-02-18

AI 摘要

论文提出一种基于FPGA的硬件加速事件图神经网络,用于低延迟、低功耗的事件驱动音频处理。

主要贡献

  • 提出基于FPGA的事件图神经网络架构。
  • 实现高效的事件驱动音频分类和关键词检测。
  • 在功耗和延迟方面建立新的基准。

方法论

利用人工耳蜗将时间序列信号转换为稀疏事件数据,使用图卷积网络和循环序列模型进行音频处理,并在SoC FPGA上实现。

原文摘要

As the volume of data recorded by embedded edge sensors increases, particularly from neuromorphic devices producing discrete event streams, there is a growing need for hardware-aware neural architectures that enable efficient, low-latency, and energy-conscious local processing. We present an FPGA implementation of event-graph neural networks for audio processing. We utilise an artificial cochlea that converts time-series signals into sparse event data, reducing memory and computation costs. Our architecture was implemented on a SoC FPGA and evaluated on two open-source datasets. For classification task, our baseline floating-point model achieves 92.7% accuracy on SHD dataset - only 2.4% below the state of the art - while requiring over 10x and 67x fewer parameters. On SSC, our models achieve 66.9-71.0% accuracy. Compared to FPGA-based spiking neural networks, our quantised model reaches 92.3% accuracy, outperforming them by up to 19.3% while reducing resource usage and latency. For SSC, we report the first hardware-accelerated evaluation. We further demonstrate the first end-to-end FPGA implementation of event-audio keyword spotting, combining graph convolutional layers with recurrent sequence modelling. The system achieves up to 95% word-end detection accuracy, with only 10.53 microsecond latency and 1.18 W power consumption, establishing a strong benchmark for energy-efficient event-driven KWS.

标签

FPGA 图神经网络 音频处理 事件驱动 关键词检测

arXiv 分类

cs.LG cs.AI cs.SD eess.AS