Multimodal Learning 相关度: 8/10

AceleradorSNN: A Neuromorphic Cognitive System Integrating Spiking Neural Networks and DynamicImage Signal Processing on FPGA

Daniel Gutierrez, Ruben Martinez, Leyre Arnedo, Antonio Cuesta, Soukaina El Hamry
arXiv: 2603.28429v1 发布: 2026-03-30 更新: 2026-03-30

AI 摘要

提出AceleradorSNN,一种基于SNN和动态ISP的FPGA加速的神经形态认知系统。

主要贡献

  • 设计了基于SNN的神经形态处理单元(NPU)
  • 设计了动态可重构的认知图像信号处理器(ISP)
  • 在FPGA上实现了实时流ISP架构
  • 评估了替代梯度训练的SNN骨干网络

方法论

采用硬件导向的设计方法,结合SNN、动态ISP和FPGA实现认知系统,并评估SNN的性能。

原文摘要

The demand for high-speed, low-latency, and energy-efficient object detection in autonomous systems -- such as advanced driver-assistance systems (ADAS), unmanned aerial vehicles (UAVs), and Industry 4.0 robotics -- has exposed the limitations of traditional Convolutional Neural Networks (CNNs). To address these challenges, we have developed AceleradorSNN, a third-generation artificial intelligence cognitive system. This architecture integrates a Neuromorphic Processing Unit (NPU) based on Spiking Neural Networks (SNNs) to process asynchronous data from Dynamic Vision Sensors (DVS), alongside a dynamically reconfigurable Cognitive Image Signal Processor (ISP) for RGB cameras. This paper details the hardware-oriented design of both IP cores, the evaluation of surrogate-gradienttrained SNN backbones, and the real-time streaming ISP architecture implemented on Field-Programmable Gate Arrays (FPGA).

标签

SNN FPGA Neuromorphic Computing ISP ADAS UAV

arXiv 分类

cs.AR cs.AI