Spectral convolutional neural network chip for in-sensor edge computing of incoherent natural light.

ABSTRACT: Optical neural networks are considered next-generation physical implementations of artificial neural networks, but their capabilities are limited by on-chip integration scale and requirement for coherent light sources. This study proposes a spectral convolutional neural network (SCNN) with matter meta-imaging. The optical convolutional layer is implemented by integrating very large-scale and pixel-aligned spectral filters on CMOS image sensor. It facilitates highly parallel spectral vector-inner products of incident incoherent natural light i.e., the direct information carrier, which empowers in-sensor optical analog computing at extremely high energy efficiency. To the best of our knowledge, this is the first integrated optical computing utilizing natural light. We employ the same SCNN ch

SUBMITTER: Cui K 

PROVIDER: S-EPMC11696300 | biostudies-literature | 2025 Jan

REPOSITORIES: biostudies-literature