SGLFormer: Spiking Global-Local-Fusion Transformer with high performance.

ABSTRACT:

Introduction

Spiking Neural Networks (SNNs), inspired by brain science, offer low energy consumption and high biological plausibility with their event-driven nature. However, the current SNNs are still suffering from insufficient performance.

Methods

Recognizing the brain's adeptness at information processing for various scenarios with complex neuronal connections within and across regions, as well as specialized neuronal architectures for specific functions, we propose a Spiking Global-Local-Fusion Transformer (SGLFormer), that significantly improves the performance of SNNs. This novel architecture enables efficient information processing on both global and local scales, by integrating transformer and convolution structures in SNNs. In addition, we uncover the problem of in

SUBMITTER: Zhang H 

PROVIDER: S-EPMC10977074 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature