Unknown

Dataset Information

0

Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability.


ABSTRACT: Deep neural networks have revolutionized several domains, including autonomous driving, cancer detection, and drug design, and are the foundation for massive artificial intelligence models. However, hardware neural network reports still mainly focus on shallow networks (2 to 5 layers). Implementing deep neural networks in hardware is challenging due to the layer-by-layer structure, resulting in long training times, signal interference, and low accuracy due to gradient explosion/vanishing. Here, we utilize negative ultraviolet photoconductive light-emitting memristors with intrinsic parallelism and hardware-software co-design to achieve electrical information's optical cross-layer transmission. We propose a hybrid ultra-deep photoelectric neural network and an ultra-deep super-resolution reconstruction neural network using light-emitting memristors and cross-layer block, expanding the networks to 54 and 135 layers, respectively. Further, two networks enable transfer learning, approaching or surpassing software-designed networks in multi-dataset recognition and high-resolution restoration tasks. These proposed strategies show great potential for high-precision multifunctional hardware neural networks and edge artificial intelligence.

SUBMITTER: Chen Z 

PROVIDER: S-EPMC10908859 | biostudies-literature | 2024 Mar

REPOSITORIES: biostudies-literature

altmetric image

Publications

Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability.

Chen Zhenjia Z   Lin Zhenyuan Z   Yang Ji J   Chen Cong C   Liu Di D   Shan Liuting L   Hu Yuanyuan Y   Guo Tailiang T   Chen Huipeng H  

Nature communications 20240302 1


Deep neural networks have revolutionized several domains, including autonomous driving, cancer detection, and drug design, and are the foundation for massive artificial intelligence models. However, hardware neural network reports still mainly focus on shallow networks (2 to 5 layers). Implementing deep neural networks in hardware is challenging due to the layer-by-layer structure, resulting in long training times, signal interference, and low accuracy due to gradient explosion/vanishing. Here,  ...[more]

Similar Datasets

| S-EPMC8055988 | biostudies-literature
| S-EPMC10533477 | biostudies-literature
| S-EPMC6528386 | biostudies-literature
| S-EPMC5388879 | biostudies-literature
| S-EPMC10834433 | biostudies-literature
| S-EPMC8746833 | biostudies-literature
| S-EPMC8966659 | biostudies-literature
| S-EPMC6645075 | biostudies-literature
| S-EPMC5467226 | biostudies-literature
| S-EPMC6502957 | biostudies-literature