Unknown

Dataset Information

0

An adaptive synaptic array using Fowler-Nordheim dynamic analog memory.


ABSTRACT: In this paper we present an adaptive synaptic array that can be used to improve the energy-efficiency of training machine learning (ML) systems. The synaptic array comprises of an ensemble of analog memory elements, each of which is a micro-scale dynamical system in its own right, storing information in its temporal state trajectory. The state trajectories are then modulated by a system level learning algorithm such that the ensemble trajectory is guided towards the optimal solution. We show that the extrinsic energy required for state trajectory modulation can be matched to the dynamics of neural network learning which leads to a significant reduction in energy-dissipated for memory updates during ML training. Thus, the proposed synapse array could have significant implications in addressing the energy-efficiency imbalance between the training and the inference phases observed in artificial intelligence (AI) systems.

SUBMITTER: Mehta D 

PROVIDER: S-EPMC8964701 | biostudies-literature | 2022 Mar

REPOSITORIES: biostudies-literature

altmetric image

Publications

An adaptive synaptic array using Fowler-Nordheim dynamic analog memory.

Mehta Darshit D   Rahman Mustafizur M   Aono Kenji K   Chakrabartty Shantanu S  

Nature communications 20220329 1


In this paper we present an adaptive synaptic array that can be used to improve the energy-efficiency of training machine learning (ML) systems. The synaptic array comprises of an ensemble of analog memory elements, each of which is a micro-scale dynamical system in its own right, storing information in its temporal state trajectory. The state trajectories are then modulated by a system level learning algorithm such that the ensemble trajectory is guided towards the optimal solution. We show tha  ...[more]

Similar Datasets

| S-EPMC11958649 | biostudies-literature
| S-EPMC7595237 | biostudies-literature
| S-EPMC10550916 | biostudies-literature
| S-EPMC9160094 | biostudies-literature
| S-EPMC12429057 | biostudies-literature
| S-EPMC7358558 | biostudies-literature
| S-EPMC5056518 | biostudies-literature
| S-EPMC4705037 | biostudies-literature