A More Hardware-Oriented Spiking Neural Network Based on Leading Memory Technology and Its Application With Reinforcement Learning

  • Kim, Min-Hwi; 
  • Hwang, Sungmin; 
  • Bang, Suhyun; 
  • Kim, Tae-Hyeon; 
  • Lee, Dong Keun; 
  • ... Cho, Seongjae; 
  • 외 2명
Citations

WEB OF SCIENCE

16
Citations

SCOPUS

17

초록

In recent days, more hardware-driven artificial intelligence system capable of brain-like low-energy consumption is gaining ever-increasing interest. The hardware-driven property lies in the low-power synaptic device and its array along with the area and energy-efficient neuron circuits. In this work, a spiking neural network (SNN) based on analog synaptic device of resistive-switching random access memory (RRAM) is constructed from the experimentally fabricated devices. Furthermore, the capability of the designed SNN hardware for sequential tasks through an optimal reinforcement learning (RL) algorithm is demonstrated. More specifically, the Rush Hour game is conducted as an example of applications for the sequential task for which an SNN architecture is plausibly suited. The rule of the game is simple but has not been demonstrated by a hardware-oriented artificial neural network (ANN) yet, and in this work, it is reported that the analog RRAM synaptic devices in the cross-point array architecture successfully solve the problem via the RL algorithm. IEEE

키워드

Artificial neural network (ANN); Biological neural networks; cross-point array architecture; Games; Hardware; hardware-driven artificial intelligence; low energy consumption; Neurons; reinforcement learning (RL); resistive-switching random access memory (RRAM); Rush Hour game; sequential task; Silicon; Silicon compounds; spiking neural network (SNN); Switches; synaptic device.; Energy efficiency; Energy utilization; Low power electronics; Memory architecture; Network architecture; Reinforcement learning; RRAM; Artificial intelligence systems; Cross-point array; Fabricated device; Low energy consumption; Random access memory; Resistive switching; Spiking neural network(SNN); Spiking neural networks; Neural networks
제목
A More Hardware-Oriented Spiking Neural Network Based on Leading Memory Technology and Its Application With Reinforcement Learning
저자
Kim, Min-Hwi; Hwang, Sungmin; Bang, Suhyun; Kim, Tae-Hyeon; Lee, Dong Keun; Ansari, M.H.R.; Cho, Seongjae; Park, Byung-Gook
DOI
10.1109/TED.2021.3099769
발행일
2021-09
유형
Article in Press
저널명
IEEE Transactions on Electron Devices
권
68
호
9
페이지
4411 ~ 4417