Joseph S. Friedman

Neural Network Recognition & On-Chip Online Learning with STT-MRAM

This project aims to design and demonstrate an online learning circuit that leverages the stochastic switching of STT-MRAM devices to enable on-chip online learning and recognition.

Background

The human brain is greatly superior to digital systems for learning and recognition tasks, inspiring efforts to create artificial computing machines that mimic the neurons and synapses in the brain. This has led to the development of dedicated hardware approaches in which the neural network is explicitly fabricated in a crossbar of artificial digital synapses and neurons. While chips such as TrueNorth and Loihi have demonstrated the feasibility of implementing synapses and neurons with conventional digital silicon devices, it is expected that the computing efficiency can be further improved by more closely emulating neurobiological hardware.

To use any of these neural network systems for neuromorphic tasks such as recognition, the synapse weights must be set to particular values through a training process. This training process is central to the artificial intelligence provided by neural networks, as it enables the circuit to develop computing capabilities that have not been explicitly programmed through the circuit design process. The ability of online learning systems to develop computing capabilities after circuit deployment requires coordination with analog circuits that implement the learning rule by providing weight-updating electrical stimuli based on system behavior.

Project Description

This research aims to demonstrate a novel CMOS weight-updating circuit for neural network recognition and on-chip online learning with STT-MRAM. This circuit will perform an unsupervised learning rule through which the relative timing of input and output neuron spikes determine the voltages applied to the various synapses. To perform online learning with the STT-MRAM array, a mixed-signal on-chip learning circuit will be designed to update the synapse weights in the memory array. This learning circuit will provide voltage pulses to the memory array that stochastically switch the STT-MRAM devices. The learning circuit will be designed to ensure a functional prototype and provide a route towards robust, low-cost, high-speed, and energy-efficient large-scale neuromorphic systems. The proposed neuromorphic computing system will be the first complete design and demonstration of an on-chip online learning circuit for STT-MRAM.

Related Publications

  1. J. S. Friedman, Unsupervised Hebbian Learning and Reservoir Computing with Magnetic Tunnel Junctions, International Conference on Magnetism, June-July 2024 (invited).
  2. P. Zhou, A. J. Edwards, F. B. Mancoff, S. Aggarwal, S. K. Heinrich-Barna, J. S. Friedman, Neuromorphic Hebbian Learning with Magnetic Tunnel Junction Synapses, Government Microcircuit Applications & Critical Technology Conference, Mar. 2024.
  3. P. Zhou, A. J. Edwards, F. B. Mancoff, S. Aggarwal, S. K. Heinrich-Barna, J. S. Friedman, Neuromorphic Hebbian Learning with Magnetic Tunnel Junction Synapses, arXiv:2308.11011 (2023).
  4. P. Zhou, A. J. Edwards, F. B. Mancoff, S. Aggarwal, J. S. Friedman, Experimental Demonstration of Unsupervised Online Learning with Stochastic STT-MTJ Switching, Conference on Magnetism and Magnetic Materials, Oct.-Nov. 2023.
  5. P. Zhou, A. J. Edwards, F. B. Mancoff, S. Aggarwal, J. S. Friedman, Binarized Neuromorphic Inference Network with STT MTJ Synapses, Conference on Magnetism and Magnetic Materials, Oct.-Nov. 2022.
  6. J. S. Friedman, P. Zhou, X. Hu, A. J. Edwards, N. Hassan, W. H. Brigner, F. Garcia-Sanchez, C. H. Bennett, A. Velasquez, J. A. C. Incorvia, F. B. Mancoff, S. Aggarwal, Unsupervised Learning and Recognition with Single-Domain and Domain-Wall MTJs, Tohoku University Center for Science and Innovation in Spintronics Symposium, Oct. 2022 (invited).
  7. P. Zhou, A. J. Edwards, F. B. Mancoff, S. Aggarwal, J. S. Friedman, Experimental Demonstration of Neuromorphic Network with STT-MTJ Synapses, IEEE The Magnetic Recording Conference, Aug. 2022 (invited).
  8. P. Zhou, A. J. Edwards, F. B. Mancoff, D. Houssameddine, S. Aggarwal, J. S. Friedman, Binarized Neuromorphic Inference Network with STT MTJ Synapses, SPIE Spintronics, Aug. 2022 (invited).
  9. P. Zhou, A. J. Edwards, F. B. Mancoff, D. Houssameddine, S. Aggarwal, J. S. Friedman, Binarized Neuromorphic Computing with STT MTJ Synapses, International Conference on Neuromorphic Systems, July 2022.
  10. P. Zhou, J. A. Smith, L. Deremo, S. K. Heinrich-Barna, J. S. Friedman, Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching, APS March Meeting, Mar. 2022.
  11. P. Zhou, A. J. Edwards, F. B. Mancoff, D. Houssameddine, S. Aggarwal, J. S. Friedman, Experimental Demonstration of Neuromorphic Network with STT MTJ Synapses, IEEE International Electron Devices Meeting - MRAM Poster Session, Dec. 2021.
  12. P. Zhou, A. J. Edwards, F. B. Mancoff, D. Houssameddine, S. Aggarwal, J. S. Friedman, Experimental Demonstration of Neuromorphic Network with STT MTJ Synapses, arXiv:2112.04749 (2021).
  13. P. Zhou, J. A. Smith, L. Deremo, S. K. Heinrich-Barna, J. S. Friedman, Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching, arXiv:2112.05707 (2021).
  14. P. Zhou, A. J. Edwards, F. B. Mancoff, D. Houssameddine, S. Aggarwal, J. S. Friedman, Experimental Demonstration of Neuromorphic Network with STT MTJ Synapses, Government Microcircuit Applications & Critical Technology Conference, Mar. 2022.
  15. P. Zhou, J. A. Smith, L. Deremo, S. K. Heinrich-Barna, J. S. Friedman, Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching, Joint IEEE International Magnetics Conference & Conference on Magnetism and Magnetic Materials, Jan. 2022.
  16. P. Zhou, J. A. Smith, L. Deremo, S. K. Heinrich-Barna, J. S. Friedman, Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching, IEEE International Conference on Rebooting Computing, Nov. - Dec. 2021.
  17. P. Zhou, J. A. Smith, L. Deremo, S. K. Heinrich-Barna, J. S. Friedman, Synchronous Unsupervised STDP Learning with Stochastic STT-MRAM Switching, Government Microcircuit Applications & Critical Technology Conference, Mar. 2021.


This research is sponsored in part by the National Science Foundation under CCF award #2146439 and by the Semiconductor Research Corporation/Texas Analog Center of Excellence as Task #2810.030.