Implementation of a Binary Neural Network on a Passive Array of Magnetic Tunnel Junctions
Abstract
The increasing scale of neural networks and their growing application space have produced demand for more energy- and memory-efficient artificial-intelligence-specific hardware. Avenues to mitigate the main issue, the von Neumann bottleneck, include in-memory and near-memory architectures, as well as algorithmic approaches. Here we leverage the low-power and the inherently binary operation of magnetic tunnel junctions (MTJs) to demonstrate neural network hardware inference based on passive arrays of MTJs. In general, transferring a trained network model to hardware for inference is confronted by degradation in performance due to device-to-device variations, write errors, parasitic resistance, and nonidealities in the substrate. To quantify the effect of these hardware realities, we benchmark 300 unique weight matrix solutions of a two-layer perceptron to classify the Wine dataset for both classification accuracy and write fidelity. Despite device imperfections, we achieve software-equivalent accuracy of up to 95.3% with proper tuning of network parameters in 15 × 15 MTJ arrays having a range of device sizes. The success of this tuning process shows that new metrics are needed to characterize the performance and quality of networks reproduced in mixed signal hardware.
- Publication:
-
Physical Review Applied
- Pub Date:
- July 2022
- DOI:
- 10.1103/PhysRevApplied.18.014039
- arXiv:
- arXiv:2112.09159
- Bibcode:
- 2022PhRvP..18a4039G
- Keywords:
-
- Computer Science - Emerging Technologies;
- Condensed Matter - Disordered Systems and Neural Networks;
- Condensed Matter - Materials Science;
- Computer Science - Machine Learning;
- Physics - Applied Physics
- E-Print:
- 22 pages plus 8 pages supplemental material