Variation-aware binarized memristive networks

Conference Publication ResearchOnline@JCU
Lammie, Corey;Krestinskaya, Olga;James, Alex;Rahimi Azghadi, Mostafa
Abstract

The quantization of weights to binary states in Deep Neural Networks (DNNs) can replace resource-hungry multiply accumulate operations with simple accumulations. Such Binarized Neural Networks (BNNs) exhibit greatly reduced resource and power requirements. In addition, memristors have been shown as promising synaptic weight elements in DNNs. In this paper, we propose and simulate novel Binarized Memristive Convolutional Neural Network (BMCNN) architectures employing hybrid weight and parameter representations. We train the proposed architectures offline and then map the trained parameters to our binarized memristive devices for inference. To take into account the variations in memristive devices, and to study their effect on the performance, we introduce variations in R ON and R OFF . Moreover, we introduce means to mitigate the adverse effect of memristive variations in our proposed networks. Finally, we benchmark our BMCNNs and variation-aware BMCNNs using the MNIST dataset.

Journal

N/A

Publication Name

2019 ICECS: 26th IEEE International Conference on Electronics, Circuits and Systems

Volume

N/A

ISBN/ISSN

978-1-7281-0996-1

Edition

N/A

Issue

N/A

Pages Count

4

Location

Genoa, Italy

Publisher

Institute of Electrical and Electronics Engineers

Publisher Url

N/A

Publisher Location

Piscataway, NJ, USA

Publish Date

N/A

Url

N/A

Date

N/A

EISSN

N/A

DOI

10.1109/ICECS46596.2019.8964998