STDG: Fast and Lightweight SNN Training Technique Using Spike Temporal Locality

Conference Publication ResearchOnline@JCU
Cai, Zhengyu;Kalatehbali, Hamid Rahimian;Walters, Ben;Rahimi Azghadi, Mostafa;Amirsoleimani, Amirali;Genov, Roman
Abstract

Spiking neural networks (SNNs) possess biological plausibility and energy efficiency as they communicate using asynchronous and mostly sparse spikes. These features make them an ideal choice for efficient neuromorphic computing. The non-differentiable, discrete binary spike events transmitted in SNNs pose a challenge for applying gradient-based optimization algorithms directly to these networks. Therefore, efficient techniques are necessary to enhance energy efficiency without sacrificing accuracy. In this work, we propose Spike Timing Dependent Gradient (STDG), a fast and lightweight learning scheme that uses temporal locality among spikes to avoid non-differentiable derivatives. Our experiments show that STDG reaches the state-of-the-art accuracy of 99.5% and 98.2% on the Caltech101 face/motorbike and the MNIST datasets, respectively.

Journal

N/A

Publication Name

BioCAS 2023 - 2023 IEEE Biomedical Circuits and Systems Conference, Conference Proceedings

Volume

N/A

ISBN/ISSN

9798350300260

Edition

N/A

Issue

N/A

Pages Count

5

Location

Toronto, Canada

Publisher

Institute of Electrical and Electronics Engineers

Publisher Url

N/A

Publisher Location

Piscataway, NJ, USA

Publish Date

N/A

Url

N/A

Date

N/A

EISSN

N/A

DOI

10.1109/BioCAS58349.2023.10388882