HSMD: an object motion detection algorithm using a Hybrid Spiking Neural Network Architecture

Machado, P. ORCID: 0000-0003-1760-3871, Oikonomou, A. ORCID: 0000-0002-5069-3971, Ferreira, J.F. ORCID: 0000-0002-2510-2412 and Mcginnity, T.M., 2021. HSMD: an object motion detection algorithm using a Hybrid Spiking Neural Network Architecture. IEEE Access. ISSN 2169-3536

1469286_Machado.pdf - Post-print

Download (973kB) | Preview


The detection of moving objects is a trivial task performed by vertebrate retinas, yet a complex computer vision task. Object-motion-sensitive ganglion cells (OMS-GC) are specialised cells in the retina that sense moving objects. OMS-GC take as input continuous signals and produce spike patterns as output, that are transmitted to the Visual Cortex via the optic nerve. The Hybrid Sensitive Motion Detector (HSMD) algorithm proposed in this work enhances the GSOC dynamic background subtraction (DBS) algorithm with a customised 3-layer spiking neural network (SNN) that outputs spiking responses akin to the OMS-GC. The algorithm was compared against existing background subtraction (BS) approaches, available on the OpenCV library, specifically on the 2012 change detection (CDnet2012) and the 2014 change detection (CDnet2014) benchmark datasets. The results show that the HSMD was ranked overall first among the competing approaches and has performed better than all the other algorithms on four of the categories across all the eight test metrics. Furthermore, the HSMD proposed in this paper is the first to use an SNN to enhance an existing state of the art DBS (GSOC) algorithm and the results demonstrate that the SNN provides near real-time performance in realistic applications.

Item Type: Journal article
Publication Title: IEEE Access
Creators: Machado, P., Oikonomou, A., Ferreira, J.F. and Mcginnity, T.M.
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Date: 7 September 2021
ISSN: 2169-3536
Rights: This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
Divisions: Schools > School of Science and Technology
Record created by: Jeremy Silvester
Date Added: 09 Sep 2021 15:23
Last Modified: 09 Sep 2021 15:23
URI: https://irep.ntu.ac.uk/id/eprint/44151

Actions (login required)

Edit View Edit View


Views per month over past year


Downloads per month over past year