TY - JOUR
T1 - Deep learning and deep knowledge representation in Spiking Neural Networks for Brain-Computer Interfaces
AU - Kumarasinghe, Kaushalya
AU - Kasabov, Nikola
AU - Taylor, Denise
PY - 2020/1/5
Y1 - 2020/1/5
N2 - Objective: This paper argues that Brain-Inspired Spiking Neural Network (BI-SNN) architectures can learn and reveal deep in time-space functional and structural patterns from spatio-temporal data. These patterns can be represented as deep knowledge, in a partial case in the form of deep spatio-temporal rules. This is a promising direction for building new types of Brain-Computer Interfaces called Brain-Inspired Brain–Computer Interfaces (BI-BCI). A theoretical framework and its experimental validation on deep knowledge extraction and representation using SNN are presented. Results: The proposed methodology was applied in a case study to extract deep knowledge of the functional and structural organisation of the brain's neural network during the execution of a Grasp and Lift task. The BI-BCI successfully extracted the neural trajectories that represent the dorsal and ventral visual information processing streams as well as its connection to the motor cortex in the brain. Deep spatiotemporal rules on functional and structural interaction of distinct brain areas were then used for event prediction in BI-BCI. Significance: The computational framework can be used for unveiling the topological patterns of the brain and such knowledge can be effectively used to enhance the state-of-the-art in BCI.
AB - Objective: This paper argues that Brain-Inspired Spiking Neural Network (BI-SNN) architectures can learn and reveal deep in time-space functional and structural patterns from spatio-temporal data. These patterns can be represented as deep knowledge, in a partial case in the form of deep spatio-temporal rules. This is a promising direction for building new types of Brain-Computer Interfaces called Brain-Inspired Brain–Computer Interfaces (BI-BCI). A theoretical framework and its experimental validation on deep knowledge extraction and representation using SNN are presented. Results: The proposed methodology was applied in a case study to extract deep knowledge of the functional and structural organisation of the brain's neural network during the execution of a Grasp and Lift task. The BI-BCI successfully extracted the neural trajectories that represent the dorsal and ventral visual information processing streams as well as its connection to the motor cortex in the brain. Deep spatiotemporal rules on functional and structural interaction of distinct brain areas were then used for event prediction in BI-BCI. Significance: The computational framework can be used for unveiling the topological patterns of the brain and such knowledge can be effectively used to enhance the state-of-the-art in BCI.
KW - Deep learning NeuCube
KW - Knowledge representation
KW - Spiking Neural Networks
KW - Electroencephalography
KW - Brain-Computer Interface
UR - https://pure.ulster.ac.uk/en/publications/deep-learning-and-deep-knowledge-representation-in-spiking-neural
UR - http://www.scopus.com/inward/record.url?scp=85072702248&partnerID=8YFLogxK
U2 - 10.1016/j.neunet.2019.08.029
DO - 10.1016/j.neunet.2019.08.029
M3 - Article
C2 - 31568895
VL - 121
SP - 169
EP - 185
JO - Neural Networks
JF - Neural Networks
SN - 0893-6080
ER -