Objective: This paper argues that Brain-Inspired Spiking Neural Network (BI-SNN) architectures can learn and reveal deep in time-space functional and structural patterns from spatio-temporal data. These patterns can be represented as deep knowledge, in a partial case in the form of deep spatio-temporal rules. This is a promising direction for building new types of Brain-Computer Interfaces called Brain-Inspired Brain–Computer Interfaces (BI-BCI). A theoretical framework and its experimental validation on deep knowledge extraction and representation using SNN are presented. Results: The proposed methodology was applied in a case study to extract deep knowledge of the functional and structural organisation of the brain's neural network during the execution of a Grasp and Lift task. The BI-BCI successfully extracted the neural trajectories that represent the dorsal and ventral visual information processing streams as well as its connection to the motor cortex in the brain. Deep spatiotemporal rules on functional and structural interaction of distinct brain areas were then used for event prediction in BI-BCI. Significance: The computational framework can be used for unveiling the topological patterns of the brain and such knowledge can be effectively used to enhance the state-of-the-art in BCI.
Bibliographical noteFunding Information:
The authors are supported by the AUT, New Zealand SRIF Interact grant, 2017/2018/2019 and the KEDRI funding ( http://www.kedri.aut.ac.nz ). The authors would like to thank the anonymous reviewers for their valuable comments on improving the paper.
This research was supported by the SRIF Interact grant 2017/2018/2019 by the Auckland University of Technology, New Zealand.The authors are supported by the AUT, New Zealand SRIF Interact grant, 2017/2018/2019 and the KEDRI funding (http://www.kedri.aut.ac.nz). The authors would like to thank the anonymous reviewers for their valuable comments on improving the paper.
© 2019 Elsevier Ltd
- Deep learning NeuCube
- Knowledge representation
- Spiking Neural Networks
- Brain-Computer Interface