TY - JOUR
T1 - A neuro-inspired visual tracking method based on programmable system-on-chip platform
AU - Yang, Shufan
AU - Wong-Lin, KongFatt
AU - Andrew, James
AU - Mak, Terrence
AU - McGinnity, TM
PY - 2018/11
Y1 - 2018/11
N2 - Using programmable system-on-chip to implement computer vision functions poses many challenges due to highly constrained resources in cost, size and power consumption. In this work, we propose a new neuro-inspired image processing model and implemented it on a system-on-chip Xilinx Z702c board. With the attractor neural network model to store the object’s contour information, we eliminate the computationally expensive steps in the curve evolution re-initialization at every new iteration or frame. Our experimental results demonstrate that this integrated approach achieves accurate and robust object tracking, when they are partially or completely occluded in the scenes. Importantly, the system is able to process 640 by 480 videos in real-time stream with 30 frames per second using only one low-power Xilinx Zynq-7000 system-on-chip platform. This proof-of-concept work has demonstrated the advantage of incorporating neuro-inspired features in solving image processing problems during occlusion.
AB - Using programmable system-on-chip to implement computer vision functions poses many challenges due to highly constrained resources in cost, size and power consumption. In this work, we propose a new neuro-inspired image processing model and implemented it on a system-on-chip Xilinx Z702c board. With the attractor neural network model to store the object’s contour information, we eliminate the computationally expensive steps in the curve evolution re-initialization at every new iteration or frame. Our experimental results demonstrate that this integrated approach achieves accurate and robust object tracking, when they are partially or completely occluded in the scenes. Importantly, the system is able to process 640 by 480 videos in real-time stream with 30 frames per second using only one low-power Xilinx Zynq-7000 system-on-chip platform. This proof-of-concept work has demonstrated the advantage of incorporating neuro-inspired features in solving image processing problems during occlusion.
KW - Visual object tracking
KW - mean-shift
KW - level set
KW - attractor neural network model
KW - occlusion
KW - system-on-chip
UR - https://pure.ulster.ac.uk/en/publications/a-neuro-inspired-visual-tracking-method-based-on-programmable-sys-3
U2 - 10.1007/s00521-017-2847-5
DO - 10.1007/s00521-017-2847-5
M3 - Article
SN - 1433-3058
VL - 30
SP - 2697
EP - 2708
JO - Neural Computing and Applications
JF - Neural Computing and Applications
IS - 9
ER -