Object-Aware SLAM Based on Efficient Quadric Initialization and Joint Data Association

ZhenZhong Cao, Yunzhou Zhang, Rui Tian, Rong Ma, Xinggang Hu, Sonya Coleman, Dermot Kerr

Research output: Contribution to journalArticlepeer-review

32 Downloads (Pure)


Semantic simultaneous localization and mapping (SLAM) is a popular technology enabling indoor mobile robots to sufficiently perceive and interact with the environment. In this paper, we propose an object-aware semantic SLAM system, which consists of a quadric initialization method, an object-level data association method, and a multi-constraint optimization factor graph. To overcome the limitation of multi-view observations and the requirement of dense point clouds for objects, an efficient quadric initialization method based on object detection and surfel construction is proposed, which can efficiently initialize quadrics within fewer frames and with small viewing angles. The robust object-level joint data association method and the tightly coupled multi-constraint factor graph for quadrics optimization and joint bundle adjustment enable the accurate estimation of constructed quadrics and camera poses. Extensive experiments using public datasets show that the proposed system achieves competitive performance with respect to accuracy and robustness of object quadric estimation and camera localization compared with state-of-the-art methods.
Original languageEnglish
Pages (from-to)1-8
Number of pages8
JournalIEEE Robotics and Automation Letters
Publication statusE-pub ahead of print - 13 Jul 2022


  • Artificial Intelligence
  • Control and Optimization
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Mechanical Engineering
  • Human-Computer Interaction
  • Biomedical Engineering
  • Control and Systems Engineering


Dive into the research topics of 'Object-Aware SLAM Based on Efficient Quadric Initialization and Joint Data Association'. Together they form a unique fingerprint.

Cite this