Kimera: An Open-Source Library for Real-Time Metric-Semantic Localization and Mapping
Author(s)
Rosinol, Antoni; Abate, Marcus; Chang, Yun; Carlone, Luca
DownloadAccepted version (4.207Mb)
Open Access Policy
Open Access Policy
Creative Commons Attribution-Noncommercial-Share Alike
Terms of use
Metadata
Show full item recordAbstract
© 2020 IEEE. We provide an open-source C++ library for real-time metric-semantic visual-inertial Simultaneous Localization And Mapping (SLAM). The library goes beyond existing visual and visual-inertial SLAM libraries (e.g., ORB-SLAM, VINS-Mono, OKVIS, ROVIO) by enabling mesh reconstruction and semantic labeling in 3D. Kimera is designed with modularity in mind and has four key components: a visual-inertial odometry (VIO) module for fast and accurate state estimation, a robust pose graph optimizer for global trajectory estimation, a lightweight 3D mesher module for fast mesh reconstruction, and a dense 3D metric-semantic reconstruction module. The modules can be run in isolation or in combination, hence Kimera can easily fall back to a state-of-the-art VIO or a full SLAM system. Kimera runs in real-time on a CPU and produces a 3D metric-semantic mesh from semantically labeled images, which can be obtained by modern deep learning methods. We hope that the flexibility, computational efficiency, robustness, and accuracy afforded by Kimera will build a solid basis for future metric-semantic SLAM and perception research, and will allow researchers across multiple areas (e.g., VIO, SLAM, 3D reconstruction, segmentation) to benchmark and prototype their own efforts without having to start from scratch.
Date issued
2020-09Department
Massachusetts Institute of Technology. Laboratory for Information and Decision Systems; Massachusetts Institute of Technology. Department of Aeronautics and AstronauticsJournal
Proceedings - IEEE International Conference on Robotics and Automation
Publisher
IEEE
Citation
Rosinol, Antoni, Abate, Marcus, Chang, Yun and Carlone, Luca. 2020. "Kimera: An Open-Source Library for Real-Time Metric-Semantic Localization and Mapping." Proceedings - IEEE International Conference on Robotics and Automation.
Version: Author's final manuscript