With the success of convolutional neural networks in computer vision tasks such as object detection and semantic segmentation on 2D data and images, there has been ongoing research on how to apply such deep learning models on 3D data. For applications such as robotics and autonomous driving, one can use depth sensing cameras to provide 3D data. However, these data are sparse and computationally hard to process. In this project, we want to process 3d data, namely, point clouds, segment them semantically and predict the bounding boxes around them.
General understanding of 3D computer vision is needed. Understanding of deep learning concepts in computer vision Hands-on experience of Python and deep learning frameworks
Qi, Charles R., et al. "Pointnet: Deep learning on point sets for 3d classification and segmentation." CVPR. 2017.
Su, Hang, et al. "Splatnet: Sparse lattice networks for point cloud processing." CVPR. 2018.
Shi, Shaoshuai, Xiaogang Wang, and Hongsheng Li. "Pointrcnn: 3d object proposal generation and detection from point cloud." CVPR. 2019.
Zhou, Yin, and Oncel Tuzel. "Voxelnet: End-to-end learning for point cloud based 3d object detection." CVPR. 2018.
If you are interested, please contact us via e-mail:
Students.ProjectForm | |
---|---|
Title: | 3D Object Detection and Segmentation from Point Clouds |
Abstract: | With the success of CNN architectures in computer vision tasks such as object detection and semantic segmentation on 2D data and images, there has been ongoing research on how to apply such deep learning models on 3D data. In fields such as robotics and autonomous driving, one can use 3D depth sensors to encapsulate 3D data. However, these data are sparse and computationally challenging to process. In this project, we want to process 3d data, namely, point clouds, segment them semantically and predict the bounding boxes around them. |
Student: | |
Director: | Federico Tombari |
Supervisor: | Mahdi Saleh |
Type: | DA/MA/BA |
Area: | Segmentation, Machine Learning, Computer Vision |
Status: | open |
Start: | |
Finish: | |
Thesis (optional): | |
Picture: |