Towards detection of containers from 3D point clouds for automation of ship-to-shore (STS) cranes

Computer Vision and Machine Learning Intern at ABB Corporate Research Center. Supervised by Dr. Bruno Arsenali, Dr. Deran Maas and Dr. Stefano Maranò.

This project was undertaken at ABB Corporate Research Center in Switzerland.

In this project, we build a fully autonomous perception system for smart container shipping by developing simulation platform for generation of synthetic point clouds, and machine learning algorithm for detection of containers from point clouds.

AI-empowered shipping system

Main Contributions

  • Designed and implemented a simulation platform of large shipping scenarios based on ROS2 and Gazebo.
  • Developed 3D lidar-based object detection algorithms for the real-time monitoring of containers, using the synthetic data generated from our simulation platform.
  • Applied the model into real scenarios and mitigated the domain gap between synthetic and real-world data.