Sébastien Taylor, Vice President of Research and Development for Au-Zone Technologies, presents the “Augmenting Visual AI through Radar and Camera Fusion” tutorial at the May 2024 Embedded Vision Summit.
In this presentation Taylor discusses well-known limitations of camera-based AI and how radar can be leveraged to address these limitations. He covers common radar data representations and how AI can be used on radar. He then explains how radar and camera data can be fused into a single sensor-fusion AI model.
Taylor also dives into low-level radar data cubes and how these can provide richer data for the model while introducing some new challenges, and he discusses methods to tackle these challenges. Finally he explores some example scenarios comparing a radar-camera combination with a stereo camera to highlight the trade-offs of the two approaches.
See here for a PDF of the slides.
