Hongcheng Wang, Director of Technical Research at Comcast, presents the “Video Activity Recognition with Limited Data for Smart Home Applications” tutorial at the September 2020 Embedded Vision Summit.
Comcast’s Xfinity Home connects millions of home smart cameras and IoT devices to improve its customers’ safety and security. The company’s teams use computer vision and deep learning to understand video and sensor data from these devices to identify relevant events so that it can improve the user experience.
Specifically, Comcast has explored the spatial-temporal relationships among objects, places and actions. The company has also developed a semi-supervised learning approach for video classification (VideoSSL) to detect certain activities using limited training data. Using these techniques, and as described in this presentation, it has achieved very promising results on activity recognition with multiple datasets.
See here for a PDF of the presentation.