Steve Teig, Chief Technology Officer at Xperi, presents the “Embedding Programmable DNNs in Low-Power SoCs” tutorial at the May 2018 Embedded Vision Summit.
This talk presents the latest generation of FotoNation’s (a core business unit of Xperi) Image Processing Unit (IPU)—an embedded AI enabled image processing engine that can be customized and adapted to suit a wide range of imaging tasks. Due to its scalable nature, the IPU can be deployed in low-power applications such as IoT devices, and can also be scaled up to much more powerful configurations suitable for challenging automotive computer vision applications. And, in perhaps the most exciting development, the latest variants of the IPU feature FotoNation’s programmable convolutional neural network engine (pCNN), which can implement CNN architectures created using state-of-art design tools such as TensorFlow and Caffe.
The pCNN hardware architecture, optimized for image analytics and Xperi’s state of the art DBI™ digital bonding interconnect technology, can also implement multiple CNNs in parallel being able to meet most stringent real time requirements. The combination of the IPU and DBI™ enables advanced artificial intelligence solutions implemented on mid-sized chips – opening the door to powerful AI driven imaging solutions that you can carry in your pocket.
