Shashi Chilappagari, Co-Founder and Chief Architect of DeGirum, presents the “Bring Your ML Models to the Edge with the DeGirum DeLight Cloud Platform,” tutorial at the May 2023 Embedded Vision Summit.
In this talk, Chilappagari presents an overview of the DeGirum DeLight Cloud Platform, which accelerates the edge AI application development process by bringing together application software, machine learning models and AI accelerator hardware. The platform provides cloud access to multiple AI hardware accelerators, including DeGirum’s ORCA, allowing developers to get started without investing time and money on bringing up hardware. It provides intuitive, hardware-agnostic APIs that enable developing a single software stack for multiple hardware options.
Along with a rich model zoo covering a wide variety of applications, the platform provides tools to enable developers to port their own models. Chilappagari highlights the challenges in model porting, including proper specification of pre-processing and post-processing logic; targeting the model for multiple hardware; and pipelining various stages in the application to optimize performance. He illustrates, with the help of examples, how the DeLight platform overcomes these challenges.
See here for a PDF of the slides.
