Costas Calamvokis, Distinguished Engineer at Expedera, presents the “Challenges and Solutions of Moving Vision LLMs to the Edge” tutorial at the May 2024 Embedded Vision Summit.
OEMs, brands and cloud providers want to move LLMs to the edge, especially for vision applications. What are the benefits and challenges of doing so? In this talk, Calamvokis explores how edge AI is evolving to encompass massively increasing LLM model sizes, the use cases of local LLMs and the performance, power and chip area considerations that system architects should consider when utilizing vision-based LLMs.
See here for a PDF of the slides.
