Wil Florentino, Senior Marketing Manager for Industrial/IIoT at Micron Technology, presents the “Importance of Memory for Breaking the Edge AI Performance Bottleneck” tutorial at the May 2024 Embedded Vision Summit.
In recent years there’s been tremendous focus on designing next-generation AI chipsets to improve neural network inference performance. As higher performance processors are called upon to execute ever-larger models—from vision transformers to LLMs—memory bandwidth is frequently the key performance bottleneck. With the demands for memory bandwidth and storage capacity varying across applications, it is critical to identify the right memory technologies that match the complexity and performance needs of your application.
In this talk, Florentino explores how to choose the right memory to break the performance bottleneck in edge AI systems. He also highlights recent memory technology developments that are enabling higher memory performance and capacity at the edge.
See here for a PDF of the slides.
