On November 10, 2022 at 9 am PT (noon ET), Steve Teig, Founder and CEO of Perceive, will present the free one-hour webinar “Putting Activations on a Diet – Or Why Watching Your Weights Is Not Enough,” organized by the Edge AI and Vision Alliance. Here’s the description, from the event registration page:
To reduce the memory requirements of neural networks, researchers have proposed numerous heuristics for compressing weights. Lower precision, sparsity, weight sharing and various other schemes shrink the memory needed by the neural network’s weights or program. Unfortunately, during network execution, memory use is usually dominated by activations–the data flowing through the network–rather than weights.
Although lower precision can reduce activation memory somewhat, more extreme steps are required in order to enable large networks to run efficiently with small memory footprints. Fortunately, the underlying information content of activations is often modest, so novel compression strategies can dramatically widen the range of networks executable on constrained hardware. In this webinar, Teig will introduce some new strategies for compressing activations, sharply reducing their memory footprint. A question-and-answer session will follow the presentation.
To register for this free webinar, please see the event page. For more information, please email [email protected].
