In-memory computing for deep learning and beyond
- Date: Jul 7, 2021
- Time: 16:00 - 17:00
- Speaker: Abu Sebastian
- IBM Zurich
- Location: Max-Planck-Institut für Mikrostrukturphysik, Weinberg 2, 06120 Halle (Saale)
- Room: Online
- Host: IMPRS-STNS
The rise of AI and in particular, deep learning (DL), is a key driver for innovations in computing systems. There is a significant effort towards the design of custom accelerator chips based on reduced precision arithmetic and highly optimized dataflow. However, the need to shuttle millions of synaptic weight values between the memory and processing units, remains unaddressed. In-memory computing (IMC) is an emerging computing paradigm that addresses this challenge of processor-memory dichotomy. Attributes such as synaptic efficacy and plasticity can be implemented in place by exploiting the physical attributes of memory devices such as phase-change memory (PCM). In this talk, I will give a status update on where in-memory computing stands with respect to DL acceleration. I will present some recent algorithmic advances for performing accurate DL inference and training with imprecise IMC. I will also touch upon some system-level aspects and will present a world’s first IMC compute core based on PCM fabricated in 14nm CMOS technology. I will also provide a brief overview of photonic in-memory computing that could facilitate unprecedented latency and compute density. Finally, I will present some applications of IMC that transcend conventional DL such as memory-augmented neural networks and spiking neural networks.
Abu Sebastian is a Distinguished Research Staff Member at IBM Research – Zurich. He was a contributor to several key projects in the space of storage and memory technologies and currently leads the research effort on in-memory computing at IBM Zurich. Dr. Sebastian is a co-recipient of the 2009 IEEE Control Systems Technology Award and the 2009 IEEE Transactions on Control Systems Technology Outstanding Paper Award. In 2015 he was awarded the European Research Council (ERC) consolidator grant and in 2020, he was awarded an ERC Proof-of-concept grant. He is an IBM Master Inventor since 2016. He was named Principal and Distinguished Research Staff Member in 2018 and 2020, respectively. In 2019, he received the Ovshinsky Lectureship Award for his contributions to "Phase-change materials for cognitive computing".
Zoom access (please access meeting 5 minutes prior to the start) | Meeting ID: 910 9757 6465 | Passcode: 318665