10:40 – 11:00

High Bandwidth Memory (HBM) and Advanced Packaging in AI

As the requirement of processing data in Artificial Intelligence (AI) grows exponentially, a large capacity and high bandwidth in memory technology plays a pivotal role in the integrated AI system performances. High bandwidth memories (HBMs) has been great solutions since 2017 when HBM2 was implemented in nVIDIA P100/V100. Currently, 6th generation HBM, HBM4 is in development.The continued scaling of HBM to increase memory capacity and bandwidth and additionally to enhance thermal performance has been great challenges and required the evolutions of 3D stacking technologies. In this presentation, HBM stacking technology innovations and roadmap will be presented. HBM stacking challenges associated with next generation advanced packaging technologies will be discussed.

Jaesik Lee Ph.D.

VP Package Engineering , SK Hynix, America

SK Hynix