AIチップのコスト2/3が「メモリ」に?HBM高騰がもたらす開発ロードマップへの衝撃 (English)
1. Introduction: The Leading Role in AI Semiconductors Shifts from “Compute Cores” to “Memory” In modern AI development, securing state-of-the-art GPUs—starting with NVIDIA’s—is a decisive factor in the success or failure of a project. However, behind the raw computing performance (FLOPs) that we typically focus on as “GPU performance,” we must not overlook a historic paradigm shift occurring in the cost structure of semiconductors. According to the latest data released by the research organization “Epoch AI,” it has become clear that in the latest generation of AI accelerators, approximately two-thirds (over 60% in recent chips) of the component manufacturing cost is occupied by “memory” (primarily HBM: High Bandwidth Memory). It is no exaggeration to say that the reality of modern AI chips is no longer just computing processors, but “massive clusters of ultra-fast memory.” ...