COMPANY
Epoch AI
Overview
Epoch AI is a research organisation publishing data and analysis on AI compute, hardware, and the economics of frontier model development. In the corpus, Epoch is most often cited as a third-party data source (alongside llm-stats and the Aider polyglot leaderboard) that keeps publishing as canonical trackers like Aider slow down. On May 25, 2026, Epoch’s “AI chip component cost shares” data insight quantified the HBM-vs-logic-die cost shift that the NVIDIA / SK Hynix / TSMC / Samsung supply chatter had been pointing at for months.
Timeline
- 2026-05-25-AI-Digest — Epoch AI publishes a data insight showing HBM at ~63% of AI chip component costs, up from 52% in Q1 2024, with the rest of the bill of materials dominated by logic die and advanced packaging. The post lands on HN at 341 pts / 361 cmts and pairs cleanly with the NVIDIA / SK Hynix / TSMC / Samsung supply story. The digest’s load-bearing framing is “memory replaces fab capacity” is too clean — it’s HBM + CoWoS together — the binding constraint is HBM + TSMC’s CoWoS 2.5D advanced packaging jointly, not memory alone displacing fab capacity. CoWoS capacity has been sold out through 2026 alongside HBM allocations; HBM stacks deliver their bandwidth advantage only when integrated into a 2.5D package. The accurate practitioner read is “logic-die fab is no longer the sole bottleneck — HBM and CoWoS packaging are now jointly binding” — which keeps NVIDIA’s recent earnings framing intact and explains why hyperscaler capex bumps cite component prices rather than wafer starts.
Key Developments
-
HBM Cost-Share Data Insight (May 25, 2026): Epoch AI’s quantification of HBM growing from 52% (Q1 2024) to ~63% (today) of AI chip component cost is the cleanest single public data point for the memory-vs-fab bottleneck question. The data maps to per-package HBM stack counts climbing (H100 had 5–6, current-generation parts push higher) and HBM3E/HBM4 unit prices reflecting the multi-year capacity crunch.
-
Reference-Data Role Inside the Corpus: Epoch AI is one of the third-party trackers (alongside llm-stats) that have continued publishing data while the canonical Aider polyglot page has gone stale (last-updated November 20, 2025 as of May 25, 2026). The bottleneck-cost insight is the first time Epoch surfaces as a substantive source rather than a passing reference in this corpus.