Shorter observations
Notes
Things I am learning, questions I am carrying, and explanations that do not need to become full essays.
Infrastructure
Why everyone keeps talking about HBM
The memory beside the GPU is becoming as strategically important as the GPU itself.
Infrastructure
What actually is an AI cluster?
A cluster is not a pile of accelerators. It is a coordinated machine whose network often decides how useful it is.
Politics
A thought about sovereign AI
Countries want domestic AI capacity, but ownership and genuine operational independence are not the same thing.
Infrastructure
Three things I learned from recent inference papers
Serving performance is mostly a story about memory movement, scheduling, and the shape of demand.