Infrastructure · 6 Jul 2026
What is the unit of AI demand?
John’s early-July thesis traced the economics of AI from a completed task through software, memory, compute, interconnect and power.
Start with what a customer buys. It might be a code change, a scientific result, a decision inside a business or an hour of useful physical work. Each has a deadline, a cost and a way to tell whether the job was completed. Tokens are one of the inputs.
Work that lasts for hours needs permissions, state, memory, tools and recovery. Those requirements travel upstream into network bandwidth, cache, accelerators, cooling and power. The companies in that chain can face very different economics even when demand for the finished job keeps growing.