The Hard Truth About AI

I have spent an extraordinary amount of time over the last two years analyzing AI — whether AI will really produce productivity, if the capital spending spree will generate a reasonable return on invested capital, etc.

The more than 260 “More Tales From Nvidia” columns I have written are literally the tip of the analytical iceberg. However, the nuts and bolts and intricacies of demand and supply, complicated chip pricing (e.g. rent for the H100 Index closed at $2.88 and rent for the more recent GPU8300 is at $7.65), the depreciation/”half life” of chips (GPUs depreciate in only 4-6 years but the underlying debt lives on much longer!), how soon will broad AI adoption take place and whether the “marginal” neoclouds should even exist (their cost of capital is too high and hyperscalers (Microsoft ($MSFT) and Google ($GOOGL) have been building data centers for more than two decades and in all likelihood they won’t ultimately need neocloud providers), would send your heads spinning and I would lose most of readers in the first paragraph.

As an aside, one of the reasons I am so critical of the business media’s superficial coverage of AI investing is that I am 100% certain that the AI knowledge base of the circus barkers recommending tech companies on Fin TV is miles long but only inches deep. They generally repeat glittering generalities and made-up Perma Bullish narratives that lack substance and analysis. (This observation also applies to the pied pipers Dan Ives and Tom Lee. No change in financing or fundamentals impedes their eternal optimism!)

Below is from the firm Vital Knowledge — it is an excellent synthesis of what the ongoing and underlying problem is weighing on the AI situation.

Amid all the noise around AI, the underlying problem for the industry is one that’s been present for a while: AI growth is dependent on capex (this is one of the most capital-intensive industries ever) and since capex is dramatically outpacing op. cash flow, companies are reliant on the largess of equity and debt investors to underwrite all the spending, but lately those markets are becoming increasingly less accommodating.

Because the issuance landscape for debt and equity has deteriorated materially, this will inevitably lead to a reduction in aggregate spending (the pool of capital willing to pay for everything is smaller than before, at least for now).

It used to be that investors could focus myopically on the big headline AI numbers (user growth, ARR, backlog, etc.), but that no longer suffices as these top line metrics are impossible to sustain/realize without funding, and that funding is now a lot more precarious.

The biggest players are putting the pedal to the metal, hoping to capitalize on the turmoil to squeeze (via crowding out) weaker vendors – this is why Musk talked about bringing 10GW+ of compute online next year for SpaceX while Meta tweaked up its 2026 capex budget and hinted at another huge number in 2027.

The argument can be made that this funding issue will soon pass because underlying demand is so strong, but it’s important to note that a lot of the demand is a function of that funding (i.e. loss-making companies are fueling a big chunk of token consumption).

It can’t be overstated how important Anthropic and OpenAI are – they remain the suns around which the whole AI world rotates and if these companies can’t come public on the terms anticipated by bulls (in terms of timing and valuations), there will be negative fallout for everyone due to 1) less money available to spend on compute and 2) a lower benchmark for sector valuations.

Compute is fungible, and the capacity being built for Anthropic/OpenAI could be repurposed over time if they don’t fill it, but that process won’t be quick or painless.

Position: None

More Bullish Tech Headlines

In addition to the well-received SpaceX ($SPCX) headlines detailed last night (SpaceX Climbs as Musk Floats Tesla Merger), some other stories are boosting Tech shares this morning:

Shares of server maker Super Micro Computer ($SMCI) are up over 12% premarket after the firm released preliminary quarterly numbers for the period ending September 30, saying it expects revenue of $18.5 billion to $19.5 billion for the quarter. That compares with its earlier forecast of $14.5 billion to $15.5 billion and an average analyst estimate of about $15 billion. The company also raised its gross margin forecast to 12% to 12.5%, from 10.4% to 10.8%

In addition, the Wall Street Journal is reporting that Anthropic’s draft prospectus signals coming spending on computer and power of as much as $750 billion in coming years, with $111 billion on contracts with Alphabet’s Google Cloud ($GOOGL), $110 billion with Amazon Web Services ($AMZN) and $31 billion with Microsoft ($MSFT) “regardless of actual usage.”

Anthropic also agreed to spend up to $86 billion renting Nvidia ($NVDA) chips from smaller AI cloud providers Nscale and Lambda.

And sales are growing at a blistering pace. The Journal reported revenues had grown to $16.3 billion in the six months ended June 30, up from $1.1 billion in the year-earlier period. That outpaced the nearly $9 billion on computing capacity and infrastructure, up from $2.3 billion.

Still it recorded a net loss of $80.7 billion, the vast majority ($72 billion) “tied to changes in the value of convertible notes and other instruments the company issued to raise funding.”

And finally, several Asian countries with large tech exposure (South Korea, Japan, Taiwan, etc.) are reporting strong export numbers led by semiconductor and other Tech shipments.

  • Bloomberg reports that South Korea’s exports the first 20 days of October, adjusted for working-day differences, rose 65.9% from a year earlier. While down from the 89.8% increase during the same period in September, it is otherwise a record. Semiconductors surged 222.5% from a year, while products increased 68.3%, and automobile exports almost 41%.
  • Also from Bloomberg, Japan’s September export growth rose 16.7% from a year earlier. While it missed expectations for a 21.2% increase, shipments of semiconductors and chip-making equipment surged 49.4% and 43.9% respectively (autos were +15.1%). Shipments to the US gained 22.9%. Those to China and the European Union advanced 8.6% and 10.5%, respectively.
  • Reuters reports that Taiwan’s export orders jumped 62.4% in September to a record $114.21 billion “credited to strong demand for AI, high-performance computing and cloud services applications.” The Ministry of Economic Affairs forecast October as rising between 62% and 67%. “Taiwan’s orders ​in September for telecoms products were up 87.3% from ​a ⁠year earlier, while those for electronic products jumped 71.0%.”