PwC: Global AI data center spending to hit $31.6tn by 2050; Role of full stack orchestration layer explained

The AI infrastructure boom is set to continue as per most market research firms. AI chip and compute server upgrade cycles will necessitate the continued spending of many hundreds of billions of dollars on AI compute infrastructure for the foreseeable future.

Global data center spending is set to reach US$31.6 trillion through 2050 to meet the world’s growing appetite for artificial intelligence (AI), an investment boom with no precedent in history, PricewaterhouseCoopers LLP (PwC) said in a report released on September 2, 2026.  Dwarfing projects such as the railways, Internet and electrification, spending on data centers could even hit US$50 trillion over the next two-and-a-half decades if AI adoption accelerates beyond PwC’s “central scenario” forecast, the professional service/accounting firm said.   For comparison, US GDP is about US$30 trillion.

An Amazon Web Services data center in Sterling, Virginia. Photo: AFP

With consumers, companies and governments increasingly using AI, tech giants such as Microsoft Corp and Amazon.com Inc and smaller data center providers are setting up new computing facilities across the planet at a rapid clip. The bulk of the spending would go into what fills the data centers — hardware from companies such as  AI chip leader Nvidia Corp.

At least 75 projects, worth about US$130 billion combined, were blocked or delayed by local opposition during the first three months of this year, according to research group Data Center Watch.

“AI infrastructure is becoming one of the defining capital allocation challenges of the next generation,” said Clara Cutajar, global infrastructure leader at PwC Australia. “It cuts across technology, energy, real estate, supply chains, regulation and financing. This changes how infrastructure investors need to think about capital requirements, risk and returns.”

At the same time, the tech industry is trying to blunt a backlash against data centers that threatens to slow down the buildout.  Protesters cite concerns about environmental impacts, resource consumption and more broadly how AI could upend employment and society.  The U.S. would capture nearly half the projected data center spending, at US$15.1 trillion, PwC said.

The Asia-Pacific region would follow at US$8.2 trillion, Europe at US$5.6 trillion, the Middle East at US$1.1 trillion and Africa at US$255 billion of the cumulative capital expenditure, PwC’s inaugural Global Data Center Outlook showed.

“Railways. Electrification. The Internet. Each required enormous amounts of capital and defined an era,” the researchers said in the report. “The AI infrastructure cycle under way dwarfs all three. This one resets every four to six years — and shows no signs of ending.”

On an annual basis, global data center spending would increase from about US$800 billion this year to US$1.1 trillion in 2030 and US$1.8 trillion in 2050, PwC predicted.

China and India would drive the largest share of incremental demand, supported by large populations, rapidly expanding digital economies, and substantial headroom for AI to embed in business and consumer activity.

While global demand is strong, factors such as power availability, data sovereignty requirements and the flow of semiconductors would determine which regions capture the investments, PwC said.  Power would be the foremost factor that shapes where AI infrastructure investment occurs.  Indeed, much of the forecast hinges on how fast reliable electricity supply for data centers can be established, the report said.  Affordable, reliable, and increasingly low-carbon electricity at scale is the hardest requirement for many markets to meet.

While the market researchers’ projection assumes a fairly open trading system where chips move freely across borders, disruptions in semiconductor supply chains could cut global investment by nearly 20 percent, they said. Meanwhile, a growing sovereignty push could redistribute, but not reduce, global investment.

“The US$31.6 trillion question isn’t whether the capital exists. It does,” the researchers said. “Nor is the question whether the demand is real. It is. The question is which regions, operators and institutions are positioned to capture it and which aren’t.”

Analysis- Where Will the Money Come From?

OpenAI and Anthropic, the two poster-children for Western frontier AI development, routinely divulge soaring annualised revenue run-rates, but these only give a vague indication as to how things are actually going.

An LLM maker that has had a particularly good month can simply multiply that monthly figure by 12, resulting in a run rate that gives the impression that sales are booming.  Two Bloomberg articles from August illustrate this distortion.

The first reveals that Anthropic’s actual revenue reached $11.5 billion in Q2, up from $4.73 billion in prior quarter, giving a total of $16.23 billion for the first half. 

The second cites sources claiming Anthropic’s run-rate puts it on track to turn over $65 billion this year.

…………………………………………………………………………………………………………………………………….

Full Stack Orchestration Layer:

The pace and scale of an unprecedented data center buildout is leading to challenges across the infrastructure lifecycle. These challenges point to a need for a single accountable orchestration layer, one designed to manage the seams across the delivery stack. PwC refers to this role as a full-stack orchestrator, a delivery platform that sets the standards, manages the integrated schedule, governs risk and change, and defines how acceptance is measured across the project.

Key Takeaways:

  • PwC estimates $5.1 trillion will be invested in data centers in the five years ending 2030 and around $32 trillion over the next 25 years depending on AI adoption.
  • Turning that capital into usable megawatt capacity means overcoming the industry’s biggest delivery failures around power, equipment, cooling, construction, commissioning, and compute.
  • A full-stack orchestrator can turn fragmented delivery into a repeatable platform by owning standards, schedules, risk, change control, and acceptance across the entire data center build.

…………………………………………………………………………………………………………………………………….

References:

https://www.taipeitimes.com/News/biz/archives/2026/09/04/2003863640

https://www.pwc.com/us/en/industries/energy-utilities-resources/full-stack-data-center-orchestrator.html

https://www.telecoms.com/ai/no-relief-in-sight-as-pwc-sees-ai-capex-reaching-31-6trn-by-2050

Big tech spending on AI data centers and infrastructure vs the fiber optic buildout during the dot-com boom (& bust)

AI Data Center Boom Carries Huge Default and Demand Risks

Expose: AI is more than a bubble; it’s a data center debt bomb

Will billions of dollars big tech is spending on Gen AI data centers produce a decent ROI?

How will fiber and equipment vendors meet the increased demand for fiber optics in 2026 due to AI data center buildouts?

China vs U.S.: Race to Generate Power for AI Data Centers as Electricity Demand Soars

AI Compute Has a Switchboard Problem: Orchestration & Data Center Fabric Explained

Nvidia CEO Huang: AI is the largest infrastructure buildout in human history; AI Data Center CAPEX will generate new revenue streams for operators

 

 

 

 

AI Compute Has a Switchboard Problem: Orchestration & Data Center Fabric Explained

by Gaurav Sharma with Alan J Weissberger

Introduction:

Anthropic [1.] earned more revenue in the second quarter of 2026 than it did in all of 2025. The Claude AI maker company raked in $11.5 billion between April and June 2026, up from $787 million in the year-earlier quarter, $4.73 billion in Q1-2026 and up from ~ $10 billion for the entire previous year.  CEO Dario Amodei told CNBC that the growth had been “just crazy” and “too hard to handle,” with demand far outstripping the company’s ability to build infrastructure with demand racing ahead of the company’s ability to scale infrastructure.

Anthropic is not alone. Bank of America projects that AI compute demand will outstrip supply through 2029. GPU lead times now stretch to 36–52 weeks.

Note 1. Anthropic is an American artificial intelligence startup founded by former OpenAI members that focuses on developing safety-oriented, steerable, and interpretable large language models like the Claude AI assistant.

This is happening even as the industry throws historic capital at capacity. Global data-center capital expenditure (capex) is on track to surpass $1 trillion in 2026, according to Dell’Oro Group. Yet the teams building with AI still cannot procure the compute they need, when they need it, at a price that lets them survive long enough to validate their thesis. The AI compute market has a switchboard problem — and fixing it calls for the same kind of thinking that transformed telecommunications.

The Access Gap:

AI-first startups now devote 40 to 50 percent of revenue to GPU hosting and inference compute, and their gross margins sit between 25 and 60 percent — versus 75 to 85 percent for traditional software companies. Compute has become the single largest cost line for most AI businesses, and it dictates what a team can afford to build.

Meanwhile, meaningful enterprise GPU capacity sits dormant. Teams hoard hardware for fear of losing access, locking accelerators into long-term reservations that sit underused overnight and between training runs. The capacity exists; the coordination does not.

The burden lands hardest on those who cannot afford the reservation game. Founders step down to cheaper hardware that slows their research. Teams cut experiments because they cannot secure enough accelerators. Projects stall while usable compute sits idle behind someone else’s contract. In this environment, access — not merit — decides which ideas reach the market and which never get tested.

From Switchboards to Packet Switching:

The early telephone network was run by hand. Every call required an operator to connect the subscriber — and each call claimed a dedicated circuit for its entire duration, even during silence. It worked, but it was slow, labor-intensive and wasteful.

GPU procurement works the same way today. An AI team identifies the hardware it wants, negotiates a reservation with a hyperscaler — AWS, Microsoft Azure or Google Cloud — and waits for capacity to become available. Each commitment locks a slice of the fleet to a single customer. The process is manual, slow and wasteful.

Telecommunications escaped this model in stages. Automated switching removed the operator; packet switching removed the dedicated circuit. Instead of reserving an entire line for one conversation, the network segmented each message into packets and routed them over whatever path had spare capacity, allowing many conversations to share a single trunk through statistical multiplexing. The same physical infrastructure carried far more traffic because capacity was allocated dynamically rather than reserved in advance.

AI compute needs an analogous shift: an orchestration plane that discovers available accelerators across multiple sources and routes each workload to suitable hardware — without the customer negotiating each connection individually.

It is already taking shape. Vendors are building orchestration systems that aggregate capacity from owned infrastructure, data centres and distributed GPU providers, then present it to the customer as a single service. The customer submits a job; the orchestration layer selects suitable hardware, assembles a cluster and delivers it.

Different Workloads, Different Routing:

Orchestration must be workload-aware. Pre-training the largest frontier models requires thousands of accelerators coupled over low-latency fabrics with precise topology; these jobs will continue to demand dense, purpose-built clusters.

Inference, fine-tuning and research are far more elastic. They tolerate geographic spread and run across a wider, more heterogeneous hardware pool. This mirrors how packet-switched networks treat traffic types differently while carrying them on shared infrastructure: a voice call needs bounded latency and continuity, while an email is routed over whatever path has spare capacity.

That differentiation opens the door for network operators. Data-centre operators and carriers already own much of the physical connectivity — fibre, points of presence, interconnection — needed to knit scattered compute into a coherent supply system. Rather than letting AI infrastructure consolidate into a small number of hyperscalers, the industry can use existing transport and edge assets to link regional data centres and GPU providers into a broader, more liquid market.

Robust Data Center Fabric Required:

The trillions in planned capex should be judged by more than the number of GPUs installed. If new capacity flows mainly to customers who can lock in multi-year reservations, the supply of compute grows even as the population of companies able to use it shrinks — fewer experiments, fewer competing hypotheses, a smaller set of teams shaping what AI becomes.

A healthier market would let AI teams reach compute from multiple providers through a single, well-connected service, with the network doing the work of matching each job to the right hardware — the telecoms discipline of statistical multiplexing applied to the GPU fleet.

Telecommunications offers the template. Every forward step it took made the same physical infrastructure serve more users. AI compute looks ready for the same move. The hardware is there, but is the network that connects it robust enough?

The physical network that connects AI compute servers (GPUs/TPUs) to each other and to high-performance storage is collectively called the Data Center Network (DCN) Fabric.  The physical network is split into two primary layers depending on what is being connected:

1. The Backend Network (Compute-to-Compute):

This is the ultra-high-speed, lossless network that connects AI compute servers (or individual GPUs) to one another. It handles “East-West” traffic—such as gradient exchanges and parameter updates—during massive parallel AI training.InfiniBand: Long considered the gold standard for high-performance computing (HPC). It relies on dedicated, high-speed physical switches and host channel adapters (pioneered largely by NVIDIA/Mellanox). It features native Remote Direct Memory Access (RDMA), allowing systems to exchange data directly from memory to memory without involving the host CPU.AI-Optimized Ethernet (RoCEv2): A highly popular open alternative that uses traditional physical Ethernet cabling and switches but runs RDMA over Converged Ethernet (RoCEv2).

Platforms like NVIDIA Spectrum-X utilize optimized Ethernet hardware to achieve lossless, low-latency performance comparable to InfiniBand.Ultra Ethernet: Driven by the Ultra Ethernet Consortium (UEC), this next-generation physical transport standard optimizes Ethernet specifically for massive scale-out AI environments.

2. The Frontend / Storage Network (Compute-to-Storage):

This network connects the AI compute servers to centralized, high-performance storage arrays (like NVMe-oF, SAN, or NAS systems) to stream massive datasets into the GPUs.High-Speed Ethernet: The physical storage network is predominantly built on high-bandwidth Ethernet (moving rapidly up to 400G and 800G per port).Storage Protocols: It leverages protocols like NVMe-oF (NVMe over Fabrics) or RoCEv2 to pull unstructured data (images, text corpuses) from storage units into the compute cluster at lightning speeds without stalling the GPUs.

Direct Comparison of the Data Center Network Technologies:

Feature InfiniBand Fabric AI Ethernet (RoCEv2 / UEC)
Primary Use Case Tightly coupled GPU-to-GPU training Compute-to-Storage & open scale-out clusters
Physical Hardware Dedicated, specialized switches & optics Standard, widely available Ethernet switches
Data Flow Style Lossless by design (Credit-based flow control) Lossless via configuration (PFC / ECN mechanisms)
Ecosystem Proprietary / Closed ecosystem Open standard, multi-vendor interoperability

………………………………………………………………………………………………………………………………………………….

References:

Telecom data centers must be redesigned for the AI era with rack scale architectures, enhanced power & cooling requirements

Analysis: Ethernet gains on InfiniBand in data center connectivity market; White Box/ODM vendors top choice for AI hyperscalers

Will AI clusters be interconnected via Infiniband or Ethernet: NVIDIA doesn’t care, but Broadcom sure does!

Cisco’s Silicon One G300 as the dominant AI networking fabric, competing with Broadcom’s Tomahawk 6 series

Big tech spending on AI data centers and infrastructure vs the fiber optic buildout during the dot-com boom (& bust)

2026 TPI Aspen Forum: challenges and risks of scaling AI, managing power infrastructure and permitting

The 2026 TPI Aspen Forum, hosted by the Technology Policy Institute from August 16–18 at the St. Regis Aspen Resort in Aspen, Colorado, placed a heavy focus on the intersections of artificial intelligence (AI), regulatory strain, and the massive energy demands driving the next phase of tech development.  Furthermore, panelists warned that the immense power and capital requirements for data centers could trigger consumer ratepayer backlash and create antitrust risks by consolidating power among a few large incumbents.  A cybersecurity bug apocalypse might be looming as AI (artificial intelligence) models begin to find long-dormant software flaws, but for now the big AI developers have limited access to their most cyber-capable models to keep the flood of new vulnerabilities in check, according to the panelists.
………………………………………………………………………………………………………………………………..
There was also a spirited discussion about the U.S. lead in Quantum computing, but that’s beyond the scope of this IEEE Techblog article.

The critical highlights regarding AI and power infrastructure include:
1. The AI Power Grid Dilemma: “Who Pays and Who Builds:”
A central panel, Meeting AI’s Power Demand: Who Pays and Who Builds, tackled how the exploding energy requirements of AI data centers have directly collided with aging electrical grids and contested rate cases. 
    • Siting Constraints: Speakers noted that power availability has become the primary bottleneck for AI data center expansion, dictating where new infrastructure can realistically be built. 
    • Economic Tension: Severe debates surfaced around funding. Grid upgrades are hitting friction due to the politics of utility rate increases—specifically over whether everyday consumers or massive tech firms should shoulder the multi-billion-dollar costs.

2. Supply Chain and Permitting Bottlenecks:
The buildout of AI-enabling infrastructure is trickling down to affect the broader telecom and broadband industry. [1]
    • Resource Competition: Internet Service Providers (ISPs) at the forum expressed mounting concerns that the sheer scale of the AI data center buildout is worsening supply chain costs and causing significant permitting delays for standard broadband networks. 
    • Following the recent sale of its residential fiber business to AT&T, Lumen Technologies is facing permitting issues as it looks to expand its network to support billion-dollar deals with hyperscalers and enable a wide range of AI use cases. After exiting 2025 with about 17 million fiber miles, Lumen is projected to expand that to 58 million fiber miles when it exits 2031, explained Melissa Mann, Lumen’s chief public policy officer.
    • “It’s not just an engineering question. It’s really a policy question and our ability to meet these demands,” Mann said, noting that it’s not clear whether Lumen will be able to obtain all the permits required to build as quickly as the hyperscalers want it to. “If we’re actually going to do this and double our fiber capacity across the industry, we’ve got to fix permitting,” Mann added.
    • Giulia McHenry, SVP for public policy at AT&T, said the network operator has seen a 15% increase in overall data traffic since 2023, though not all is AI-related. “But we are ensuring that we’re ready for AI to cross our networks,” she said.
    • Mann noted that up to 50% of Internet traffic on Lumen’s network is being driven by autonomous AI agents.  Noting that delivering service at low latencies is becoming table stakes, not a special feature, she added, “Latency is no longer a preference. There’s a floor on latency for many of these [AI] use cases and applications.” 

3. Upstream AI Antitrust Risks:
Regulatory eyes are shifting away from the user-facing AI models and moving directly toward the infrastructure layer.
    • Upstream Focus: Federal Trade Commission (FTC) Chairman Andrew Ferguson noted during his fireside chat that the most significant competitive and antitrust risks in artificial intelligence do not lie among competing AI models themselves, but rather upstream in the control of data, chips, and power infrastructure. 
    • Mann said 90% of Lumen’s customers now use more than one AI provider and more than one cloud provider. The ability to give them more control was a primary driver of Lumen’s recent acquisition of Alkira, a company that enables partners to orchestrate and move their data to different clouds and AI providers via a single pane of glass. In practice, that means that if an enterprise sees energy prices spike in Virginia, it can shift workloads to another region where energy costs are lower and where ample capacity is available, she explained.

4.  Supply chain issues:

    • Supply chain costs are “skyrocketing,” said AT&T’s McHenry, noting that a large data center might use as much fiber as the company lays down in a year.
    • Supply chain constraints, particularly on memory, also impact broadband customer premises equipment (CPE), said Mark Walker, VP of technology policy at CableLabs“As we are building those additional network miles and upgrading our networks, that increase in memory costs flows directly through to the capital costs and the ability to deliver services,” Walker said.
    • “If broadband service providers are forced to pass along those hidden costs without measurably improving the service, customers will become frustrated,” added Harold Feld,  SVP at Public Knowledge, a consumer advocacy group.
    • Customer Premises Equipment (CPE) makers face mounting operational challenges due to global memory chip shortages. Also, the FCC ban on new foreign-produced WiFi  routers, forces hardware developers to navigate complex recertification workflows to secure conditional regulatory approvals for redesigned router models. Manufacturers must re-apply for compliance clearances following any major component substitutions.

………………………………………………………………………………………………………………………………………………………………………

References:

https://www.tpiaspenforum.tech/

Dell’Oro: Data Center Physical Infrastructure revenue to grow at 22% CAGR from 2025-2025/forecast comparisons, analysis, risks

According to Dell’Oro Group, global Data Center Physical Infrastructure (DCPI) manufacturer revenue is projected to grow at a 22% compound annual growth rate (CAGR) from 2025 to 2030, reaching $120 billion by the end of the period. This growth is driven by net additions to installed IT capacity, which account for the large majority of the forecast. Additionally, the infrastructure content per megawatt will have a smaller effect as higher-density and liquid-cooled architectures redistribute spend across DCPI categories.

“The AI buildout has moved past the point where it can be treated as a surge. It is now the baseline against which the rest of the market is measured,” said Alex Cordovil, Research Director at Dell’Oro Group. “What has changed in this forecast is where the risk sits. Demand is no longer the open question—delivery is. Equipment lead times, construction labor, grid interconnection, and community consent all remain constrained, especially with the first statewide data center moratorium now in force.”

Additional highlights from the Data Center Physical Infrastructure 5-Year July 2026 forecast report:

  • Capacity Additions Peak in 2026: Annual net capacity additions peak in year-over-year growth terms in 2026 and moderate steadily thereafter, remaining in double-digit growth territory through 2030. The market is still expanding quickly, but no longer accelerating. North America leads capacity additions over the period, followed by China.
  • Thermal Management Leads Segment Growth: Thermal Management remains the fastest-growing DCPI segment, with liquid cooling the fastest-growing technology as rack densification moves the technology from an option to a precondition. Heat rejection coverage has been expanded in this edition, with water-cooled chillers expected to grow faster than air-cooled units on scalability rather than efficiency. Chillers remain a staple of data center specifications, even in warm-water designs, since free cooling loses effectiveness during the hottest days of the year.
  • UPS Growth Concentrates in Larger Systems: Growth within the UPS segment concentrates in higher power rating three-phase systems, which are expected to expand faster than smaller units as the larger building blocks of AI clusters push deployments up the capacity curve. Medium-voltage designs are gaining ground, connecting UPS systems closer to the grid and attracting new entrants alongside established suppliers. Solid-state transformers are projected to weigh meaningfully on UPS demand beginning in 2029, initially focusing on large AI factories that have largely moved away from UPS-based architectures.
  • Hyperscalers and Colocation Anchor Demand: Hyperscalers end the period as the largest single contributor to DCPI revenue, although their growth has slowed compared to the pace seen in 2025–26, as they lean more heavily on colocation partners to serve workloads, particularly outside the United States. Colocation remains central to the buildout, and the spread of powered shell development is shifting equipment procurement onto the tenant, moving revenue among customer segments without altering building occupancy. Newly separated in this forecast, AI-specialized Cloud—the neoclouds and AI model builders—becomes one of the fastest-growing lines in our coverage. Enterprise demand continues to grow, but more slowly than the rest of the market.
  • Regional Diversification Builds: North America continues to lead regional growth, with China the next largest contributor. EMEA is the only region revised downward from the January forecast, reflecting slower power availability and a more difficult permitting environment. Community opposition has become a material constraint on siting, blocking or delaying a meaningful share of announced projects. Together with the expected repricing of U.S. natural gas, are expected to support faster growth in CALA and Asia Pacific excluding China.

About the Report

Dell’Oro Group’s Data Center Physical Infrastructure 5-Year Forecast report provides a complete overview of the Data Center Physical Infrastructure market. This covers market sizes and forecasts for uninterruptible power supplies (UPS), thermal management, cabinet power distribution and busway, rack power distribution, IT racks and containment, and software and services. Allocation of manufacturer revenues by hyperscaler, other cloud, colocation, telco, and enterprise customer segments is also provided, alongside a forecast of data center capacity additions by region. For more information about the report, please contact us at [email protected].

………………………………………………………………………………………………………………………………………………………………………………………

Forecast Comparisons: 

Dell’Oro’s $120 billion DCPI forecast through 2030 is at the high end of published physical-infrastructure manufacturer-revenue estimates, but it is directionally consistent with other firms’ forecasts for adjacent power, cooling, and mechanical/electrical (M&E) categories. The differences largely reflect market definition: DCPI is not interchangeable with total data-center capex, construction, IT equipment, or facilities real estate.

The 22% Dell’Oro CAGR should not be read as a consensus CAGR for every DCPI component. Power equipment forecasts around 7.5% and broader support-infrastructure forecasts around 8.2% suggest more moderate growth in legacy categories, while AI-linked liquid cooling is projected to grow in the mid- to high-teens.

The key forecasting judgment is therefore AI infrastructure content per MW: if GPU density keeps climbing and liquid cooling, high-voltage distribution, energy storage, and modular power systems become standard rather than niche, DCPI revenue can grow substantially faster than data-center floor space or even installed MW. Conversely, grid constraints, AI-demand normalization, and lower equipment dollars per watt from scale and engineering improvements could constrain manufacturer revenue growth even as deployed capacity continues to expand.

Comparable Forecasts:

Firm / forecast scope Forecast How it relates to DCPI
Dell’Oro Group — DCPI manufacturer revenue $120 billion by 2030; 22% CAGR, 2025–30 Broad physical infrastructure equipment, including power, cooling and related facility systems.
Grand View Research — data-center support infrastructure $92.2 billion by 2030; 8.2% CAGR, 2025–30 Includes UPS/generators, cooling, racks/enclosures, and monitoring. Lower growth likely reflects an earlier/base definition and different vendor-revenue coverage.
MarketsandMarkets — data-center power $50.5 billion by 2030, from $35.1 billion in 2025; 7.5% CAGR A major DCPI subsegment: UPS, PDUs, generators, energy storage, power-management software/DCIM.
MarketsandMarkets — data-center cooling $37.6 billion by 2033, from $13.2 billion in 2026; 16.1% CAGR Cooling is a DCPI subsegment; its faster growth reflects the transition toward liquid cooling for AI racks.
MarketsandMarkets — U.S. cooling $16.6 billion by 2030, from $4.9 billion in 2025; 19.1% CAGR Indicates that the AI-heavy U.S. market is expected to outpace the global cooling average.
McKinsey — data-center M&E procurement and installation More than $250 billion of cumulative spending by 2030 This is spending, rather than annual manufacturer revenue, but it corroborates the scale of the opportunity for electrical and mechanical infrastructure.
Omdia — total data-center capex Nearly $1.6 trillion in 2030; 17% CAGR from 2025 Much broader than DCPI—includes IT/compute and other capital expenditure—but demonstrates the investment envelope supporting physical-infrastructure demand.

A useful interpretation is that Dell’Oro’s $120 billion is plausible only if the market increasingly captures high-value AI-ready electrical and thermal systems—not merely traditional UPS, air-conditioning, and rack revenue. Adding standalone power and cooling forecasts cannot produce a clean “DCPI total,” because analysts differ in whether they include services, software/DCIM, integration, installation, generators, switchgear, rack infrastructure, and edge facilities.

………………………………………………………………………………………………………………………………………………………………………………………………………..

Image Generated by Perplexity.ai

…………………………………………………………………………………………………………………………………………………….

Analysis – main spending drivers:

  • AI accelerator density. GPU/accelerator clusters raise rack power from conventional enterprise levels to much higher levels, increasing demand for power distribution, UPS capacity, switchgear, busways, backup generation, and energy storage. ABI Research expects AI-dedicated active data-center capacity to rise from 11.5 GW in 2026 to 43.6 GW in 2031, and projects that AI will represent more than half of total data-center capacity in the early 2030s.

  • Shift from air cooling to liquid cooling. Higher-density AI systems cannot be served economically—or sometimes technically—by conventional room-level air cooling alone. Direct-to-chip cold plates, coolant-distribution units, rear-door heat exchangers, liquid loops, heat-rejection equipment, and controls raise cooling-system content per MW. Cooling equipment is therefore forecast to grow faster than the more mature broad power-equipment category.

  • Rapid capacity additions by hyperscalers and colocation operators. JLL expects roughly 97 GW of data-center capacity to be added globally from 2025 to 2030, approximately doubling the sector to about 200 GW. Every new MW requires a physical plant, even where the IT stack is sourced separately.

  • Power availability is becoming the binding constraint. Global data-center electricity consumption is expected to roughly double to 945 TWh by 2030 in the IEA base case. This puts a premium on grid interconnection equipment, substations, medium-voltage distribution, on-site generation, batteries, and energy-management systems—and can cause operators to overbuild or deploy infrastructure earlier than their server installations.

  • Resilience requirements and time-to-power. AI facilities require high availability alongside enormous load ramps. Operators are spending on redundant electrical paths, backup generation, battery systems, microgrids, and modular/skid-based electrical infrastructure to shorten construction schedules and reduce exposure to grid-connection delays.

  • Retrofitting the installed base. Demand is not solely greenfield. Existing hyperscale, colocation, and enterprise sites must upgrade electrical distribution and thermal plants to host AI pods, often retaining conventional infrastructure for legacy workloads while adding liquid-cooling islands.

  • Efficiency, water, and carbon constraints. Higher energy costs, grid constraints, water availability, and sustainability targets push investment toward more efficient thermal architectures, heat reuse where feasible, advanced controls, and power-management systems. These are often capital-intensive even when they lower lifetime PUE, water use, or operating cost.

……………………………………………………………………………………………………………………………………………………………….

Huge Risks to the forecast:

The central downside to Dell’Oro’s forecast is an AI-demand and funding reset: if OpenAI, Anthropic, or other frontier-model providers fail to turn extraordinary usage growth into durable, high-margin cash flows, capacity commitments could be deferred, resized, or cancelled. Because the DCPI forecast assumes nearly 200 GW of added data-center capacity through 2030, even a partial reduction in the AI build plan would materially affect power, cooling, and electrical-equipment orders.

The OpenAI/Anthropic risk:

The potential issue is not that either company vanishes overnight. It is that they—and the hyperscalers and GPU-cloud firms supporting them—may discover that the revenue and gross-margin trajectory does not justify the scale of previously contracted compute.

The risk chain is: AI monetization miss→lower compute utilization / pricing→capex deferrals→fewer energized MW→lower DCPI revenue.

The exposure is unusually concentrated. Advanced AI demand is dominated by a small number of hyperscalers and frontier-model providers; McKinsey estimates that 60–65% of AI workloads in the United States and Europe will be hosted on hyperscaler infrastructure by 2030. Thus, a retrenchment by a few large buyers can have an outsized effect on the physical-infrastructure supply chain.

Why OpenAI is a focal point:

OpenAI’s downside case would be a mismatch between compute obligations and customer monetization:

  • Consumer AI usage may remain high, but paid conversion, enterprise seat expansion, API volume, or willingness to pay for frontier-model performance may disappoint.

  • Inference costs may not decline fast enough relative to prices, leaving growth without attractive contribution margins.

  • New models may yield diminishing commercial differentiation, shortening product cycles and weakening customers’ willingness to pay premium prices.

  • Its financing requirements could become harder to meet if capital markets reassess terminal valuations, the cost of debt rises, or strategic partners limit exposure.

Some reporting and commentary point to very large continuing compute costs and funding needs relative to reported revenue, but the precise economics are opaque because OpenAI remains private and uses non-GAAP and run-rate measures inconsistently across reports. That opacity is itself a risk: DCPI vendors can see announced projects and committed capacity, but cannot fully observe the ultimate cash-flow support for the tenant’s demand.

Why Anthropic is not a complete hedge:

Anthropic’s enterprise orientation and reported revenue growth could diversify the sector’s demand base, but it does not eliminate systemic risk. It faces many of the same conditions:

  • Revenue is substantially concentrated in a relatively early enterprise-AI adoption cycle.

  • Enterprise customers can trial models broadly but consolidate suppliers quickly if performance differences narrow.

  • Model-price competition could reduce revenue per token or per API call faster than cost-per-token declines.

  • Large training runs are discretionary. A pause in the cadence of frontier-model releases would immediately reduce the urgency of new GPU clusters and associated electrical/cooling plant.

Recent reports describe unusually rapid revenue expansion and positive adjusted operating income for Anthropic, but the sustainability and definition of those measures are not independently transparent in the way public-company financial statements are. The relevant question for DCPI is not just whether Anthropic grows revenue, but whether its long-term contracted compute load and its own capital support remain sufficient to sustain multi-year facility commitments.

Other downside mechanisms:

An AI crash is the sharpest downside scenario, but Dell’Oro’s bullish outcome also depends on several more gradual assumptions.

Risk Mechanism affecting DCPI Most exposed categories
AI ROI falls short Enterprises limit production deployments after pilots, lowering inference demand and cloud capacity leasing New builds; colo expansion; modular power and cooling
Model efficiency improves faster than demand Better algorithms, smaller models, quantization, inference optimization, and improved chips reduce compute per task Incremental MW; high-density cooling demand
AI pricing deflation Competition compresses model/API prices, impairing lab and GPU-cloud economics despite increasing usage Customer-funded greenfield projects
Hyperscaler capex discipline Microsoft, Amazon, Google, Meta, and others rationalize investment after overbuilding Large electrical lineups, transformers, UPS, generators
GPU-cloud credit risk Providers with concentrated customers or leased GPUs struggle to refinance Build-to-suit data centers and equipment tied to one tenant
Power and permitting delays Announced campuses cannot be energized on schedule; equipment ships later or projects are abandoned Grid interconnection, switchgear, generators, on-site power
Community and regulatory resistance Moratoria, water restrictions, and power-cost concerns reduce feasible site inventory Greenfield DCPI, especially in constrained markets
Supply catches demand The current equipment backlog and capacity scarcity unwind, creating price and utilization pressure Standardized power and cooling equipment

Dell’Oro itself reportedly frames the immediate risk as delivery—equipment lead times, construction labor, grid interconnection, and community consent—rather than demand. Those bottlenecks can cut near-term revenue even if AI demand is real, because DCPI is recognized when facilities are physically delivered and commissioned, not when a GPU cluster or capacity plan is announced.

Efficiency is a double-edged sword:

Dell’Oro’s premise benefits from high rack density: AI systems require more substantial electrical architecture and move cooling from conventional air systems toward liquid cooling. McKinsey notes that direct-to-chip cooling can address roughly 60–120 kW racks, and that immersion can support still higher densities; those architectures increase DCPI content per rack and often per MW.

But efficiency can reverse the volume implication. Better accelerators, model distillation, mixture-of-experts approaches, lower-precision inference, and power-system improvements can reduce electricity and infrastructure required per unit of AI output. The IEA explicitly models a “High Efficiency” pathway in which technology and software efficiency gains materially restrain data-center electricity demand, while its “Headwinds” case assumes slower AI uptake and capacity growth that plateaus beyond 2030, with efficiency offsetting much of the effect of increased IT use.

The key analytical distinction is:

  • Revenue per MW can rise because AI racks need liquid cooling, high-capacity UPS, switchgear, busways, and sophisticated controls.

  • Total MW deployed can fall if model efficiency improves or commercial demand disappoints.

Dell’Oro’s $120 billion outcome requires both substantial net new MW and elevated DCPI content per MW. A positive outcome on only the second factor would not fully protect the forecast.

What would signal trouble:

For a forward-looking DCPI thesis, monitor leading indicators rather than announced headline capex:

  • OpenAI and Anthropic: paid enterprise adoption, API demand, realized—not merely annualized—revenue, gross margin, cash burn, and financing terms.

  • Hyperscalers: capex guidance, AI-service revenue, remaining performance obligations, capacity utilization, and disclosure of power or data-center commitments.

  • GPU-clouds and colocation firms: customer concentration, lease pre-commitments, cancellations, financing costs, and the ratio of contracted versus speculative capacity.

  • Physical deployment: utility interconnection queues, energized MW rather than planned MW, transformer/switchgear order cancellations, and data-center construction starts.

  • Economics: inference price declines versus cost declines, GPU utilization, and evidence that enterprise AI deployments generate measurable productivity or revenue returns.

A particularly bearish signal would be simultaneous model-price deflation, falling GPU utilization, and delayed data-center energization. That combination would mean the sector is not merely supply constrained; it would imply that the financial rationale for capacity has weakened.

Bottom line:

A failure by OpenAI or Anthropic to meet expectations could trigger a classic capital-cycle correction: capacity was ordered on expectations of demand, but the cash flows needed to validate the investment arrive later, at lower margins, or not at all. In that scenario, DCPI’s most vulnerable segments are discretionary greenfield power and cooling deployments attached to single large AI tenants or thinly capitalized GPU-cloud providers.

However, a single lab’s disappointment would not necessarily collapse the entire market. DCPI demand also comes from hyperscaler internal workloads, enterprise AI, cloud migration, conventional data growth, colocation expansion, and infrastructure upgrades. The most likely downside is therefore a lower and lumpier growth path, with project delays and inventory/order corrections, rather than zero growth. The more severe Dell’Oro downside requires a broad AI-ROI failure that causes multiple frontier labs and hyperscalers to retrench at the same time.

References:

Data Center Physical Infrastructure Market Forecast to Reach $120 Billion by 2030, According to Dell’Oro Group

Dell’Oro: 2H2026 Data Center Capex to Accelerate due to massive AI Deployments

Nvidia CEO Huang: AI is the largest infrastructure buildout in human history; AI Data Center CAPEX will generate new revenue streams for operators

Huge Risks for the proposed $500B AI Investments from Giant Wall Street firms

Expose: AI is more than a bubble; it’s a data center debt bomb

Will Google Cloud’s AI and data analytics revenue +TPU IP licensing income offset huge AI CAPEX to produce a decent ROI?

Inside Amazon’s new data center network architecture: quasi random network topology and passive optical devices

Big Fiber’s $250M financing deal to buildout dark fiber routes for AI Data Center expansion

Analysis: Ethernet gains on InfiniBand in data center connectivity market; White Box/ODM vendors top choice for AI hyperscalers

Fiber Optic Boost: Corning and Meta in multiyear $6 billion deal to accelerate U.S data center buildout

How will fiber and equipment vendors meet the increased demand for fiber optics in 2026 due to AI data center buildouts?

Huge Risks for the proposed $500B AI Investments from Giant Wall Street firms

Disclaimer: Perplexity.ai was used for research and analysis in this article.

……………………………………………………………………………………………………………………..

Executive Summary:

This past Monday, six giant Wall Street asset managers, private-equity firms and banks announced an effort to raise $500 billion to keep fueling the A.I. boom by financing more data centers, power plants and chips. The proposed platform would direct capital to Nvidia customers—including AI startups and data-center operators—at precisely the point when many have struggled to obtain funding through ordinary credit channels.

We take that as a huge warning sign for the proposed AI investments.  Here’s why: If the underlying projects offered clearly proven cash flows, predictable utilization and collateral with durable value, lenders would not need a specially assembled consortium, headline-scale commitments and Nvidia’s direct involvement to make the loans happen. The initiative appears designed to overcome a financing bottleneck created by the extraordinary gap between AI infrastructure spending and demonstrated AI revenue.

This proposed $500 billion AI-financing initiative is less a validation of durable AI economics than an admission that the sector’s spending plans have outgrown its customers’ ability—or willingness—to finance them conventionally. Rather than demonstrating independently sustainable demand, the arrangement risks extending an investment cycle increasingly dependent on vendor-enabled credit, opaque commitments and financial engineering.

The firms—Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs and KKR—said they were working together to come up with that huge sum to lend to Nvidia’s customers, including the start-ups that use the company’s chips in data centers to develop and operate A.I. software. These customers, Nvidia said, have been struggling to secure financing for chips and data centers.

Nvidia will connect its customers with one of the six lenders, which will provide financing that could range from loans to credit. The financing will be “at attractive rates,” Nvidia said in a blog post.

In practical terms, this is a vendor-financing mechanism, even if the capital technically comes from third parties. Nvidia is helping its customers obtain the money required to buy Nvidia-dependent infrastructure. The more readily startups and data-center operators can borrow, the more equipment they can order; the more equipment they order, the more Nvidia can sell. That does not mean the demand is fictitious, but it does make it harder to distinguish independent end-user demand from demand supported by an ecosystem that is financing itself.

Circularity is the principal concern. When suppliers, investors, cloud providers, AI labs and lenders all have financial incentives to keep capital circulating within the same small group of counterparties, reported growth can look more robust than the ultimate economics justify. The risk is not simply that projects fail individually. It is that a shortfall in AI-service revenues, utilization or pricing could spread simultaneously through hardware vendors, AI developers, cloud operators, private-credit vehicles and the securities backed by their cash flows. Circular financing can blur the line between real external demand and investment-funded purchases.

Executives from the lenders joined Jensen Huang, Nvidia’s CEO & founder, for an unusual, extended interview on CNBC, where they talked up their new, seemingly insatiable desire to finance infrastructure for A.I. Huang said on the air. He added that “A.I. labs” and “A.I. start-ups” would have access to the financing. He did not name those companies or whether Nvidia would receive any money as part of the effort.  David M. Solomon, Goldman’s chief executive, said the consortium was Mr. Huang’s idea.

“We need to raise this money as fast as possible,” said Larry Fink, BlackRock’s chief executive. He also stated: “There’s quite a bit of negativity around A.I. and data centers right now, but let’s be clear: This is going to be creating a huge amount of jobs.”

Skeptical Analysis:

The urgency in those statements deserves more scrutiny. Speed is not a substitute for underwriting, and job-creation claims do not establish that investments will meet their cost of capital. The industry is attempting to finance assets whose useful economic life may be much shorter and more uncertain than that of traditional infrastructure. A GPU fleet can lose competitiveness rapidly when a new architecture, memory standard or systems design emerges. Its resale value can fall sharply if capacity demand weakens. Treating such hardware as collateral comparable to a toll road, utility asset or long-lived building is a major assumption—not an established fact.

The announcement punctuates a head rush on Wall Street and in Silicon Valley into anything that even vaguely resembles A.I. The stocks of tech giants and chipmakers have soared for most of this year, and a pair of the biggest names in the space, Anthropic and OpenAI, are expected to file for initial public offerings that could value them at $1 trillion apiece.

But soaring equity valuations and enormous projected IPO valuations do not answer the basic return-on-investment question: who will pay enough, for long enough, to justify the total cost of the data centers, power plants, networking, GPUs and debt now being assembled? AI vendors may generate impressive revenue growth while still failing to earn enough to cover the depreciation, energy, financing and replacement costs of the infrastructure required to produce it.

Nvidia’s financing narrative appears to conflate broad interest in AI-enabled services with broad, independent demand for capital-intensive AI infrastructure. Governments, enterprises and startups may all seek access to AI capabilities, but the current demand for hyperscale GPU clusters, dedicated power capacity and purpose-built “AI factories” remains concentrated among a relatively small group of frontier-model developers and cloud platforms.

That distinction matters because broad adoption of AI applications does not automatically translate into economically sustainable demand for vast new data-center capacity. Enterprises can consume AI through APIs, hosted platforms, smaller models and open-source software without owning—or financing—dedicated high-density compute infrastructure. Nvidia itself describes demand as spanning enterprises, startups, governments, nations and AI labs, but the critical question for investors is how much of that demand converts into durable, contracted infrastructure revenue rather than experimentation, pilots or subsidized consumption.

As Bloomberg reported last week, OpenAI accounted for somewhere between 50% and 70% of Microsoft’s AI revenue in the 12 months to 30 June.

That degree of concentration is significant. Microsoft disclosed $24.1 billion in sales from OpenAI during the year ended in June; outside estimates place that at more than half, and perhaps about 70%, of Microsoft’s AI-related revenue. Much of the revenue reflects OpenAI’s spending on Microsoft cloud and model-development services, meaning a substantial portion of the apparent AI revenue base may be generated within a tightly linked commercial relationship rather than by a diversified population of external enterprise customers.

That could be problematic if the picture is similar at other hyperscalers and at other frontier AI companies like Anthropic, for example. A market in which a handful of loss-making model developers drive an outsized share of cloud and infrastructure revenue is inherently more fragile than one supported by a broad base of profitable end users. It exposes infrastructure providers and lenders to customer concentration, correlated capital spending and the possibility that a reduction in financing at one frontier lab quickly reduces demand across the supply chain.

Indeed, as has been reported by multiple correspondents – most notably staunch AI critic Ed Zitron – LLM makers like OpenAI are losing money hand over fist and can only charge so much for tokens before customers either curb their usage or switch to open source models.  Zitron wrote:

“It’s estimated that 70% or more of the AI revenues of Microsoft, Google, and Amazon were from either OpenAI or Anthropic. UBS estimated that next year, Anthropic and OpenAI’s compute spend would be 48% of all Google Cloud revenues — which means that they likely account for even more than 70% of its AI revenues.”

The commercial challenge is not whether frontier models have value- they do. It is whether they can deliver that value at prices that exceed the combined costs of training, inference, electricity, networking, cloud capacity, depreciation and ongoing model development. If token pricing rises too far, customers may reduce usage, shift workloads to lower-cost models, or use open-source alternatives. If pricing remains low, frontier-model providers may struggle to cover their infrastructure bills. Open-source fine-tuning can materially reduce costs for specialized enterprise workloads, reinforcing the competitive pressure on premium proprietary-model pricing.

The most plausible downside is that the technology becomes broadly useful but insufficiently profitable to support today’s extreme capital intensity. That outcome would leave the sector with too much high-cost capacity, thin margins, declining GPU collateral values and lenders dependent on assumptions about utilization and cash flows that have not yet been tested through a downturn. The foundational financial risk is straightforward: AI-service revenues may prove insufficient to service the fixed obligations incurred to construct the infrastructure.  Notably, Nvidia stock dipped modestly on Monday after The Financial Times reported that the company was nearing the mammoth financing deal.

While the contours of the arrangements were announced Monday afternoon, details remained scarce. A joint news release referred only to “memorandums of understanding” to “create dedicated pools of capital at significant scale.”

That language is important. Memorandums of Understanding (MoU’s) are not equivalent to binding, fully funded commitments. Until investors know the actual terms—capital committed, leverage permitted, collateral requirements, Nvidia’s role in losses, loan maturities, customer concentration limits and underwriting standards—the $500 billion figure is better understood as an ambitious financing target than as validated capital deployment. Reporting has described the initiative as a multiyear target rather than cash already committed, while questions remain about the scale of any Nvidia backstop.

During their television interview, the lenders’ executives alluded vaguely to “yield-based products” and even securitization, or the creation of bonds that would divvy up the revenue from A.I. labs into risky and less risky categories. There were several references to A.I. as a new asset class and to allowing smaller investors an opportunity to invest in debt backed by the data centers.

This is where the proposal moves from aggressive investment to potential systemic-risk creation. Securitization can distribute risk, but it does not eliminate it; it can instead diffuse difficult-to-value exposure across a wider investor base. Packaging AI-data-center debt into yield products may make financing more available, but it also risks obscuring the quality of the underlying cash flows, the degree of correlated exposure among borrowers and the vulnerability of rapidly depreciating hardware collateral. The more complex the capital stack becomes, the greater the danger that investors mistake engineered liquidity for genuine economic value.

Executive Quotes:

“NVIDIA has reached an important milestone. We began by building chips; today, we are helping create a new class of productive, investable infrastructure: AI factories,” said Jensen Huang, founder and CEO of NVIDIA. “In AI, compute is revenue. NVIDIA compute is uniquely suited for this role. It is broadly adopted, flexible across models and workloads, fungible and transferable across customers and operators, and continuously improved through CUDA software — extending its useful life and improving its economics over time. It is supported by a deep global ecosystem of developers, customers and offtakers. That is why we are bringing the world’s leading long-term capital providers together to independently underwrite AI infrastructure. These financing platforms will help customers access scarce compute at scale and build the DSX AI factories that will power every industry and country in the age of AI.”

“Modern compute has emerged as a scarce, mission-critical asset class with compelling investment characteristics that is positioned to drive significant long-term economic growth and productivity gains,” said Apollo President Jim Zelter. “The combination of NVIDIA’s proprietary technology ecosystem and Apollo’s flexible, long-term capital base provides a strong foundation to support the next stage of the AI buildout as part of the broader Global Industrial Renaissance.”

“The AI buildout will require unprecedented investment and a skilled workforce to turn that investment into the infrastructure that will help power future growth,” said Larry Fink, Chairman and CEO of BlackRock. “This partnership deepens our relationship with NVIDIA, including through the AI Infrastructure Partnership, and brings together NVIDIA’s leadership in accelerated computing with BlackRock’s ability to connect long-term capital to essential infrastructure. Together, we can help deliver the compute capacity that companies need to grow and create more jobs, supporting the continued growth of the U.S. and global economies, while creating attractive, long-term investment opportunities for our clients.”

“NVIDIA has created extraordinary demand for its compute through an intense focus on customer value and versatile technology,” said Jon Gray, President and COO of Blackstone. “We continue to be enormous investors globally across the NVIDIA ecosystem, and this announcement further underscores our confidence in their platform and the future of AI infrastructure.”

“As our strategic partner, NVIDIA is enabling us to scale AI factories. We are excited about further collaboration to build and fund the backbone of AI globally,” said Bruce Flatt, CEO of Brookfield. “With demand for large-scale AI compute growing significantly as adoption scales across industries, compute is fast becoming the essential layer of infrastructure and a core pillar of the Brookfield AI infrastructure strategy.”

“We’re in a pivotal moment of a historic AI investment cycle. NVIDIA’s full-stack platform is in high demand and uniquely positioned at the center of that global buildout,” said David Solomon, Chairman and CEO of Goldman Sachs. “Our investment and distribution roles reflect our confidence in NVIDIA’s leadership, and we’re excited for the new opportunity to create a market for credit backed by NVIDIA compute.”

“Compute has become a critical infrastructure asset. As we’ve scaled our approach to digital infrastructure, we’ve learned that delivery, not ambition, is the hard part. That’s why we’re excited to build on our strategic partnership with NVIDIA, a founding investor in Helix Digital Infrastructure, to bring together NVIDIA’s accelerated computing platform with KKR’s long-duration capital, infrastructure expertise and capital markets capabilities to turn growing demand into real capacity at extraordinary scale,” said Joe Bae and Scott Nuttall, Co-Chief Executive Officers of KKR.

“This is the very beginning — like what it was when I started in the mortgage-backed securities market in the 1970s,” Mr. Fink said. “I look upon this as a next future for financial engineering.”

That analogy should be treated as cautionary, not reassuring. Financial engineering can expand access to capital and spread risk efficiently when assets have transparent valuations, stable cash flows and conservative underwriting. It becomes dangerous when it is used to finance unproven revenue models, rapidly obsolescing assets and demand forecasts that must remain exceptionally optimistic simply to justify the initial investment.

Huge Risks Explained:

If AI demand stalls, Nvidia faces a sharp reversal in hardware demand and a potentially damaging credit overhang, while lenders could be left financing underutilized data centers secured by equipment whose value can decline far faster than conventional infrastructure. The common vulnerability is that the same uncertain AI revenue streams would be expected to support chip purchases, data-center leases, project debt and securitized investment products.   Nvidia is especially exposed to risks:

  • Order cancellations and lower pricing power. Cloud providers, AI labs and startups would likely slow GPU orders, defer deployments or renegotiate capacity commitments. Nvidia could face weaker revenue growth, inventory risk and pressure on the high margins that have supported its valuation.

  • Vendor-financing and counterparty risk. If Nvidia is arranging or backstopping financing for customers buying its systems, a demand slowdown could turn what appeared to be hardware sales into indirect credit exposure. Customers unable to earn adequate returns from AI services may struggle to repay loans used to buy Nvidia equipment. The risk is magnified where the company’s commercial success depends on borrowers gaining access to financing in the first place.247wallst+1

  • Collateral impairment. GPUs are not durable, slow-depreciating infrastructure assets. A new chip generation, a shift toward more efficient models, or weak utilization can materially reduce the resale value of installed systems. If lenders rely on those systems as collateral, a default could leave them holding equipment worth substantially less than the loan balance—and Nvidia could face lower demand for both new and prior-generation products. Moody’s identifies rapid capacity expansion and fast-changing chips, cooling and computing architectures as sources of overbuilding and technology-obsolescence risk.moodys

  • Feedback-loop risk. A slowdown could create a negative cycle: AI customers reduce spending; Nvidia’s sales weaken; lenders become more cautious; financing availability tightens; customers cut orders further. Where vendors, customers and capital providers are financially intertwined, the decline can be more abrupt than a normal inventory correction.

  • Equity-valuation risk. Nvidia’s market value reflects unusually strong assumptions about the longevity of AI spending, margins and growth. A reassessment of those assumptions could compress the valuation sharply even if Nvidia remains profitable. BIS warns that disappointment in AI returns could trigger a sudden financing pullback and turn the capex boom into a prolonged investment bust.bis

Lenders’ exposure:

Risk How a demand stall transmits losses
Default risk AI labs, cloud operators and data-center developers may fail to generate enough revenue to cover interest, principal, energy and operating costs.
Underutilized capacity Empty or lightly used data halls produce far less cash flow than underwriting models assume, impairing debt-service coverage.
Collateral-value risk Specialized GPU, networking and cooling systems may have weak resale value in a downturn, especially if many borrowers liquidate comparable equipment simultaneously.
Refinancing risk Projects commonly require follow-on funding after construction. If markets reprice AI risk, borrowers may be unable to refinance maturing debt except at much higher rates—or at all.
Concentration risk Multiple loans, funds and securitizations may rely on a small number of AI labs, hyperscalers, equipment suppliers and power projects. A weakness in one tenant or customer can affect many nominally separate investments.
Structured-finance risk Securitizing data-center revenues can spread exposure across private-credit funds, insurers, pensions and bondholders. It diversifies ownership of the risk, but does not improve the underlying cash flow.

The most immediate lender risk is a mismatch between long-lived debt obligations and unstable, technology-dependent revenue. A data center might be financed over many years, but its GPU fleet may need continual upgrades to remain competitive—requiring additional capital expenditure before the original debt is repaid. Moody’s notes that this combination of increasing capital intensity, uncertain compute requirements and structured finance can pressure developers, landlords and investors through execution, renewal and refinancing risk.moodys

Construction and power risks:

A demand slowdown could arrive before projects enter service. That creates a particularly difficult situation for lenders because construction interest, cost overruns and power-reservation charges may accumulate before revenue begins.

Permitting delays, local opposition, water constraints and electricity-grid limitations further compound this exposure. Reuters reported that lenders increasingly treat project readiness—including approvals, permits and local community support—as a credit factor because delays can increase costs, jeopardize covenants and prevent projects from reaching revenue-generating operation.

System-wide scenario:

The more serious scenario is a correlated unwind:

  1. AI applications fail to deliver enough monetizable demand.

  2. AI labs and cloud providers reduce compute commitments.

  3. Data-center utilization and expected rental income fall.

  4. Borrowers cannot service or refinance project debt.

  5. GPUs and related infrastructure lose collateral value.

  6. Losses reach private-credit funds, banks, securitized vehicles, insurers and institutional investors.

  7. New financing becomes unavailable, causing further cuts in infrastructure orders and Nvidia sales.

This would not necessarily resemble the 2008 banking crisis: some first-loss exposure sits outside regulated banks. But Chicago Booth research estimates that a severe re-rating of AI-related debt could still produce roughly $60 billion to $140 billion in realized credit losses, alongside large equity-market effects.

What matters most:

The decisive question is not whether AI is useful or whether data centers remain necessary. It is whether cash-paying end users will generate sufficient, durable revenue to justify the full cost of the hardware, power, real estate, construction and financing now being committed.  If that answer is no, the sector may discover that it financed capacity—not returns.

……………………………………………………………………………………………………………………………………………………………………………………

From Google’s Gemini:

The Hyperscaler Risk Transmission Chain:
When frontier-model providers struggle to generate high-margin cash flows, the financial damage transfers to hyperscalers through four distinct mechanisms:
1. Massive Equity and Balance Sheet Asset Write-Downs:
Hyperscalers have poured tens of billions of dollars into OpenAI and Anthropic, often structured as “cash-for-cloud” partnerships. If capital markets reassess the terminal valuations of these private AI firms due to a monetization miss, hyperscalers will face multi-billion-dollar non-cash impairment charges on their balance sheets, severely hitting reported net income. 
2. Severe Excess Data Center Capacity & High Fixed Costs: 
Hyperscalers have aggressively built or leased data center physical infrastructure (DCPI) to support the massive compute obligations of their AI partners.
    • The Revenue Void: If OpenAI or Anthropic defers or cancels capacity commitments, hyperscalers are left with energized Megawatts (MW) that have no immediate, high-paying tenant.
    • Stranded Capital: The specialized power, liquid cooling systems, and electrical equipment tailored for dense AI clusters cannot easily be repurposed for traditional cloud workloads without lowering returns on invested capital (ROIC).

3. Collapse of the “Cloud Recycling” Revenue Loop:
A significant portion of the revenue hyperscalers currently report from AI is circular: the hyperscaler invests billions in OpenAI/Anthropic, and the AI firm immediately hands that money back to the hyperscaler to pay for cloud compute time. If these startups cannot monetize their enterprise seats or API volumes, this artificial cloud revenue engine stalls, causing a sharp deceleration in hyperscaler cloud growth rates. 
4. Drastic CapEx Retrenchment & Margin Compression:
Faced with lower compute utilization and falling pricing power per token, hyperscalers would be forced to aggressively slash their capital expenditures (CapEx). While cutting CapEx preserves cash, the near-term transition would compress operating margins due to the heavy depreciation costs of already-purchased Nvidia GPUs and physical data center assets that are sitting idle. [1, 2, 3, 4, 5]

Impact on Hyperscaler Financials:
The table below outlines how a partial vs. severe AI monetization crash alters hyperscaler financial health.

Financial Metric Baseline Forecast (Bull Case) Partial Monetization Reset Severe Crash / Structural Downside
Cloud Revenue Growth Accelerated (driven by AI APIs & enterprise seats) Flattens out as enterprise customers consolidate suppliers Decelerates sharply; circular cloud revenue loops collapse
CapEx Infrastructure Full execution of Dell’Oro’s ~200 GW build out by 2030 20–30% of capacity commitments deferred or resized Mass cancellations of orders; multi-year build freezes
Operating Margins Expands as inference costs decline relative to software prices Compresses due to underutilized GPU clusters and high DCPI fixed costs Severe contraction; massive asset write-downs and depreciation drag
ROIC Historic highs driven by high-density compute demand Diluted; longer payback periods for specialized data centers Tanks; billions in stranded physical capital and obsolete hardware


ROIC:  Return On Invested Capital is a financial metric that measures how well a company uses the money from both lenders and shareholders to make after-tax profits. It is calculated by dividing net operating profit after tax by the average invested capital.
…………………………………………………………………………………………………………………………………………………………………………………………………………….
Concentration of Vulnerability: 
The risk is highly concentrated because hyperscalers are effectively underwriting the entire physical supply chain of the AI boom. McKinsey estimates that 60–65% of AI workloads in the US and Europe will be hosted on hyperscaler infrastructure by 2030. Because a tiny group of buyers controls the market, if just one major hyperscaler cuts its infrastructure spend in response to an OpenAI or Anthropic monetization miss, it will trigger an immediate bullwhip effect—crushing revenue for power, cooling, and electrical equipment vendors upstream. 
……………………………………………………………………………………………………………………………………………………………………………………………………

References:

https://nvidianews.nvidia.com/news/nvidia-partners-with-apollo-blackrock-blackstone-brookfield-goldman-sachs-and-kkr-to-establish-ai-compute-infrastructure-financing-platforms-to-mobilize-over-500-billion-of-third-party-capital

https://www.nytimes.com/2026/08/10/business/ai-nvidia-lenders-500-billion.html

https://www.bloomberg.com/news/articles/2026-08-05/microsoft-s-ai-sales-mostly-come-from-openai-disclosures-show

https://www.wheresyoured.at/dont-look-up/

Curmudgeon: Caveat Emptor: Huge Debt and Circular Financing Deals Dominate AI Build-Outs (07/23/26)

Merry-go-round of dog chasing its tail: Relationship between U.S. hyperscalers and private Gen AI companies

AI infrastructure spending boom: a path towards AGI or speculative bubble?

Expose: AI is more than a bubble; it’s a data center debt bomb

Will Google Cloud’s AI and data analytics revenue +TPU IP licensing income offset huge AI CAPEX to produce a decent ROI?

Amazon’s Jeff Bezos at Italian Tech Week: “AI is a kind of industrial bubble”

Big Tech AI spending binge results in massive job cuts!

AI spending boom accelerates: Big tech to invest an aggregate of $400 billion in 2025; much more in 2026!

FT: Scale of AI private company valuations dwarfs dot-com boom

Big tech spending on AI data centers and infrastructure vs the fiber optic buildout during the dot-com boom (& bust)

AI Data Center Boom Carries Huge Default and Demand Risks

Can the debt fueling the new wave of AI infrastructure buildouts ever be repaid?

Gartner: AI spending >$2 trillion in 2026 driven by hyperscalers data center investments

Will billions of dollars big tech is spending on Gen AI data centers produce a decent ROI?

 

Hyperscaler AI Race: Soaring Capex Wipes Out Free Cash Flow; AGI and Digital Gods

The tsunami wave of generative AI investment is now facing intense scrutiny due to an unsustainable imbalance between massive capital expenditure (capex) and negligible return on investment (ROI). Despite unprecedented infrastructure spending (mostly for AI Data Center buildouts), the sector has yet to deliver a definitive “killer app” or high-utility enterprise software capable of generating meaningful corporate revenue.  Consequently, stakeholders are shifting from speculative funding toward rigorous evaluation of tangible monetization and operational efficiencies. This lack of clear value realization raises valid concerns about a potential market correction as the technology struggles to transition from a capital sink to a self-sustaining ecosystem.
…………………………………………………………………………………………………………………………………………………………………………
Google parent company Alphabet boosted its forecast for capital spending for both 2026 and 2027 last week, citing supply constraints amid surging demand for more computing power. The company said its 2026 capex would increase its potential maximum to $205 billion from $190 billion.  That $15 billion increase places Alphabet neck-and-neck with Amazon at the absolute top of the hyperscaler spending ladder. Paul Meeks, head of technology research at Freedom Capital Markets, told CNBC that Wall Street is expecting about $260 billion in capex from Google/Alphabet in 2027.  “I think people would be satisfied [with that],” he added. “The thing I worry about is if you have a drop in spending: All of a sudden it’s $205 billion for Google this year, and next year it’s, say, $100 billion – it collapses.”
…………………………………………………………………………………………………………………………………………………………………………….
Hyperscaler Annual Capex Forecast (2024–2027):
All figures represent billions of USD ($B) and reflect current consensus updates.

Company 2024 (Actual) 2025 (Actual) 2026 (Current Guidance / Est) 2027 (Projected)
📦 Amazon $53B $112B $195B – $210B $230B – $260B
🔍 Alphabet (Google) $51B $104B $195B – $205B $240B – $280B
💻 Microsoft $56B $108B $185B – $195B $220B – $250B
♾️ Meta $38B $85B $125B – $145B $150B – $180B
🗄️ Oracle $13B $25B $45B – $50B $55B – $65B
🧮 Combined Aggregate $211B $434B $745B – $805B $895B – $1,035B
Source: Google Gemini
………………………………………………………………………………………………………………………………………………………………………………..

The huge increase in hyperscaler capex, wipes out their free cash flow (revenues-expenses is now negative for all but Microsoft). The shift in focus by investors from earnings to free cash flow marks a turning point in market perceptions.  The correct way to describe free cash flow is the cash flow a company generates during a period of time that is available to be paid to the company’s shareholders and debtholders.Companies with negative free cash flow are only able to cover the interest and principal on their debt by additional borrowing or by issuing new equity. In other words, cash is flowing from investors to the company, not the other way around.  In a financial crisis, investors become unwilling to support companies not able to cover interest and principal, with the result being a cascade of defaults and runs on financial institutions.

A major concern with the massive AI-capex which has occurred during the last two years is that much of it is debt financed. As the real cost of generative AI-tokens is becoming clear, lower priced Chinese competitors are emerging, and AI customers are beginning to economize on their use of AI. As a result, investors are becoming increasingly alarmed about whether U.S. AI firms will be able to cover their debt obligations.  AI-capex has been the main, and perhaps only driver of U.S. economic growth. If more companies announce negative free cash flows, that increase in magnitude, the financial system and overall economy will move closer to the tipping point.

…………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………….

But wait, Google/Alphabet co-founder says it’s more about winning AI market share than skyrocketing capex or ROI.  On Patrick O’Shaughnessy’s Invest Like the Best podcast, Gavin Baker, Chief Investment Officer for Atreides Management, shared an anecdote about what’s been going on within Google/Alphabet offices. According to Baker, Google co-founder Larry Page has been telling Google employees, “I am willing to go bankrupt rather than lose this race.” That shows how high the person who led Alphabet through its halcyon days thinks the stakes are in AI.

Baker went on to describe the leaders of Meta Platforms, Microsoft, and Alphabet as being in a race to create a “Digital God,” or artificial general intelligence (AGI), which is likely to be worth trillions of dollars in value if not tens of trillions or even more. He also explained that the tech giants are counting on the models to scale, or get better as they get bigger, and the tech giants are unlikely to slow down their spending on AI infrastructure until they’re proven otherwise. AGI could be more disruptive than any technology before it, including the internet, and most tech CEOs seem to think this.  OpenAI CEO Sam Altman told Time magazine last December, “I think AGI will be the most powerful technology humanity has yet invented.”
……………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………….

References:

https://www.forbes.com/sites/hershshefrin/2026/07/2/market-experiences-an-ai-capex-turning-point-with-tipping-point-to-follow/

https://www.fool.com/investing/2024/08/31/thinking-of-selling-nvidia-stock-larry-page-quote/

Curmudgeon: Caveat Emptor: Huge Debt and Circular Financing Deals Dominate AI Build-Outs 

Will billions of dollars big tech is spending on Gen AI data centers produce a decent ROI?

Bloomberg: Meta to sell AI compute in a new cloud services offering

Disclaimer: Perplexity.ai was used for research resulting in this article.

Executive Summary:

According to BloombergMeta Platforms is advancing plans to commercialize its internal AI infrastructure through a new cloud services offering, signaling a strategic expansion beyond its traditional hyperscale consumer platforms into the competitive AI infrastructure market. This initiative would position Meta alongside established cloud providers such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud, while also overlapping with emerging GPU-centric “neocloud” providers.  Meta’s move represents a significant evolution in the AI infrastructure landscape, with potential ripple effects across data center architecture, optical transport networks, and the broader telecom ecosystem.

At the core of this strategy is the monetization of Meta’s rapidly expanding AI compute footprint. The company has aggressively invested in large-scale data center infrastructure—reportedly including multi-hundred-billion-dollar campus developments—to support training and inference for its proprietary large language models (LLMs) and recommendation systems. As these deployments scale, Meta appears to be seeking to externalize surplus capacity, transforming a cost center into a revenue-generating platform.

The proposed service portfolio is expected to span two primary layers. First, Meta may expose access to hosted AI models via APIs, analogous to AWS Bedrock or Azure AI Services, enabling enterprises to integrate generative AI and foundation model capabilities without managing underlying infrastructure. Second, Meta is exploring the provision of raw compute capacity—primarily GPU-accelerated workloads—mirroring the infrastructure-as-a-service (IaaS) model offered by neocloud providers such as CoreWeave. This dual-layer approach would allow Meta to compete both in higher-margin AI platform services and in lower-level compute provisioning.

Telecom & Networking Implications:

From a telecom and network infrastructure perspective, this development has several implications. Hyperscale AI workloads are increasingly bandwidth-intensive, requiring high-capacity, low-latency interconnects within and between data centers. Meta’s investments are therefore likely to drive demand for advanced optical networking technologies, including coherent pluggable optics (e.g., 400ZR/800ZR), data center interconnect (DCI) architectures, and AI-optimized fabric designs leveraging Ethernet-based scale-out topologies. In addition, the geographic placement of these data centers—often in power-abundant, rural locations—introduces new requirements for long-haul fiber connectivity and edge aggregation.

The initiative, internally referred to as “Meta Compute,” reflects a broader industry shift toward vertically integrated AI infrastructure stacks, where hyperscalers tightly couple compute, networking, and software frameworks. For telecom operators and infrastructure vendors, this trend underscores the growing convergence between cloud, AI, and network domains, particularly as AI-driven workloads begin to influence traffic patterns, peering strategies, and edge deployment models.

Strategically, Meta’s entry into the AI cloud market raises competitive pressure across multiple fronts. Unlike traditional cloud providers, Meta brings extensive experience in hyperscale distributed systems and open-source AI frameworks (e.g., PyTorch), but lacks a mature enterprise cloud ecosystem. Its success will likely depend on its ability to translate internal infrastructure efficiencies into externally consumable services, while addressing enterprise requirements for reliability, security, and service-level agreements.

Meta’s cloud push is best viewed as a network-and-infrastructure strategy as much as a software business, because monetizing AI capacity depends on how well it can expose compute, move data, and preserve performance at hyperscale. The telecom significance is that Meta is turning internal AI infrastructure into a market-facing platform, which increases the importance of optical transport, data-center interconnect, and low-latency backbone engineering.

From a telecom perspective, the key issue is not simply that Meta may sell AI models or GPU capacity; it is that the company is building a service layer on top of a very large, power- and bandwidth-intensive distributed system. Reuters reported that Meta is considering both hosted model access and raw compute sales, with the former resembling an AI platform service and the latter looking more like neocloud infrastructure.That means the network becomes part of Meta’s product offering. Large AI inference and training environments require high-bisection fabrics inside the data center, plus dense east-west traffic handling, which pushes demand for faster Ethernet switching, advanced optical modules, and carefully engineered rack-to-rack and site-to-site interconnects.  Meta’s AI cloud ambitions reinforce a broader shift: hyperscalers are no longer treating networking as a background utility, but as a primary constraint on scale.

Network World’s coverage of Meta Compute notes that Meta has unified data center and network oversight and is planning multi-gigawatt AI buildouts, underscoring how tightly power, fiber, switching, and facility design are now linked.

For network operators and vendors, that translates into stronger demand for long-haul fiber, DCI platforms, low-latency transport, and high-radix switching. It also raises the strategic value of metro and regional interconnect corridors that can support AI clusters, especially when capacity must be spread across multiple sites for power, land, or resiliency reasons.

Meta’s potential move into raw compute sales is especially relevant to telecom because it resembles the economics of infrastructure-heavy cloud and colocation models. In practice, the service quality will depend on how efficiently Meta can provision GPU clusters, maintain deterministic performance, and avoid congestion across the transport layer connecting those clusters.  That implies growing importance for:

  • Coherent optical transport and scalable DCI.

  • High-capacity Ethernet fabrics for AI clusters.

  • Open-rack and disaggregated infrastructure designs.

  • Network automation that can track workload placement and traffic hotspots.

These are not just cloud concerns; they are telecom-grade capacity-planning problems. As AI clusters become larger and more distributed, network planning starts to look more like core network engineering than conventional enterprise hosting.

Image Credits: Gabby Jones/Bloomberg / Getty Images

……………………………………………………………………………………………………………………………………………………………………..

Conclusions:

Meta’s entry would not only compete with AWS, Azure, and Google Cloud, but could also pressure specialized neocloud providers more directly. Reuters noted that Meta’s spare capacity could matter more to neo-cloud vendors than to the largest hyperscalers, because those providers rely on access to external GPU supply and managed infrastructure growth.  For telecom analysts, that suggests the competitive battleground is shifting from “who has the best model” to “who can deliver the most resilient compute-network-power stack.” The winners will likely be those that can couple AI accelerators with fiber-rich sites, robust interconnect, and energy-secure data center footprints.

Meta’s move reflects the convergence of cloud, AI, and transport networks. The story is less about Meta becoming a generic cloud vendor and more about hyperscale AI infrastructure evolving into a new class of network-dependent utility.  Indeed, Meta’s cloud initiative highlights a broader industry reality — in the AI era, compute is valuable, but connectivity, optical scale, and power-aware architecture increasingly determine whether compute can be monetized at all.

……………………………………………………………………………………………………………………………………….

References:

https://www.bloomberg.com/news/articles/2026-07-01/meta-is-building-a-cloud-business-to-sell-excess-ai-compute?embedded-checkout=true  (PAYWALL)

https://www.reuters.com/business/meta-sell-excess-ai-computing-capacity-via-cloud-business-bloomberg-news-reports-2026-07-01/

https://www.networkworld.com/article/4115975/meta-establishes-meta-compute-to-lead-ai-infrastructure-buildout.html

Meta, like SpaceX, looks to turn excess AI compute into cash

https://www.cnbc.com/2026/05/27/mark-zuckerberg-says-meta-starting-cloud-business-on-the-table.html

Fiber Optic Boost: Corning and Meta in multiyear $6 billion deal to accelerate U.S data center buildout

OCP 2025 Meta keynote: Scaling the AI Infrastructure to Data Center Regions

TechCrunch: Meta to build $10 billion Subsea Cable to manage its global data traffic

AI Frenzy Backgrounder; Review of AI Products and Services from Nvidia, Microsoft, Amazon, Google and Meta; Conclusions

Bharti Airtel and Meta extend 2Africa Pearls subsea cable system to India

Is AI the driving force behind the metaverse?

 

 

 

 

Telecom data centers must be redesigned for the AI era with rack scale architectures, enhanced power & cooling requirements

Recent analysis by SiliconANGLE and Morgan Stanley highlights that the bottleneck for generative AI in telecom has shifted from software capabilities to physical hardware availability. While telecom network operators have successfully designed AI models for network optimization, predictive maintenance, and autonomous traffic routing, they lack the raw compute power to run them at scale. Traditional telecom data centers were built for central office workloads and basic virtualization, not the massive parallel processing required by modern Large Language Models (LLMs) and real-time AI inference. As a result, carriers are trapped in a compute-constrained environment, forced to queue workloads or ration processing power.
……………………………………………………………………………………………………………………………………….
The growth slope of generative AI in networking through 2026–2027 is now entirely bound to the physical deployment speed of raw, rack-scale data center infrastructure. This dependency is driven by three main factors:
  • Gigawatt-Scale Power and Liquid Cooling: Next-generation AI clusters require unprecedented power density, often exceeding 40kW to 100kW per rack. Telcos cannot simply drop these into existing facilities; they require entirely new or heavily retrofitted data centers featuring advanced liquid cooling architectures to prevent thermal throttling.
  • The Fragmented Edge vs. Centralized Fortresses: Operators are realizing that centralized hyperscale data centers (like AWS or Azure clusters in Virginia) cannot support latency-sensitive “Physical AI” or real-time agentic workflows. To make AI-native networking work, carriers must deploy high-density compute racks directly at the network edge, a highly complex and capital-intensive roll-out.
  • Neutral Interconnection Hubs: Multi-cloud setups and distributed training workloads are putting immense pressure on backbones. The expansion rate of neutral interconnect hubs (like Equinix and Digital Realty) is directly gating how fast enterprises and telcos can orchestrate data between fragmented training clusters and edge inference nodes.
  • Rack-scale architecture is rapidly emerging as the primary deployment unit as enterprises transition from discrete servers to fully integrated systems capable of supporting the power density, thermal constraints, and interconnect requirements of production-scale AI workloads.

Image Credit:  AMD

……………………………………………………………………………………………………………………………………………………………………………………………

AI data centers supporting telecom networks require fundamentally different power and cooling infrastructure compared to legacy enterprise facilities. The transition to generative AI and real-time edge processing has pushed power density per rack from an average of 5–10 kW up to 40–100+ kW.

Dell Technologies Inc. has been strategically aligning its portfolio to this shift, and at Dell Technologies World 2026, the company introduced an expanded PowerRack portfolio that integrates compute, networking, and storage within a unified rack-scale platform. This evolution underscores a broader transition in system design priorities—from server-centric architectures to tightly coupled, rack-level systems—driven by the escalating demands of AI infrastructure. As Arun Narayanan, senior vice president of compute and networking product management at Dell, indicated, increasing power density and system complexity are making rack-level architectural optimization not just advantageous, but essential.

“Go back two years ago, the largest, most powerful rack was 80 kilowatts,” Narayanan said. “Come to Vera Rubin, you’re going to get racks of 235 kilowatts, and then get to the next generation of Rubin Ultra and Kyber, you’re going to very quickly get to one megawatt racks. You have to fundamentally redesign everything from power distribution to cooling.”

Power Requirements and Delivery:
To prevent massive line losses and voltage drops at high densities, data centers must completely overhaul their internal alternating current (AC) distribution.
    • Medium-Voltage Power Distribution: Traditional facilities step utility power down to 480V AC far from the rack. High-density AI data centers run medium-voltage  or  power directly down to the row or container level before stepping down. This minimizes conduction losses through the heavy copper busbars.
    • The Move to 48V DC Busbars: Within the server chassis, power shelf architectures are shifting from traditional 12V DC distribution to DC busbars. A  delivery architecture reduces the current  required to deliver the same wattage  by a factor of four. Resistive power loss occurs when electrical energy is converted into heat due to the inherent opposition to current flow in a conductor. The formula (P{loss} = I^2 R dictates that this power dissipation is highly sensitive to current changes.  Therefore, cutting the current to one-fourth reduces internal rack heat and conduction power losses by 93.75%
    • Grid Interconnection and Substation Constraints: A single rack-scale AI cluster (such as a cluster of 32 or 64 interconnected nodes) can easily pull 2 to 3 Megawatts (MW). Operators are bypassing traditional local distribution grids entirely. They are building dedicated on-site substations tied directly to transmission-level lines to guarantee upstream capacity.


Cooling Requirements and Technologies:
Air cooling hits a hard physical performance ceiling at roughly 30–35 kW per rack. Beyond this threshold, the volume of air required to pass through the server chassis creates unacceptable fan power consumption and audible noise. AI data centers deploy liquid-based thermodynamics to dissipate the thermal energy.
       [ Liquid Cooling Architectures for AI Racks ]
       
 ┌───────────────────────────┐      ┌───────────────────────────┐
 │       Direct-to-Chip      │      │     Immersion Cooling     │
 ├───────────────────────────┤      ├───────────────────────────┤
 │ Closed loop micro-channels│      │ Entire server submerged   │
 │ bolted directly onto GPUs │      │ in dielectric fluid tank  │
 │                           │      │                           │
 │     [ GPU ] ──► [ Liquid] │      │    ┌───┐ ┌───┐ ┌───┐      │
 │   Cold Plate   Coolant    │      │    │GPU│ │CPU│ │RAM│      │
 │    Circuit     Circuit    │      │    └───┴─┴───┴─┴───┘      │
 └───────────────────────────┘      └───────────────────────────┘

    • Direct-to-Chip (Cold Plate) Cooling: This is the primary architecture for 2026 deployments. A closed-loop copper block with micro-channels is bolted directly onto high-thermal-flux components like the GPU or CPU. A specialized dielectric or water-glycol fluid circulates through the block. This absorbs heat directly from the silicon via conduction and pumps it away to a secondary heat exchanger.
    • Immersion Cooling (Single-Phase and Two-Phase):
        • Single-Phase: The entire server blade is submerged in a bath of non-conductive, hydrocarbon- or synthetic-based dielectric fluid. The fluid circulates through the chassis via natural convection or pumps to remove heat.
        • Two-Phase: The dielectric fluid has a low boiling point (\(50^{\circ }\text{C}\)). The heat from the chips boils the fluid into a vapor. The vapor rises to a condenser coil at the top of the sealed tank, condenses back into liquid, and falls back into the pool. This utilizes the latent heat of vaporization, making it highly efficient.

    • Cooling Distribution Units (CDUs): High-density loops rely on CDUs to act as the barrier between the internal facility water loops (which can be lower quality) and the ultra-pure, treated water circuit flowing directly through the server cold plates.

Strategic Market Outlook (2026–2027):
Because hardware deployment cannot be short-circuited by software updates, a clear divide is emerging in the telecom sector. Operators who secured early private capital, locked in GPU supply chains, and invested in dark fiber infrastructure are positioned to scale their AI capabilities rapidly. Conversely, carriers relying on incremental, legacy virtualization upgrades will face a hard performance ceiling. Through 2027, the market winners will be determined not by who has the best AI algorithms, but by who can build and power physical rack space the fastest.
……………………………………………………………………………………………………………..

References: