AI sparks huge increase in U.S. energy consumption and is straining the power grid; transmission/distribution as a major problem

The AI boom is  changing how data centers are built and where they’re located, and it’s already sparking a reshaping of U.S. energy infrastructure, according to Barron’s. Energy companies increasingly cite AI power consumption as a leading contributor to new demand. That is because AI compute servers in data centers require a tremendous amount of power to process large language models (LLMs).  That was explained in detail in this recent IEEE Techblog post.

Fast Company reports that “The surge in AI is straining the U.S. power grid.”  AI is pushing demand for energy significantly higher than anyone was anticipating. “The U.S. electric grid is not prepared for significant load growth,” Grid Strategies warned.  AI is a major part of the problem when it comes to increased demand. Not only are industry leaders such as OpenAI, Amazon, Microsoft, and Google either building or looking for locations on which to build enormous data centers to house the infrastructure required to power large language models, but smaller companies in the space are also making huge energy demands, as the Washington Post reports.

Georgia Power, which is the chief energy provider for that state, recently had to increase its projected winter megawatt demand by as much as 38%. That’s, in part, due to the state’s incentive policy for computer operations, something officials are now rethinking. Meanwhile, Portland General Electric in Oregon, recently doubled its five-year forecast for new electricity demand.

Electricity demand was so great in Virginia that Dominion Energy was forced to halt connections to new data centers for about three months in 2022. Dominion says it expects demand in its service territory to grow by nearly 5% annually over the next 15 years, which would almost double the total amount of electricity it generates and sells. To prepare, the company is building the biggest offshore wind farm in the U.S. some 25 miles off Virginia Beach and is adding solar energy and battery storage. It has also proposed investing in new gas generation and is weighing whether to delay retiring some natural gas plants and one large coal plant.

Also in 2022, the CEO of data center giant Digital Realty said on an earnings call that Dominion had warned its big customers about a “pinch point” that could prevent it from supplying new projects until 2026.

AES, another Virginia-based utility, recently told investors that data centers could comprise up to 7.5% of total U.S. electricity consumption by 2030, citing data from Boston Consulting Group. The company is largely betting its growth on the ability to deliver renewable power to data centers in the coming years.

New data centers coming on line in its regions ”represent the potential for thousands of megawatts of new electric load—often hundreds of megawatts for just one project,” Sempra Energy told investors on its earnings call last month.  The company operates public utilities in California and Texas and has cited AI as a major factor in its growth.

There are also environmental concerns. While there is a push to move to cleaner energy production methods, such as solar, due to large federal subsidies, many are not yet online. And utility companies are lobbying to delay the shutdown of fossil fuel plants (and some are hoping to bring more online) to meet the surge in demand.

“Annual peak demand growth forecasts appear headed for growth rates that are double or even triple those in recent years,” Grid Strategies wrote. “Transmission planners need long-term forecasts of both electricity demand and sources of electricity supply to ensure sufficient transmission will be available when and where it’s needed. Such a failure of planning could have real consequences for investments, jobs, and system reliability for all electric customers.”

According to Boston Consulting Group, the data-center share of U.S. electricity consumption is expected to triple from 126 terawatt hours in 2022 to 390 terawatt hours by 2030. That’s the equivalent usage of 40 million U.S. homes, the firm says.  Much of the data-center growth is being driven by new applications of generative AI. As AI dominates the conversation, it’s likely to bring renewed focus on the nation’s energy grid.  Siemens Energy CEO Christian Bruch told shareholders at the company’s recent annual meeting that electricity needs will soar with the growing use of AI. “That means one thing: no power, no AI. Or to put it more clearly: no electricity, no progress.”

The technology sector has already shown how quickly AI can recast long-held assumptions. Chips, for instance, driven by Nvidia, have replaced software as tech’s hottest commodity. Nvidia has said that the trillion dollars invested in global data-center infrastructure will eventually shift from traditional servers with central processing units, or CPUs, to AI servers with graphics processing units, or GPUs. GPUs are better able to power the parallel computations needed for AI.

For AI workloads, Nvidia says that two GPU servers can do the work of a thousand CPU servers at a fraction of the cost and energy. Still, the better performance capabilities of GPUs is leading to more aggregate power usage as developers find innovative new ways to use AI.

The overall power consumption increase will come on two fronts: an increase in the number of GPUs sold per year and a higher power draw from each GPU. Research firm 650 Group expects AI server shipments will rise from one million units last year to six million units in 2028. According to Gartner, most AI GPUs will draw 1,000 watts of electricity by 2026, up from the roughly 650 watts on average today.

Ironically, data-center operators will use AI technology to address the power demands. “AI can be used to improve efficiency, where you’re modeling temperature, humidity, and cooling,” says Christopher Wellise, vice president of sustainability for Equinix, one of the nation’s largest data-center companies. “It can also be used for predictive maintenance.” Equinix states that using AI modeling at one of its data centers has already improved energy efficiency by 9%.

Data centers will also install more-effective cooling systems.  , a leading provider of power and cooling infrastructure equipment, says that AI servers generate five times more heat than traditional CPU servers and require ten times more cooling per square foot. AI server maker Super Micro estimates that switching to liquid cooling from traditional air-based cooling can reduce operating expenses by more than 40%.

But cooling, AI efficiency, and other technologies won’t fully solve the problem of satisfying AI’s energy demands. Certain regions could face issues with their local grid. Historically, the two most popular areas to build data centers were Northern Virginia and Silicon Valley. The regions’ proximity to major internet backbones enabled quicker response times for applications, which is also helpful for AI. (Northern Virginia was home to AOL in the 1990s. A decade later, Silicon Valley was hosting most of the country’s online platforms.)

Today, each region faces challenges around power capacity and data-center availability. Both areas are years away making from the grid upgrades that would be needed to run more data centers, according to DigitalBridge, an asset manager that invests in digital infrastructure.  DigitalBridge CEO Marc Ganzi says the tightness in Northern Virginia and Northern California is driving data-center construction into other markets, including Atlanta; Columbus, Ohio; and Reno, Nev. All three areas offer better power availability than Silicon Valley and Northern Virginia, though the network quality is slightly inferior as of now. Reno also offers better access to renewable energy sources such as solar and wind.

Ultimately, Ganzi says the obstacle facing the energy sector—and future AI applications—is the country’s decades-old electric transmission grid.  “It isn’t so much that we have a power issue. We have a transmission infrastructure issue,” he says. “Power is abundant in the United States, but it’s not efficiently transmitted or efficiently distributed.”

Yet that was one of the prime objectives of the Smart Grid initiative which apparently is a total failure!   Do you think IEEE can revive that initiative with a focus on power consumption and cooling in AI data centers?

References:

https://www.barrons.com/articles/ai-chips-electricity-usage-2f92b0f3

https://www.fastcompany.com/91050626/surge-in-ai-straining-the-u-s-power-grid-artificial-intelligence

https://www.bloomberg.com/news/articles/2024-01-25/ai-needs-so-much-power-that-old-coal-plants-are-sticking-around

https://www.supermicro.com/en/solutions/liquid-cooling

Proposed solutions to high energy consumption of Generative AI LLMs: optimized hardware, new algorithms, green data centers

AI Frenzy Backgrounder; Review of AI Products and Services from Nvidia, Microsoft, Amazon, Google and Meta; Conclusions

FCC increases broadband speed benchmark (x-satellites) to 100/20 Mbit/s

The U.S. FCC voted this week to implement a 4x increase to its “broadband” benchmark, from 25/3 Mbit/s to 100/20 Mbit/s (download/upload speeds).  The Commission’s Report was issued pursuant to section 706 of the Telecommunications Act of 1996.  The FCC concluded “that advanced telecommunications capability is not being deployed in a reasonable and timely fashion based on the total number of Americans.”

Using the agency’s Broadband Data Collection deployment data for the first time rather than FCC Form 477 data, the Report shows that, as of December 2022:

• Fixed terrestrial broadband service (excluding satellite) has not been physically deployed to approximately 24 million Americans, including almost 28% of Americans in rural areas, and more than 23% of people living on Tribal lands;

Mobile 5G-NR (ITU-R M.2150/3GPP Release 16) coverage has not been physically deployed at minimum speeds of 35/3 Mbps to roughly 9% of all Americans, to almost 36% of Americans in rural areas, and to more than 20% of people living on Tribal lands;

• 45 million Americans lack access to both 100/20 Mbps fixed service and 35/3 Mbps mobile 5G-NR service; and

• Based on the new 1 Gbps per 1,000 students and staff short-term benchmark for schools and classrooms, 74% of school districts meet this goal.

The Report also sets a 1 Gbps/500 Mbps long-term goal for broadband speeds to give stakeholders a collective goal towards which to strive – a better, faster, more robust system of communication for American consumers.

FCC Chairwoman Jessica Rosenworcel said in a statement discussing the agency’s new 100/20 Mbit/s benchmark.

“This fix is overdue. It aligns us with pandemic legislation like the Bipartisan Infrastructure Law and the work of our colleagues at other agencies. It also helps us better identify the extent to which low-income neighborhoods and rural communities are underserved. And because doing big things is in our DNA, we also adopt a long-term goal of 1 Gigabit down and 500 Megabits up.”

“One more thing. The law requires that we assess how reasonable and timely the deployment of broadband is in this country.”

Don’t expect much change. As noted by Engadget, U.S. Internet Service Providers (ISPs) offering speeds under the new benchmark won’t be able to call their services “broadband” on the new telecom information labels the FCC will soon begin requiring. However, ISPs and network providers are not required to hit the FCC’s new 100/20 Mbit/s speeds.

Moreover, it will not impact the NTIA’s massive $42.45 billion Broadband Equity, Access, and Deployment (BEAD) program, which already requires 100/20 Mbit/s speeds on networks receiving government subsidies.

……………………………………………………………………………………………………….

The FCC’s definition of broadband excludes satellites at a time of frenzied investments in Internet services from space. Championed by Elon Musk’s Starlink, companies ranging from Amazon to OneWeb to Telesat are planning similar low-Earth orbit (LEO) satellite constellations for space-based Internet.

Starlink’s parent company – SpaceX – this week conducted another test of its massive Starlink rocket. That rocket is in part intended to launch Starlink’s second generation satellites.

However, the FCC has excluded such satellite efforts from most of its broadband programs. For example, it rejected Starlink’s application for government funding through its Rural Digital Opportunity Fund (RDOF) program.

“It is evident that fixed wireless access (FWA) offerings already compete aggressively with traditional wired broadband services, and LEO satellite-based services are poised to do the same. Accordingly, all three should be treated as robust rivals within a single ‘home Internet’ product market,” wrote the Free State Foundation, another think tank.

According to FCC Commissioner Brendan Carr, a Republican, the agency specifically excludes Starlink from its overall efforts because he thinks President Biden dislikes SpaceX chief executive Elon Musk. “The Biden Administration is choosing to prioritize its political and ideological goals at the expense of connecting Americans,” Carr alleges.

With its roughly 5,000 satellites, Starlink currently offers median speeds of around 64 Mbit/s, according to Ookla, and counts around 2.6 million customers globally.

References:

https://docs.fcc.gov/public/attachments/DOC-401205A1.pdf

https://docs.fcc.gov/public/attachments/DOC-401205A2.pdf

https://www.lightreading.com/regulatory-politics/the-subtle-debate-behind-the-fcc-s-new-broadband-speed-benchmark

BroadbandNow Research: Best & Worst States for Broadband Access

FCC proposes 100 Mbps download as U.S. minimum broadband speed

Fiber Connect 2023: Telcos vs Cablecos; fiber symmetric speeds vs. DOCSIS 4.0?

GAO: U.S. Broadband Benchmark Speeds Too Slow; FCC Should Analyze Small Business Speed Needs

FCC Says Broadband Deployment Lacking; Redefinition (25M/3M) Has Huge Implications for AT&T, Verizon & Comcast

ABI Research and CCS Insight: Strong growth for satellite to mobile device connectivity (messaging and broadband internet access)

 

Dell’Oro: 2023 global telecom equipment revenues declined 5% YoY; Huawei increases its #1 position

Preliminary Dell’Oro Group data found that worldwide telecom equipment revenues across the six telecom programs tracked  – Broadband Access, Microwave & Optical Transport, Mobile Core Network (MCN), Radio Access Network (RAN), and SP Router & Switch – declined 5% year-over-year (YoY) for the full year 2023, performing worse than expected.   First and foremost, challenging comparisons in some of the advanced 5G markets with higher 5G population coverage taken together with the slow transition towards 5G SA helped to partially explain steep declines in wireless-based investments. This capex deceleration was not confined to the RAN and MCN segments. Following a couple of years of robust PON investments, operators were able to curtail their home broadband capex as well. This reduction was more than enough to offset positive developments with optical transport and Service Provider routers.

The North America telecom equipment market declined faster than expected. Initial readings show that the aggregate telecom equipment market dropped by roughly a fifth in the North America region, underpinned by weak activity in both RAN and Broadband Access. On the bright side, regional dynamics were more favorable outside of the US. Our assessment is that worldwide revenues excluding North America advanced in 2023, as positive developments in the Asia Pacific region were mostly sufficient to offset weaker growth across Europe.

Also contributing to the regional and technology trends is the disruption caused by Covid hoarding and the supply chain crisis. Although this inventory correction was not felt everywhere and varied across the telecom segments, it was more notable in the RAN this past year.

Renewed concerns about macroeconomic conditions, Forex, and higher borrowing costs are also weighing down prospects for growth. The gains in the USD against the Yuan and the Yen are impacting USD-based equipment revenue estimates in China and Japan.

………………………………………………………………………………………………………………………………………………………………………………………………

Dell’Oro says that Huawei maintained its lead as the top global telecom equipment company by revenue in 2023, despite efforts by the U.S. government and other countries to limit its addressable market and access to Android and the latest chips and semiconductor technology from TSMC.  In fact, Dell’Oro’s assessment is that Huawei’s lead widened in 2023, in part because its limited exposure to the North America region was a benefit in 2023 on a relative basis.

Supplier rankings were mostly unchanged.  However, vendor revenue shares shifted slightly in 2023. Still, the overall concentration has not changed – the top seven suppliers accounted for around 80% of the overall market.

Market conditions are expected to remain challenging in 2024, though the decline is projected to be less severe than in 2023. The analyst team is collectively forecasting global telecom equipment revenues to contract 0 to -5% in 2024. Risks are broadly balanced. In addition to currency fluctuations, economic uncertainty, and inventory normalization, there are multiple regions/technology segments that are operating in a non-steady state.

References:

Worldwide Telecom Equipment Market Slumps in 2023

Dell’Oro & Omdia: Global RAN market declined in 2023 and again in 2024

Dell’Oro: Broadband access equipment sales to increase in 2025 led by XGS-PON deployments

Global 5G Market Snapshot; Dell’Oro and GSA Updates on 5G SA networks and devices

Dell’Oro: Broadband network equipment spending to drop again in 2024 to ~$16.5 B

Dell’Oro: Mobile Core Network market has lowest growth rate since 4Q 2017

Dell’Oro: U.S. suppliers ~20% of global telecom equipment market; struggling in RAN business

 

U.S. fiber rollouts now pass ~52% of homes and businesses but are still far behind HFC

Fiber optic network deployments have reached a milestone as they now pass more than 50% of U.S. households, according to recent report from the Fiber Broadband Association (FBA) [1.] and RVA Market Research and Consulting.  Fiber broadband deployment set a new historical record in 2023, passing nine million new homes at a growth rate of 13% year-over-year. The 2023 North America Fiber Provider Survey, sponsored by the FBA, concluded that 77.9 million U.S. homes were passed with fiber, with nearly 52% of all the nation’s unique homes and businesses passed.

Note 1. The FBA is an all-fiber trade association that provides resources, education, and advocacy for companies, organizations, and communities that want to deploy fiber networks. The FBA’s goal is to raise awareness and provide education about the fiber deployment process, safe worksites, and effective fiber installs.

Image Credit: The Fiber Broadband Association (FBA)

………………………………………………………………………………………………………………………………………………………………………………………….

The last $10 billion U.S. Treasury American Rescue Plan (ARP) funding for infrastructure projects such as broadband networks is being distributed this year. The $42.5 billion in NTIA BEAD funding available over the next few years will significantly contribute to enabling and upgrading communities across America with the high-speed, low-latency broadband necessary for participation in today’s 21st-century society. We are seeing a steady stream of NTIA approvals and expect the first states to make BEAD awards in the second half of 2024.

Here’s how the growth of fiber has risen in recent years compared to coax cable (or hybrid fiber/coax, HFC) and the long history of copper.

“Thanks to this latest surge, fiber lines now pass nearly 78 million U.S. homes, up 13% from a year ago,” Alan Breznick, Heavy Reading analyst and the cable/video practice leader at Light Reading, explained in recorded opening remarks here at Light Reading’s 17th’s annual Cable Next-Gen event.  Almost 69 million of those locations are “unique” fiber homes, meaning that about 9 million are passed by more than one fiber provider, Breznick added.

The share of broadband technology is also evolving. While HFC remains the primary way of delivering broadband, fiber-to-the-premises (FTTP) and fixed wireless access (FWA) will continue to make their presence felt in the coming years.  Omdia (owned by Informa) expects cable’s share of that mix to drop over the next four years, hitting about 55% by 2028, while fiber’s share is expected to rise to 30% by that time, Breznick explained.

For the cable industry, fiber and FWA are not solely about competition. Many operators are also using FTTP extensively in greenfield deployments and subsidized rural buildouts. They are deploying it on a targeted basis via a new generation of nodes that can support multiple access technologies, including HFC and wireless.

CableLabs has put fiber-to-the-premises on the front burner via a pair of new working groups. A recent survey from Omdia shows that more than one-third of cable operators have already deployed passive optical networking (PON) in some form. That number will “undoubtedly keep rising” thanks to initiatives such as the Broadband Equity Access and Deployment (BEAD) program, Breznick said.   Omdia expects spending on next-gen cable technologies to tick up in 2024 and 2025 and then reach a relatively steady annual state through 2029.

Meanwhile, operators such as Mediacom Communications have tapped into FWA to extend the reach of broadband in rural areas.  Combined, they demonstrate some of the reasons why the industry has been shedding the “cable” label via rebranding efforts and name changes in recent years.

Cable’s broadband challenge is to grow broadband subscribers as it faces more broadband competition combined with historically low churn and a slow housing move market.  “If it feels like an uphill battle for cable, maybe that’s because it is. But that doesn’t mean it has to be a losing battle,” Breznick said. “That’s because the cable industry still has plenty of tricks left up its sleeve.”

Those tricks include the use of next-generation DOCSIS 3.1 (sometimes called DOCSIS 3.1+ or extended DOCSIS 3.1) that can bump up speeds as high as 8 Gbit/s by opening up new orthogonal frequency division multiplexing (OFDM) channels. Some operators, including Comcast, Charter Communications, Rogers Communications, Cox Communications and Cable One, have begun to deploy DOCSIS 4.0 or have put it squarely on their network upgrade roadmaps.

And though cable operators’ network spending is expected to be down in the first half of 2024, vendors are optimistic that the spigots will start to open up again in the second half of the year as operators pick up the pace.

References:

https://www.broadbandtechreport.com/home/article/14310005/a-healthy-fiber-industry-for-2024-and-beyond

https://www.lightreading.com/fttx/us-fiber-rollouts-reach-tipping-point-but-are-still-far-behind-hfc

Fiber Connect 2023: Telcos vs Cablecos; fiber symmetric speeds vs. DOCSIS 4.0?

Dell’Oro: Broadband access equipment sales to increase in 2025 led by XGS-PON deployments

Nokia’s launches symmetrical 25G PON modem

 

 

 

Nokia’s launches symmetrical 25G PON modem

Nokia today announced the launch of a new symmetrical 25G PON [1.] fiber modem. Helping to further accelerate 25G PON deployments, the compact solution can easily be installed on a wall, inside a building, or in an outdoor enclosure to immediately deliver internet speeds that are 20x faster than current gigabit solutions. Once deployed, operators can leverage their existing fiber network to offer new premium residential, business, or anyhaul services that unlock additional revenue streams.

Note 1. 25G PON, also known as 25GS PON, is a next-generation PON that offers a number of benefits. It can provide 10Gb/s services or higher, premium enterprise services, and 5G transport.

Demand for high-speed broadband access is accelerating with end-users increasingly seeking quality multi-gigabit services to power their homes and businesses. From the Metaverse and cloud gaming to cyber security, and Industry 4.0 applications, users want multi-gigabit services that can meet their evolving broadband needs.

Nokia’s new 25G PON fiber modem allows operators to establish a future-ready network that can immediately address the growing demand for more capacity and enhanced broadband services. The new 25G PON solution enables operators to quickly upgrade their existing GPON or XGS PON network to deliver true 10Gbs speeds and beyond with unprecedented ease. For enterprises, this can help significantly improve business productivity and enhance connectivity to the cloud or value-added applications located in data centers. For consumers and power users, the solution provides immediate access to additional capacity needed to support bandwidth-hungry applications such as AI, gaming, or security.

25G PON Wavelength Plan:

Image Credit: Nokia

……………………………………………………………………………………………………………………………………………………………………………………………………………………………..

Geert Heyninck, General Manager of Broadband Networks at Nokia, said: “The 25G PON eco-system is growing and with it, the technology that continues to bring concrete business benefits to customers. The market for 25G PON is here and with the new fiber modem, we have a very efficient 25G solution that can support all types of services and applications in the fiber-for-everything era. 25G PON continues to be the easiest, most cost-effective and power-efficient way for services providers to upgrade and maximize the use of their existing fiber network to deliver ultra-fast broadband access.”

Jeff Heynen, Vice President, Broadband Access and Home Networking at Dell’Oro Group, said: “25G PON deployments and the 25GS-PON MSA (Multi-Source Agreement) Group has grown substantially over the past year. One of the driving factors for the growing interest in 25GS-PON is its ability to coexist with GPON and XGS-PON without having to deploy additional feeder fiber, splitters, or other ODN elements. This past year we’ve seen large operators like Google indicate plans to make 25G PON service available to its customers while the MSA continues to expand, encompassing a diverse range of service providers, equipment vendors, and component suppliers.”

The new 25G PON fiber modem complements Nokia’s growing 25G PON portfolio, which includes the Lightspan FX, DF and MF fiber access platforms (OLTs) and the industry’s first 25G PON sealed fiber access node designed for cable operators.

25G PON ONT product details:

  • Coexistence with GPON, XGS-PON and 50G PON on the same ODN
  • Hardened and compact design for various deployment practices and environments
  • Symmetrical 25 Gb/s throughput using pluggable optics
  • Frequency and time-of-day synchronization functions for mobile transport
  • Can be used to connect cell sites to transport mobile traffic over PON network in plug-and-play mode, delivering the required capacity, latency and synchronization required for 5G networks.
  • Supports demarcation point functions for enterprise and wholesale services.
  • Nokia has shipped more than one million 25G PON ready ports to date.
  • 25G PON is ready to be activated in more than 150 networks worldwide.
  • The eco-system for 25G PON is mature with more than 60 operators, system vendors, chipset and optical suppliers part of a MSA focused on standardizing and accelerating the technology.
  • Some of the operators currently deploying 25G PON include Google Fiber, EPB, Vodafone Qatar and OGI.
  • There are more than 30 operators trialing 25G PON for residential, mobile fronthaul and business connectivity applications.

References and additional information:

https://www.nokia.com/about-us/news/releases/2024/03/12/nokia-launches-new-25g-pon-fiber-modem-to-accelerate-multi-gigabit-broadband-deployments/

Nokia 25G ONT
Lightspan FX
Lightspan SF-8M sealed fiber access node
Lightspan MF fiber platform
25G PON

Google Fiber planning 20 Gig symmetrical service via Nokia’s 25G-PON system

Orange and Nokia demo 600Gb/sec transmission over a 914 km optical network; Nokia 25G PON

Dell’Oro: Broadband access equipment sales to increase in 2025 led by XGS-PON deployments

Dell’Oro: XGS, 25G, and Early 50G PON Rollouts to Fuel Broadband Spending

Passive Optical Network (PON) technologies moving to 10G and 25G

Nokia and Proximus (Belgium) demonstrate 1st implementation of 25GS-PON

 

Fiber and Fixed Wireless Access are the fastest growing fixed broadband technologies in the OECD

The latest OECD statistics show that Fiber and Fixed Wireless Access (FWA) have seen the strongest growth in fixed broadband technologies in three years. Fibre subscriptions have increased by 56% between June 2020 to June 2023, and FWA subscriptions have increased by 64%. The United States (252%), Estonia (153%), Norway (139%) and Spain (118%) led this FWA growth. The dynamism of fiber and FWA stands in stark contrasts to the decline in DSL (-24%).

Fiber access, which is the dominant technology since 2021, amounts to 41% of total fixed broadband subscriptions in June 2023 (see graph below). FWA still represents a more modest share of 3.7% of total fixed broadband subscriptions (in countries where data is available). DSL now represents a share of 22% of total broadband, while cable accounts for 30.5% of overall connections. Satellite, which grew 11% over the last three years, represents 0.7% of fixed broadband subscribers.
Broadband access technologies as share of total fixed broadband subscriptions in OECD countries, June 2023

Nine OECD countries have more than 70% of fibre connections over total broadband, with Korea, Japan, Iceland, Spain leading the way with the highest fibre penetration rates of 89%, 86%, 85% , and 84%, respectively. The highest fibre growth rates are in Europe, with Austria and Belgium having growth rates of 75% and 73% over the last year, closely followed by Mexico with a growth in fibre of 68%. Two other Latin American countries are in the top 7: Costa Rica and Colombia with fibre growth rates of 42% and 34%, respectively.

Mobile data usage per subscription grew substantially by 28% in one year passing from 10.2 GB to 13 GB per subscription per month in OECD countries as of June 2023. The amount of data consumed in countries vary greatly from 6 GB to 46 GB, with Latvia being the OECD leader.

Despite an already very high mobile broadband penetration in the OECD area, overall mobile subscriptions continue to grow by 4.6% over the last year, which totalled 1.8 billion as of June 2023, up from 1.74 billion a year earlier. Mobile broadband penetration is highest in Japan, Estonia, the United States and Finland, with subscriptions per 100 inhabitants at 200%, 192%, 183% and 161%, respectively.

Eighteen countries were able to provide the number of their 5G subscriptions separately from mobile broadband subscriptions. The share of 5G in total mobile broadband subscriptions is 23% on average for the OECD countries that provided this data.

Machine-to-machine (M2M) SIM cards grew 14% increase in one year. The two leading countries are Sweden with 238 M2M SIM cards per 100 inhabitants and Iceland (203), followed by Austria (179), the Netherlands (93) and Norway (76). Both Sweden and Iceland issue M2M SIM cards for international use.

Total number of fixed broadband subscriptions, by country, millions, June 2023:

……………………………………………………………………………………………………………………….

For further information, or to discuss these trends further, journalists can contact Verena Weber ([email protected]), Head of the OECD’s Connectivity Services and Infrastructures (CSI) Unit by email.
References:
Download broadband data, charts and penetration maps by country at http://oe.cd/broadband

AI Frenzy Backgrounder; Review of AI Products and Services from Nvidia, Microsoft, Amazon, Google and Meta; Conclusions

Backgrounder:

Artificial intelligence (AI) continues both to astound and confound.  AI finds patterns in data and then uses a technique called “reinforcement learning from human feedback.” Humans help train and fine-tune large language models (LLMs). Some humans, like “ethics & compliance” folks, have a heavier hand than others in tuning models to their liking.

Generative Artificial Intelligence (generative AI) is a type of AI that can create new content and ideas, including conversations, stories, images, videos, and music. AI technologies attempt to mimic human intelligence in nontraditional computing tasks like image recognition, natural language processing (NLP), and translation. Generative AI is the next step in artificial intelligence. You can train it to learn human language, programming languages, art, chemistry, biology, or any complex subject matter. It reuses training data to solve new problems. For example, it can learn English vocabulary and create a poem from the words it processes. Your organization can use generative AI for various purposes, like chatbots, media creation, and product development and design.

Review of Leading AI Company Products and Services:

1.  AI poster child Nvidia’s (NVDA) market cap is about $2.3 trillion, due mainly to momentum-obsessed investors who have driven up the stock price. Nvidia currently enjoys 75% gross profit margins and has an estimated 80% share of the Graphic Processing Unit (GPU) chip market.  Microsoft and Facebook are reportedly Nvidia‘s biggest customers, buying its GPUs last year in a frenzy.

Nvidia CEO Jensen Huang talks of computing going from retrieval to generative, which investors believe will require a long-run overhaul of data centers to handle AI. All true, but a similar premise about an overhaul also was true for Cisco in 1999.

During the dot-com explosion in the late 1990s, investors believed a long-run rebuild of telecom infrastructure was imminent. Worldcom executives claimed that internet traffic doubled every 100 days, or about 3.5 months. The thinking at that time was that the whole internet would run on Cisco routers at 50% gross margins.

Cisco’s valuation at its peak of the “Dot.com” mania was at 33x sales. CSCO investors lost 85% of their money when the stock price troughed in October 2002. Over the next 16 years, as investors waited to break even, the company grew revenues by 172% and earnings per share by a staggering 681%. Over the last 24 years, CSCO buy and hold investors earned only 0.67% per year!

 

2. Microsoft is now a cloud computing/data-center company, more utility than innovator.  Microsoft invested $13 billion in OpenAI  for just under 50% of the company to help develop and roll out ChatGPT. But much of that was funny money — investment not in cash but in credits for Microsoft‘s Azure data centers.  Microsoft leveraged those investments into super powering its own search engine, Bing, with generative AI which is now called “Copilot.”  Microsoft  spends a tremendous amount of  money on Nvidia H100 processors to speed up its AI calculations. It also has designed its own AI chips.

3. Amazon masquerades as an online retailer, but is actually the world’s largest cloud computing/data-center company.  The company offers several generative AI products and services which include:

  • Amazon CodeWhisperer, an AI-powered coding companion.
  • Amazon Bedrock, a fully managed service that makes foundational models (FMs) from AI21 Labs, Anthropic, and Stability AI, along with Amazon’s own family of FMs, Amazon Titan, accessible via an API.
  • A generative AI tool for sellers to help them generate copy for product titles and listings.
  • Generative AI capabilities that simplify how Amazon sellers create more thorough and captivating product descriptions, titles, and listing details.

Amazon CEO Jassy recently said the the company’s generative AI services have the potential to generate tens of billions of dollars over the next few years. CFO Brian Olsavsky told analysts that interest in Amazon Web Services’ (AWS) generative AI products, such as Amazon Q and AI chatbot for businesses, had accelerated during the quarter. In September 2023, Amazon said it plans to invest up to $4 billion in startup chatbot-maker Anthropic to take on its AI based cloud rivals (i.e. Microsoft and Google).  Its security teams are currently using generative AI to increase productivity

4. Google, with 190,000 employees, controls 90% of search. Google‘s recent launch of its new Gemini AI tools was a disaster, producing images of the U.S. Founding Fathers and Nazi soldiers as people of color. When asked if Elon Musk or Adolf Hitler had a more negative effect on society, Gemini responded that it was “difficult to say.” Google pulled the product over “inaccuracies.”  Yet Google is still promoting its AI product: “Gemini, a multimodal model from Google DeepMind, is capable of understanding virtually any input, combining different types of information, and generating almost any output.”

5. Facebook/Meta controls social media but has lost $42 billion investing in the still-nascent metaverse. Meta is rolling out three AI features for advertisers: background generation, image cropping and copy variation. Meta also unveiled a generative AI system called Make-A-Scene that allows artists to create scenes from text prompts . Meta’s CTO Andrew Bosworth said the company aims to use generative AI to help companies reach different audiences with tailored ads.

Conclusions:

Voracious demand has outpaced production and spurred competitors to develop rival chips. The ability to secure GPUs governs how quickly companies can develop new artificial-intelligence systems. Tech CEOs are under pressure to invest in AI, or risk investors thinking their company is falling behind the competition.

As we noted in a recent IEEE Techblog post, researchers in South Korea have developed the world’s first AI semiconductor chip that operates at ultra-high speeds with minimal power consumption for processing large language models (LLMs), based on principles that mimic the structure and function of the human brain. The research team was from the Korea Advanced Institute of Science and Technology.

While it’s impossible to predict how fast additional fabricating capacity comes on line,  there certainly will be many more AI chips from cloud giants and merchant semiconductor companies like AMD and Intel.  Fat profit margins Nvidia is now enjoying will surely attract many competitors.

………………………………………………………………………………….,……………………………………….

References:

https://www.zdnet.com/article/how-to-use-the-new-bing-and-how-its-different-from-chatgpt/

https://cloud.google.com/ai/generative-ai

https://aws.amazon.com/what-is/generative-ai/

https://www.wsj.com/articles/amazon-is-going-super-aggressive-on-generative-ai-7681587f

https://ai.meta.com/

Meta wants to use generative AI to create ads

Curmudgeon: 2024 AI Fueled Stock Market Bubble vs 1999 Internet Mania? (03/11)

https://www.investopedia.com/amazon-stock-jumps-amid-retail-business-strength-and-cloud-ai-product-growth-key-price-levels-to-watch-8557842

Korea’s KAIST develops next-gen ultra-low power Gen AI LLM accelerator

Telco and IT vendors pursue AI integrated cloud native solutions, while Nokia sells point products

MTN Consulting: Generative AI hype grips telecom industry; telco CAPEX decreases while vendor revenue plummets

Proposed solutions to high energy consumption of Generative AI LLMs: optimized hardware, new algorithms, green data centers

Amdocs and NVIDIA to Accelerate Adoption of Generative AI for $1.7 Trillion Telecom Industry

Cloud Service Providers struggle with Generative AI; Users face vendor lock-in; “The hype is here, the revenue is not”

Global Telco AI Alliance to progress generative AI for telcos

Bain & Co, McKinsey & Co, AWS suggest how telcos can use and adapt Generative AI

Generative AI Unicorns Rule the Startup Roost; OpenAI in the Spotlight

Generative AI in telecom; ChatGPT as a manager? ChatGPT vs Google Search

Generative AI could put telecom jobs in jeopardy; compelling AI in telecom use cases

Impact of Generative AI on Jobs and Workers

 

IEEE SCV March 28th Event: A Conversation with IEEE President and IEEE Region 6 Director Elect

A Conversation with IEEE President and IEEE Region 6 Director Elect

Time/Date: 5pm-7:30pm March 28, 2024

Venue: Santa Clara University Room SCDI 1302 & 1308 (see map for room location)

Register at: https://events.vtools.ieee.org/m/410534

Abstract:

Please join us for a lively and enlightening conversation with IEEE President Tom Coughlin and IEEE Region 6 Director Elect Joseph Wei, moderated by Alan J Weissberger.  We will discuss and debate how to make IEEE more relevant to its members, explore volunteer opportunities, ways to elevate the awareness and perception of IEEE as the world’s largest tech non-profit organization.

In the past decade, IEEE membership has significantly declined, there are fewer volunteers, and many IEEE initiatives (e.g. 5G, cloud computing, IoT and smart grid) have fizzled.  IEEE Conferences and Journals are now dominated by academia and for the most part are not of interest to industry as the content is not realizable and has little or no practical value.  Many engineers, sales and marketing people think that IEEE is irrelevant and won’t help them advance their careers. Clearly, IEEE has been  in a severe decline for several years.

How can we turn that around?  Can IEEE provide better tools and support for the active volunteers and to grow its professional membership while encouraging student members to upgrade to full membership?  How can we retain, encourage and train younger members to volunteer for officer positions and provide fresh leadership?  Can we find a more equitable balance between industry and academia for IEEE conferences, publications, and local chapters?  What are the important, high priority tech initiatives that IEEE should focus on to ensure success? Finally, can we orchestrate a leadership transition to ensure high priority projects are progressed?

Timeline:

5pm-5:30pm:  Registration and Networking

5:30pm-7pm:  Opening statements by each participant followed by a conversation/debate about IEEE key issues and initiatives.

7pm-7:25pm:  Audience Q & A

7:25pm-7:30pm: Closing remarks and thanks from the participants

References:

https://techblog.comsoc.org/2024/02/05/ieee-presidents-priorities-and-strategic-direction-for-2024/

https://events.vtools.ieee.org/m/410534

IEEE President Elect: IEEE Overview, 2024 Priorities and Strategic Plan

 

Téral Research: global wireless infrastructure market sank 9% YoY in 2023; will decline 6% in 2024

As expected, the global wireless infrastructure market comprised of all  RAN and core networks sank 9% YoY despite a strong China-driven 4Q23 that was not enough to offset 3 consecutive quarters of sales declines.

2023 will be remembered by the U.S. market posting its steepest drop in history, the strong 5G rollouts in China which is way ahead of its government-set target, and India’s fast 5G rollout led by Bharti Airtel and Reliance Jio. Meanwhile, 5G core—mostly fueled by China again, and 5G RAN showed some steam in 4Q23.

In this environment, for 2023, Huawei kept its lead over Ericsson in global market share, followed by Nokia and ZTE, both managed to increase their market share. Samsung remained #5 but lost shares.

We are now entering the third year of this disinvestment cycle. The 5G investment cycle that started in 2019 and ended in 2021 was driven by hundreds of communications service providers (CSPs), including the ones with the world’s largest cellular footprints (i.e., China), and led to a total of 302 commercial 5G networks launched as of December 31, 2023. But the pace is quickly slowing down: by comparison, 2023 was Year 6 for 5G rollouts, at that stage, 360 4G LTE networks were live.

At this point, the global Wireless Infrastructure market will be characterized by much smaller footprints that have yet to be upgraded to 5G as well as 5G-Advanced upgrades for the early 5G adopters, and an open RAN ramp up driven by Tier 1 CSPs. In addition, the slow 5G monetization, the normalization after the 5G surge in China and India and the rise of the secondhand equipment market are chief inhibitors that contribute to the declining pattern.

Nonetheless, there is no new wave in the horizon and as a result, this year, we expect the market to decline 6% compared to 2023, despite an AT&T-induced pickup expected in 2H24 in the U.S. market. In the long run, our CSP 20-year wireless infrastructure footprint pattern analysis points to a 2023-2029 CAGR of -3% characterized by steady declines through 2026, which appears to be the bottom leading to flatness. In fact, we expect 5G to slightly pick up in 2027, driven by 5G-Advanced and other upgrades needed to prepare networks for 6G. Given the ongoing 6G activity, we believe something labeled 6G will be deployed in 2028.

References:

Téral Research :: February 2024 Wireless Infrastructure 4Q23 & FY23 (teralresearch.com)

Dell’Oro: RAN revenues declined sharply in 2023 and will remain challenging in 2024; top 8 RAN vendors own the market

Dell’Oro: Broadband network equipment spending to drop again in 2024 to ~$16.5 B

Global 5G Market Snapshot; Dell’Oro and GSA Updates on 5G SA networks and devices

LightCounting: Wireless infrastructure market down in 2Q-23 (no surprise)

LightCounting: Wireless infrastructure market dropped both YoY and sequentially in 1Q23

IBM: 5G use cases that are transforming the world (really ?)

For many years, this author has been very skeptical about the commercial success of highly touted 5G use cases.  That’s mainly because the 3GPP 5G specs and ITU-R M.2150 5G RIT/SRIT standard did not (and still do not) meet the ITU-R M.2410 minimum performance requirements for the URLLC use case for either ultra high reliability or ultra low latency.

Another reason for our skepticism is that “real 5G,” which provides 3GPP specified 5G features (like network slicing, edge computing/MEC, and 5G Security), requires a 5G SA core network, which relatively few wireless network operators have deployed.

Nonetheless, IBM has published an article citing 5G use cases that are transforming the world. Here they are:

Autonomous vehicles

From taxi cabs to drones and beyond, 5G technology underpins most of the next-generation capabilities in autonomous vehicles. Until the 5G cellular standard came along, fully autonomous vehicles were a bit of a pipe dream due to the data transmission limitations of 3G and 4G technology. Now, 5G’s lightning-fast connection speeds have made transport systems for cars, trains and more much faster than previous generations, transforming the way systems and devices connect, communicate and collaborate.

Smart factories

5G, along with AI and ML, is poised to help factories become not only smarter but more automated, efficient and resilient. Today, many mundane but necessary tasks associated with equipment repair and optimization are being turned over to machines thanks to 5G connectivity paired with AI and ML capabilities. This is one area where 5G is expected to be highly disruptive, impacting everything from fuel economy to the design of equipment lifecycles and how goods arrive at our homes.

For example, on a busy factory floor, drones and cameras connected to smart devices utilizing the IoT can help locate and transport something more efficiently than in the past and prevent theft. Not only is this better for the environment and consumers, but it also frees up employees to dedicate their time and energy to tasks that are more suited to their skill sets.

Smart cities

The idea of a hyper-connected urban environment that uses 5G network speeds to spur innovation in areas like law enforcement, waste disposal and disaster mitigation is fast becoming a reality. Some cities already use 5G-enabled sensors to track traffic patterns in real time and adjust signals, helping guide the flow of traffic, minimize congestion and improve air quality.

In another example, 5G power grids monitor supply and demand across heavily populated areas and deploy AI and ML applications to “learn” what times energy is in high or low demand. This process has been shown to significantly impact energy conservation and waste, potentially reducing carbon emissions and helping cities reach sustainability goals.

Smart healthcare

Hospitals, doctors and the healthcare industry as a whole already benefit from the speed and reliability of 5G networks every day. One example is the area of remote surgery that uses robotics and a high-definition live stream connected to the internet via a 5G network. Another is the field of mobile health, where 5G gives medical workers in the field quick access to patient data and medical history, enabling them to make smarter decisions, faster, and potentially save lives.

Lastly, as we saw during the pandemic, contact tracing and the mapping of outbreaks are critical to keeping populations safe. 5G’s ability to deliver of volumes of data swiftly and securely allows experts to make more informed decisions that have ramifications for everyone.

Better employee experiences

5G paired with new technological capabilities won’t just result in the automation of employee tasks, it will dramatically improve them and the overall employee experience. Take virtual reality (VR) and augmented reality (AR), for example. VR (digital environments that shut out the real world) and AR (digital content that augments the real world) are already used by stockroom employees, transportation drivers and many others. These employees rely on wearables connected to a 5G network capable of high-speed data transfer rates that improve several key capabilities, including the following:

  • Live views: 5G connectivity provides live, real-time views of equipment, events and even people. One way in which this feature is being used in professional sports is to allow broadcasters to remotely call a sporting event from outside the stadium where the event is taking place.
  • Digital overlays: IoT applications in a warehouse or industrial setting allow workers equipped with smart glasses (or even just a smartphone) to obtain real-time insights from an application, including repair instructions or the name and location of a spare part.
  • Drone inspections: Right now, one of the leading causes of employee injury is inspection of equipment or project sites in remote and potentially dangerous areas. Drones, connected via 5G networks, can safely monitor equipment and project sites and even take readings from hard-to-reach gauges.

Edge computing

Edge computing, a computing framework that allows computations to be done closer to data sources, is fast becoming the standard for enterprises. According to this Gartner white paper (link resides outside ibm.com), by 2025, 75% of enterprise data will be processed at the edge (compared to only 10% today). This shift saves businesses time and money and enables better control over large volumes of data. It would be impossible without the new speed standards generated by 5G technology.

Ultra-reliable edge computing and 5G enable the enterprise to achieve faster transmission speeds, increased control and greater security over massive volumes of data. Together, these twin technologies will help reduce latency while increasing speed, reliability and bandwidth, resulting in faster, more comprehensive data analysis and insights for businesses everywhere.

5G solutions with IBM Cloud Satellite

5G presents big opportunities for the enterprise, but first, you need a platform that can handle its speed. IBM Cloud Satellite lets you deploy and run apps consistently across on-premises, edge computing and public cloud environments on a 5G network. And it’s all enabled by secure and auditable communications within the IBM Cloud.  The IBM Cloud Satellite-managed distributed cloud solution delivers cloud services, APIs, access policies, security controls and compliance.

References:

5G use cases that are transforming the world

https://www.ibm.com/products/satellite

Big 5 Event: wireless connectivity use cases for healthcare, network slicing, security and private networks

Qualcomm Introduces the World’s First “5G NR-Light” Modem-RF System for new 5G use cases and apps

MoffettNathanson: 5G use cases and revenue streams have not yet materialized

CELLSMART: 5G upload speeds are insufficient for industrial/enterprise applications

 

BofA on 5G Use Cases and Industry Vertical Applications