Proposed solutions to high energy consumption of Generative AI LLMs: optimized hardware, new algorithms, green data centers
Introduction:
Many generative AI tools rely on a type of natural-language processing called large language models (LLMs) to first learn and then make inferences about languages and linguistic structures (like code or legal-case prediction) used throughout the world. Some companies that use LLMs include: Anthropic (now collaborating with Amazon), Microsoft, OpenAI, Google, Amazon/AWS, Meta (FB), SAP, IQVIA. Here are some examples of LLMs: Google’s BERT, Amazon’s Bedrock, Falcon 40B, Meta’s Galactica, Open AI’s GPT-3 and GPT-4, Google’s LaMDA Hugging Face’s BLOOM Nvidia’s NeMO LLM.
The training process of the Large Language Models (LLMs) used in generative artificial intelligence (AI) is a cause for concern. LLMs can consume many terabytes of data and use over 1,000 megawatt-hours of electricity.
Alex de Vries is a Ph.D. candidate at VU Amsterdam and founder of the digital-sustainability blog Digiconomist published a report in Joule which predicts that current AI technology could be on track to annually consume as much electricity as the entire country of Ireland (29.3 terawatt-hours per year).
“As an already massive cloud market keeps on growing, the year-on-year growth rate almost inevitably declines,” John Dinsdale, chief analyst and managing director at Synergy, told CRN via email. “But we are now starting to see a stabilization of growth rates, as cloud provider investments in generative AI technology help to further boost enterprise spending on cloud services.”
Hardware vs Algorithmic Solutions to Reduce Energy Consumption:
Roberto Verdecchia is an assistant professor at the University of Florence and the first author of a paper published on developing green AI solutions. He says that de Vries’s predictions may even be conservative when it comes to the true cost of AI, especially when considering the non-standardized regulation surrounding this technology. AI’s energy problem has historically been approached through optimizing hardware, says Verdecchia. However, continuing to make microelectronics smaller and more efficient is becoming “physically impossible,” he added.
In his paper, published in the journal WIREs Data Mining and Knowledge Discovery, Verdecchia and colleagues highlight several algorithmic approaches that experts are taking instead. These include improving data-collection and processing techniques, choosing more-efficient libraries, and improving the efficiency of training algorithms. “The solutions report impressive energy savings, often at a negligible or even null deterioration of the AI algorithms’ precision,” Verdecchia says.
……………………………………………………………………………………………………………………………………………………………………………………………………………………
Another Solution – Data Centers Powered by Alternative Energy Sources:
The immense amount of energy needed to power these LLMs, like the one behind ChatGPT, is creating a new market for data centers that run on alternative energy sources like geothermal, nuclear and flared gas, a byproduct of oil production. Supply of electricity, which currently powers the vast majority of data centers, is already strained from existing demands on the country’s electric grids. AI could consume up to 3.5% of the world’s electricity by 2030, according to an estimate from IT research and consulting firm Gartner.
Amazon, Microsoft, and Google were among the first to explore wind and solar-powered data centers for their cloud businesses, and are now among the companies exploring new ways to power the next wave of AI-related computing. But experts warn that given their high risk, cost, and difficulty scaling, many nontraditional sources aren’t capable of solving near-term power shortages.
Exafunction, maker of the Codeium generative AI-based coding assistant, sought out energy startup Crusoe Energy Systems for training its large-language models because it offered better prices and availability of graphics processing units, the advanced AI chips primarily produced by Nvidia, said the startup’s chief executive, Varun Mohan.
AI startups are typically looking for five to 25 megawatts of data center power, or as much as they can get in the near term, according to Pat Lynch, executive managing director for commercial real-estate services firm CBRE’s data center business. Crusoe will have about 200 megawatts by year’s end, Lochmiller said. Training one AI model like OpenAI’s GPT-3 can use up to 10 gigawatt-hours, roughly equivalent to the amount of electricity 1,000 U.S. homes use in a year, University of Washington research estimates.
Major cloud providers capable of providing multiple gigawatts of power are also continuing to invest in renewable and alternative energy sources to power their data centers, and use less water to cool them down. By some estimates, data centers account for 1% to 3% of global electricity use.
An Amazon Web Services spokesperson said the scale of its massive data centers means it can make better use of resources and be more efficient than smaller, privately operated data centers. Amazon says it has been the world’s largest corporate buyer of renewable energy for the past three years.
Jen Bennett, a Google Cloud leader in technology strategy for sustainability, said the cloud giant is exploring “advanced nuclear” energy and has partnered with Fervo Energy, a startup beginning to offer geothermal power for Google’s Nevada data center. Geothermal, which taps heat under the earth’s surface, is available around the clock and not dependent on weather, but comes with high risk and cost.
“Similar to what we did in the early days of wind and solar, where we did these large power purchase agreements to guarantee the tenure and to drive costs down, we think we can do the same with some of the newer energy sources,” Bennett said.
References:
https://aws.amazon.com/what-is/large-language-model/
https://spectrum.ieee.org/ai-energy-consumption
https://www.crn.com/news/cloud/microsoft-aws-google-cloud-market-share-q3-2023-results/6
Amdocs and NVIDIA to Accelerate Adoption of Generative AI for $1.7 Trillion Telecom Industry
SK Telecom and Deutsche Telekom to Jointly Develop Telco-specific Large Language Models (LLMs)
AI Frenzy Backgrounder; Review of AI Products and Services from Nvidia, Microsoft, Amazon, Google and Meta; Conclusions
Amdocs and NVIDIA to Accelerate Adoption of Generative AI for $1.7 Trillion Telecom Industry
Amdocs and NVIDIA today announced they are collaborating to optimize large language models (LLMs) to speed adoption of generative AI applications and services across the $1.7 trillion telecommunications and media industries.(1)
Amdocs and NVIDIA will customize enterprise-grade LLMs running on NVIDIA accelerated computing as part of the Amdocs amAIz framework. The collaboration will empower communications service providers to efficiently deploy generative AI use cases across their businesses, from customer experiences to network provisioning.
Amdocs will use NVIDIA DGX Cloud AI supercomputing and NVIDIA AI Enterprise software to support flexible adoption strategies and help ensure service providers can simply and safely use generative AI applications.
Aligned with the Amdocs strategy of advancing generative AI use cases across the industry, the collaboration with NVIDIA builds on the previously announced Amdocs-Microsoft partnership. Service providers and media companies can adopt these applications in secure and trusted environments, including on premises and in the cloud.
With these new capabilities — including the NVIDIA NeMo framework for custom LLM development and guardrail features — service providers can benefit from enhanced performance, optimized resource utilization and flexible scalability to support emerging and future needs.
“NVIDIA and Amdocs are partnering to bring a unique platform and unmatched value proposition to customers,” said Shuky Sheffer, Amdocs Management Limited president and CEO. “By combining NVIDIA’s cutting-edge AI infrastructure, software and ecosystem and Amdocs’ industry-first amAlz AI framework, we believe that we have an unmatched offering that is both future-ready and value-additive for our customers.”
“Across a broad range of industries, enterprises are looking for the fastest, safest path to apply generative AI to boost productivity,” said Jensen Huang, founder and CEO of NVIDIA. “Our collaboration with Amdocs will help telco service providers automate personalized assistants, service ticket routing and other use cases for their billions of customers, and help the telcos analyze and optimize their operations.”
Amdocs counts more than 350 of the world’s leading telecom and media companies as customers, including 27 of the world’s top 30 service providers.(2) With more than 1.7 billion daily digital journeys, Amdocs platforms impact more than 3 billion people around the world.
NVIDIA and Amdocs are exploring a number of generative AI use cases to simplify and improve operations by providing secure, cost-effective and high-performance generative AI capabilities.
Initial use cases span customer care, including accelerating customer inquiry resolution by drawing information from across company data. On the network operations side, the companies are exploring how to proactively generate solutions that aid configuration, coverage or performance issues as they arise.
(1) Source: IDC, OMDIA, Factset analyses of Telecom 2022-2023 revenue.
(2) Source: OMDIA 2022 revenue estimates, excludes China.
Editor’s Note:
- Language models: These models, like OpenAI’s GPT-3, generate human-like text. One of the most popular examples of language-based generative models are called large language models (LLMs).
- Large language models are being leveraged for a wide variety of tasks, including essay generation, code development, translation, and even understanding genetic sequences.
- Generative adversarial networks (GANs): These models use two neural networks, a generator, and a discriminator.
- Unimodal models: These models only accept one data input format.
- Multimodal models: These models accept multiple types of inputs and prompts. For example, GPT-4 can accept both text and images as inputs.
- Variational autoencoders (VAEs): These deep learning architectures are frequently used to build generative AI models.
- Foundation models: These models generate output from one or more inputs (prompts) in the form of human language instructions.
https://www.nvidia.com/en-us/glossary/data-science/generative-ai/
https://blogs.nvidia.com/blog/2023/01/26/what-are-large-language-models-used-for/
Cloud Service Providers struggle with Generative AI; Users face vendor lock-in; “The hype is here, the revenue is not”
Global Telco AI Alliance to progress generative AI for telcos
Bain & Co, McKinsey & Co, AWS suggest how telcos can use and adapt Generative AI
Generative AI Unicorns Rule the Startup Roost; OpenAI in the Spotlight
Generative AI in telecom; ChatGPT as a manager? ChatGPT vs Google Search
Generative AI could put telecom jobs in jeopardy; compelling AI in telecom use cases
Intentional or Accident: Russian fiber optic cable cut (1 of 3) by Chinese container ship under Baltic Sea
A Russian fiber optic cable under the Baltic Sea was completely severed last month when a Chinese container ship passed over it, state company Rostelecom said on Tuesday.
Finnish investigators have already said they suspect the vessel, the NewNew Polar Bear, of causing serious damage to the nearby Balticconnector gas pipeline by dragging its anchor over the sea bed during the same voyage.
Two other Baltic telecoms cables were damaged on the same night of October 7th, along the route that the ship was travelling, according to shipping data reviewed by Reuters.
The incidents have highlighted the vulnerability of marine cables and pipelines at a time when security fears are running high because of the Ukraine war. Investigators have yet to establish who was responsible for blowing up Russia’s Nord Stream gas pipelines under the Baltic last year.
A Rostelecom spokesperson, responding to emailed questions from Reuters, said the double armored fiber optic cable, with a thickness of 40.4 mm (1.6 inches), had been cut completely.
Asked if the company believed the Chinese ship had caused the damage, the spokesperson said: “At the time of the damage to the fiber optic cable, the Chinese ship New Polar Bear was at a point with coordinates coinciding with the route of the communication line.”
China has said it is willing to provide necessary information on the incident in accordance with international law. NewNew Shipping, the owner and operator of the NewNew Polar Bear, has previously declined to comment when contacted by Reuters.
In a statement earlier on Tuesday, Rostelecom publicly acknowledged the damage to its cable for the first time, describing it as an accident and without mentioning the cause. It said the site of the damage was only 28 km (17 miles) from where the Balticconnector gas pipeline was ruptured soon afterwards.
In total, three Baltic telecoms cables and one pipeline were damaged in the space of less than nine hours.
Data from shipping intelligence firm MarineTraffic, reviewed by Reuters, showed that the New Polar Bear passed over a Swedish-Estonian telecoms cable at 1513 GMT, then over the Russian cable at around 2020 GMT, the Balticconnector at 2220 GMT and a Finland-Estonia telecoms line at 2349 GMT.
Rostelecom said the damage to its cable was recorded at 2030 GMT.
As far back as Oct. 13, President Vladimir Putin dismissed as “complete rubbish” suggestions that Russia might have been to blame for the Balticconnector damage and floated the possibility that a ship’s anchor could have caused it.
On Tuesday, the Kremlin referred further questions to the Communications Ministry, which did not respond to a Reuters request for comment.
Finnish police announced on Oct. 24 that they had found a ship’s anchor near the broken gas pipeline. They have not concluded whether the damage was caused accidentally or deliberately. Operator Gasgrid has said the pipeline could be out of commission until April or longer.
Rostelecom said a specialised vessel had started repairs on the fiber optic cable on Sunday and that the work was expected to take 10 days, depending on weather conditions.
The cable runs from St Petersburg to Russia’s Baltic exclave of Kaliningrad. The company said users had not been affected because data was transmitted via terrestrial routes and backup satellite channels.
References:
China seeks to control Asian subsea cable systems; SJC2 delayed, Apricot and Echo avoid South China Sea
Sabotage or Accident: Was Russia or a fishing trawler responsible for Shetland Island cable cut?
Geopolitical tensions arise in Asia over subsea fiber optic cable projects; U.S. intervened to flip SeaMeWe-6 contractor
Verizon once again delays 5G Standalone (SA) commercial service
Like AT&T, Verizon has promised 5G standalone (SA) core network for a very long time. The mostly wireless U.S. carrier initially said it would launch standalone 5G in 2020. Some in the industry thought it did so in 2022. But the company said the technology ‘is in testing now’ and is still not available commercially.
“We have it in trials only at this point. We don’t have it commercially available for our customers,” Verizon’s chief networking executive, Joe Russo, said on a podcast last month hosted by Recon Analytics. “So more to come in the next several months as Verizon will be entering the standalone core game.”
“It is absolutely a capability that we think will be another enabler to new use cases. But … the reliability and performance of Verizon’s network is what we stand for, and I don’t put technology out into the network that is a step back. It has to be a step forward. And all of the data that I see – both internal testing and with external testing that happens out there in the market – tells me that SA [standalone] needs a little bit more time.”
“We’re doing significant developing and testing to make sure that both the data session and the voice sessions in a standalone world are as good or better than what you would expect in our 4G network today. So we see that in the next several months we’re going to get there, but it was not my goal to be first in deploying standalone. It’s my goal to be best in deploying standalone.”
……………………………………………………………………………………………………………………………..
Verizon spokesperson Kevin King clarified that “we have commercial traffic running on our 5G non standalone core. That is what we announced earlier in the year. Joe was referring to our 5G standalone core which is in testing now.”
That cop-out was contradicted by a statement made during a webinar for analysts on September 29th, which was obtained by Light Reading. “People talk about the standalone core. Just terminology-wise, that’s the 5G core essentially. If you guys have read the stuff we’ve said publicly, certainly we serve some customers on portions of our 5G core,” said Mike Haberman, Verizon’s SVP of strategy and transformation, And then we have some internal stuff going on with other functionality on the core. We’re in the process of rolling out (5G SA) in a very smart fashion.”
“Here’s the deal: When you go to the standalone core, you can’t aggregate your LTE carriers. With the non standalone core I’m aggregating together both 5G and 4G. So when you go standalone you start to bifurcate the spectrum. So that’s the impact to the RAN [radio access network]. So you better be sure that your mobile [customer] distribution, where they are geography, makes sense. Or what will happen is those customers will experience a lower service level. No good. We want to be careful of that. So that’s why, when you do the standalone core, you have to pay very close attention to your radio access network because they are directly attached.”
On April 27th Verizon issued a press release describing the benefits of 5G standalone (SA) technology and how it’s “what sets Verizon apart.” However, the release doesn’t specifically say that Verizon launched the technology. That despite Verizon last year announced it had begun moving traffic onto its new 5G core, which supports both the non standalone (NSA) and standalone (SA) versions of the technology.
Last year, Mobile World Live reported that Verizon was migrating “commercial traffic onto SA 5G core.” The article cited an unnamed Verizon representative. Mobile World Live also reported that Ericsson, Casa Systems, Oracle and Nokia supply Verizon’s 5G core.
Dell’Oro Group, in January 2023, listed Verizon among the few North American wireless providers that had commercially launched the technology.
“This is a moving target,” Recon Analytics analyst Roger Entner told Light Reading. But Entner said Verizon’s position on the standalone version of 5G makes sense. “The benefits you can get today from standalone are limited.”
–>This author totally disagrees with Mr. Entner, because TRUE 5G=5G SA. IN OTHER WORDS, ALL OF THE 3GPP DEFINED 5G FEATURES REQUIRE 5G SA! That includes 5G security and network slicing.
…………………………………………………………………………………………………………………………………
Light Reading’s Mike Dano wrote:
Verizon now appears to be roughly three years behind its initial standalone 5G rollout plans. In the summer of 2020, Verizon said it would begin moving traffic onto its standalone 5G core “in the second half of 2020 with full commercialization in 2021.”
Then, in early 2022, Verizon CTO Kyle Malady suggested that the operator would begin moving some of its fixed wireless access (FWA) traffic onto its standalone 5G core by June of that year. He also said at the time that Verizon would start putting smartphone traffic onto that core in 2023.
………………………………………………………………………………………………………….
T-Mobile US and Dish Wireless are the only two 5G carriers that have launched commercial 5G SA. AT&T has made a lot of noise about it’s 5G SA plans but has yet to launch.
AT&T’s chief networking executive, Chris Sambar, wrote in a September 29th blog post that AT&T was moving some customers to standalone 5G. “Many of the newest mobile devices are ready for 5G standalone, and we continue to move thousands of customers every day. We also recently launched AT&T Internet Air home fixed wireless service, and from the start, this product rides on standalone 5G.”
https://www.lightreading.com/5g/verizon-surprises-with-ongoing-delays-in-5g-standalone-rollout
https://www.verizon.com/about/news/5g-standalone-why-it-matters
https://about.att.com/blogs/2023/network-ready.html
AT&T touts 5G advances; will deploy Standalone 5G when “the ecosystem is ready”- when will that be?
Analysys Mason: 40 operational 5G SA networks worldwide; Sub-Sahara Africa dominates new launches
GSA 5G SA Core Network Update Report
5G subscription prices rise in U.S. without killer applications or 5G features (which require a 5G SA core network)
SpaceX has majority of all satellites in orbit; Starlink achieves cash-flow breakeven
SpaceX accounts for roughly one-half of all orbital space launches around the world, and it’s growing its launch frequency. It also has a majority of all the satellites in orbit around the planet. This Thursday, majority owner & CEO Elon Musk tweeted, “Excited to announce that SpaceX Starlink has achieved breakeven cash flow! Starlink (a SpaceX subsidiary) is also now a majority of all active satellites and will have launched a majority of all satellites cumulatively from Earth by next year.”
There are some 5,000 Starlink satellites in orbit. Starlink satellites are small, lower-cost satellites built by SpaceX that deliver high-speed, space-based internet service to customers on Earth. Starlink can cost about $120 a month and there is some hardware to buy as well.
Starlink ended 2022 with roughly 1 million subscribers. The subscriber count now isn’t known, but it could be approaching 2 million users based on prior growth rates. SpaceX didn’t return a request for comment.
In 2021, Musk said SpaceX would spin off and take Starlink public once its cash flow was reasonably predictable.
A SpaceX rocket carriers Starlink satellites into orbit. PHOTO CREDIT: SPACEX
Starlink has been in the spotlight since last year as it helps provide Ukraine with satellite communications key to its war efforts against Russia.
Last month, Musk said Starlink will support communication links in Gaza with “internationally recognized aid organizations” after a telephone and internet blackout isolated people in the Gaza Strip from the world and from each other.
Musk has sought to establish the Starlink business unit as a crucial source of revenue to fund SpaceX’s more capital-intensive projects such as its next-generation Starship, a giant reusable rocket the company intends to fly to the moon for NASA within the next decade.
Starlink posted a more than six-fold surge in revenue last year to $1.4 billion, but fell short of targets set by Musk, the Wall Street Journal reported in September, citing documents.
SpaceX is valued at about $150 billion and is one of the most valuable private companies in the world.
References:
https://www.barrons.com/articles/elon-musk-spacex-starlink-86fe99ec?
Verizon transports 1.2 terabytes per second of data across a single wavelength
Verizon has upgraded its optical to electrical conversion cards to send data at speeds of 1.2 Tbps on a single wavelength through the carrier’s live production network. The trials demonstrated increased reliability and overall capacity as well, Verizon said.
The trials, which were conducted in metro Long Island, N.Y., were in partnership with Cisco and included technology from Acacia, as well. They utilized Cisco’s NCS 1014 transceiver shelf and Acacia’s Coherent Interconnect Module (CIM 8). Verizon said the module features silicon semiconductor chips with 5nm complementary metal-oxide semiconductor (CMOS) digital processing and 140 Gbaud silicon photonics using 3D packaging technology. In short, digital processing capabilities and transistor density both are increased.
Verizon said that it transmitted a 1.0 Tbps single wavelength through the Cisco NCS 20000 line system for more than 205 km. It traversed 14 fiber central offices (COs). The carrier said this is significant because progressive filtering and signal-to-noise degradation impact wavelengths as they pass through each CO. The trials also featured 800 Gbps transmission for 305 km through 20 COs — and a 1.2 Tbps wavelength that traversed three offices.
“We have bet big on fiber. Not only does it provide an award-winning broadband experience for consumers and enterprises, it also serves as the backbone of our wireless network. As we continue to see customers using more data in more varied ways, it is critical we continue to stay ahead of our customers’ demands by using the resources we have most efficiently,” said Adam Koeppe, SVP of Technology Planning at Verizon.
Image courtesy of Verizon
In addition to increasing data rates, the new optics technology from Cisco reduces the need for regeneration of the light signal (conversion to electrical and back to optical signals) along the path by compensating for the degradation of the light signal traveling through the fiber cable. This adds reliability and leads to a reduced cost per bit operating expense for more efficient network management.
Bill Gartner, senior vice president and general manager of Cisco Optical Systems and Optics, added, “This trial demonstrates our commitment to continuous innovation aimed at increasing wavelength capacity and reducing costs. The Verizon infrastructure built with the Cisco NCS 2000 open line system supports multiple generations of optics, thus protecting investments as technology evolves.”
In March, Windstream Wholesale said that it sent a 1 Tbps wave across its Converged Optical Network (ICON) between Dallas and Tulsa, a distance of 541 km.
References:
https://www.verizon.com/about/news/verizon-fiber-technology-advancement-results
Verizon Touts 1.2 Tbps Wavelengths Over Production Network – Telecompetitor
https://www.verizon.com/about/news/verizon-transports-800-gbps
AT&T, Verizon and Comcast all lost fixed broadband subscribers in 2Q-2023
Tutorial: Utilizing Containers for Cloud-Native and Elastic SBCs
by Bhupen Chauhan (edited by Alan J Weissberger)
Introduction:
A recent advancement in Session Border Controllers (SBCs) involves moving them to the cloud and utilizing elasticity. The use of Containers (defined below) intensifies this change even more. SBC solutions are essential for businesses. Service providers depend on Voice over IP (VoIP), because they provide security, interoperability, quality, and compliance in their communication infrastructure. We’ll delve further into the world of Cloud Native/Elastic SBCs using containers in this post.
What is a SBC?
A Session Border Controller (SBC) is a specialized hardware device or software program that controls how phone calls are answered, carried out, and ended as VoIP. They act as gatekeepers between internal and external networks, managing the media streams and signals necessary for establishing, carrying out, and terminating calls.
A SBC establishes and keeps track of each session’s quality of service (QoS) state, guaranteeing calls must be answered correctly, and urgent calls take precedence over all other calls. Additionally, an SBC can act as a firewall for session traffic by enforcing its QoS policies and recognizing particular inbound threats to the communication environment.
SBC’s Significance in Communications:
By providing security, guaranteeing interoperability, and enabling the effective use of network resources, SBCs strengthen communication networks. Here are several reasons to have Session Border Controller in VoIP Phone System and protect IP communications, defending against intrusions and offering essential functions, including:
- Security: An SBC’s most important responsibility is to defend the network against hostile assaults, including fraud, eavesdropping, and denial of service (DoS) attacks. They add a layer of security by concealing the network topology.
- Quality of Service (QoS): SBCs ensure that voice calls have the capacity and resources to remain high-quality by prioritizing voice traffic over other kinds of traffic.
- Interoperability: SBCs provide smooth communication between various devices, protocols, and signaling in IP networks by offering the required protocol translations.
- NAT Traversal: VoIP communication may encounter problems due to Network Address Translation (NAT). By fixing NAT traversal issues, SBCs guarantee reliable and continuous communications.
- Call Routing and Policy Enforcement: SBCs effectively route calls according to rules and specifications. They can also control bandwidth usage and implement various payment methods.
- Regulatory Compliance: Communication service providers are required in some areas to offer the ability to intercept communications legally. SBCs help VoIP service providers in fulfilling these kinds of legal obligations.
- Media services: Comprise functions like tone production, DTMF (dual-tone multi-frequency) interworking, and transcoding (changing one codec to another).
SBCs are essential to today’s communications environment, particularly regarding IP-based voice and video communications. Cloud-based and elastic SBCs will play a more significant role as communications change and more services go to the cloud. Now, we will together understand the concept of Cloud Native and Elastic SBCs.
What are Cloud Native and Elastic SBCs?
A strategy for developing and executing programs that takes advantage of the cloud computing concept is known as cloud-native. Conversely, Elastic SBCs describe a system’s capacity to adjust automatically to variations in workload by allocating and releasing resources.
Traditional SBCs and Cloud Native/Elastic SBCs are different as we now explain.
Traditional SBCs vs. Cloud Native/Elastic SBCs:
Traditional SBCs lack flexibility and are usually hardware-based. They might be expensive and difficult to expand or change. In comparison, Cloud Native/Elastic SBCs are highly adaptable. They provide cost-effectiveness and agility by effortlessly scaling up or down in response to demand.
Elasticity’s Function in Communication Services:
Elasticity guarantees continuous communication services that can adjust to heavy demands, particularly during peak hours. It implies that networks may scale resources without human intervention, ensuring service quality without taxing the infrastructure or adding needless expenses.
………………………………………………………………………………………………………………………………………
What are Containers?
Containers are small, independent, executable software packages containing all the necessary components to run a piece of software, guaranteeing that it performs consistently in various computing settings.
Function of Containers in the Modern Applications Deployment:
Containers offer an unequaled level of consistency and speed, revolutionizing how programs are delivered. They contain an application and all its dependencies, guaranteeing that it functions the same everywhere it is deployed.
Kubernetes and Docker:
Docker technology creates, transports, and operates applications inside containers. Meanwhile, Kubernetes’s container orchestration technology ensures that massive container deployments are effectively scaled and managed.
The Research and Markets predicts the global Kubernetes market is anticipated to expand significantly, rising from USD 1.8 billion in 2022 to USD 7.8 billion by 2030, with a spectacular Compound Annual Growth Rate (CAGR) of 23.4%
Use of Containers in SBCs:
SBCs benefit from unrivaled scalability, flexibility, and agility thanks to containers. They enable rapid deployments, guarantee consistency across many environments, and dramatically cut overall overheads—financially and in terms of time. Using Containers involves:
- Individual micro-services package and deploy using containers such as Docker. It guarantees scalability, isolation, and effective resource use.
- It can easily update services, rolled back, and versioned.
Architectural Considerations for Creating Cloud-Native Applications:
Scalability, Redundancy, Resilience, and Performance considerations are crucial when constructing Cloud Native/Elastic SBCs with containers. Architectures must be modular, and facilities must be made for smooth upgrades and patches that don’t interfere with running services. The following architectural factors should be taken into account while creating and deploying Cloud Native/Elastic SBCs using containers:
Disentanglement of Elements:
- Conventional SBCs frequently integrate several features into a single monolithic system.
- Micro-services design, in which every function (signaling, media processing, transcoding, security, etc.) is a separate, independent service, is the best way to create cloud-native SBCs.
Coordination:
- Containerized SBC micro-services can be managed and orchestrated by tools such as Kubernetes, which guarantees their efficient scheduling, scaling, and maintenance.
- Consider putting service mesh technologies into practice for enhanced traffic management and security.
State Administration:
- Active call sessions require careful management.
- Consider utilizing state full sets in Kubernetes or distributed databases to maintain a session state.
High Redundancy and Availability:
- Should guarantee redundancy over several zones or regions Via cloud-native design.
- Incorporate self-healing procedures and health checks to ensure uninterrupted service availability.
Converting SBCs to a containerized, cloud-native architecture has benefits for maintainability, scalability, and flexibility. However, careful architectural considerations are necessary to guarantee cost-effectiveness, security, and performance.
Containers Networking for Real-Time Communication:
The networking element of containers is essential in the area of real-time communication. It guarantees seamless switching between media streams, satisfies low-latency specifications, and ensures that Quality of Service (QoS) standards.
Elastic and Cloud Native SBC Security and Compliance:
SBCs play a crucial role in addressing security. Strong security measures are required for Cloud Native/Elastic SBCs to thwart threats, prevent unwanted access, and guarantee data privacy. They must also adhere to industry norms and laws to ensure reliable communication connections.
Prospects for the Future and the Changing Scene for Cloud Native SBCs:
SBCs will likely interact more deeply with cloud ecosystems in the future, utilizing AI and machine learning to provide more innovative and adaptive features. To support developing IoT and 5G use cases, edge computing may also play a more significant part in Cloud Native SBCs.
Conclusions:
A significant improvement in the evolution of network security and telecommunications has been realized cloud-native and elastic principles and the power of containers. This new paradigm is poised to completely reshape communication networks in the future since it provides agility, scalability, and efficiency. As we embrace containerization and the cloud, the possibilities are endless, opening the prospect of a more efficient, safe, and networked world.
References:
Session Border Controller (SBC) for Enterprises and VoIP Service Providers
Ericsson’s India 6G Research Program at its Chennai R&D Center
Today at the India Mobile Congress 2023, Ericsson announced the launch of its ‘India 6G‘ program with the establishment of an India 6G Research team at its Chennai R&D Center. Ericsson stated that the ‘India 6G’ team consists of senior research members and a team of experienced researchers in Radio, Networks, AI, and Cloud. They have been tasked with developing fundamental solutions for the future.
The India Research team, in collaboration with Ericsson research teams in Sweden and the US, will work together to develop the technology that will enable the delivery of a cyber-physical continuum. In this continuum, networks will provide critical services, immersive communications, and omnipresent IoT, all while ensuring the integrity of the delivered information.
The 6G Research team in India, in collaboration with Ericsson Global Research teams, will develop novel solutions. The teams are working on various projects, including Channel Modelling and Hybrid Beamforming, Low-energy Networks, Cloud Evolution and Sustainable Computing, Trustworthy, Explainable, and Bias-Free AI algorithms, Autonomous Agents for Intent Management Functions, Integrated Sensing and Communication Functions for the Man-Machine Continuum, and Compute Offload to Edge-Computing Cloud, among others.
“By establishing a dedicated 6G research team for in-country research, contextual to India’s need and collaborating with the world class research programs across international research labs, we look forward to incorporating the needs of India into the mainstream of telecommunication technology evolution. “stated Magnus Frodigh, Head of Research at Ericsson.
Ericsson says it is partnering with premier institutes in India for Radio, AI and Cloud Research. The company said, “AI Research is of high importance to Ericsson as the 6G networks would be autonomously driven by AI algorithms. Ericsson is also looking to partner with other premier engineering institutes in India for 6G related research.”
The Centre for Responsible AI is an interdisciplinary research centre that envisions becoming a premier research centre for both fundamental and applied research in Responsible AI with immediate impact in deploying AI systems in the Indian ecosystem. AI Research is of high importance to Ericsson as the 6G networks would be autonomously driven by AI algorithms. Ericsson is also looking to partner with other premier engineering institutes in India for 6G related research.
Ericsson in India:
Ericsson is reportedly partnering with Communication Service Providers, Bharti Airtel, and Reliance Jio to deploy 5G in the country.
According to the statement, Ericsson has been present in India since 1903, and the Ericsson Research team was established in 2010. With the establishment of 6G Research in India, Ericsson looks forward to playing a key role in advancing this technology in the country.
The company has three R&D centres in India, located in Chennai, Bengaluru, and Gurgaon.
References:
https://www.ericsson.com/en/press-releases/2/2023/10/ericsson-initiates-india-6g-program-in-india
https://telecomtalk.info/ericsson-announces-india-6g-program-at-imc2023/889172/
India unveils Bharat 6G vision document, launches 6G research and development testbed
Enable-6G: Yet another 6G R&D effort spearheaded by Telefónica de España
Nokia to open 5G and 6G research lab in Amadora, Portugal
6th Digital China Summit: China to expand its 5G network; 6G R&D via the IMT-2030 (6G) Promotion Group
China to introduce early 6G applications by 2025- way in advance of 3GPP specs & ITU-R standards
Charter Communications adds broadband subs and raises CAPEX forecast
Cableco Charter Communications added 63,000 broadband internet subscribers in the third quarter. Net adds in new markets hit 31,000 in the third quarter, accelerating from 26,000 last quarter. A note from New Street Research said the company passed fewer homes in new markets than expected, “and so the pace of penetration growth is tracking ahead of expectations.”
Charter’s third-quarter revenue of $13.6 billion grew by 0.2% year-over-year, driven by residential internet revenue growth of 3.7%, residential mobile service revenue growth of 33.8% and other revenue growth of 28.8%, mostly driven by higher mobile device sales.
Free cash flow of $1.1 billion decreased from $1.5 billion in the prior year, due to higher capital expenditures, mostly driven by Charter’s network evolution and expansion initiatives.
As of September, Charter had a total of 32.2 million residential and SMB customer relationships, excluding mobile-only relationships.
“We continue to make significant progress against the multi-year strategic initiatives we outlined last year,” said Chris Winfrey, President and CEO of Charter. “These initiatives drive continuing improvements in the quality of our products, and when combined with our customer-friendly pricing and packaging and high-quality service, will drive significant, long-term growth in shareholder value.”
…………………………………………………………………………………………………………………….
On its earnings call, CEO Winfrey said that “given the greater subsidized rural passings and construction opportunity,” Charter may even look to partially fund those new markets by “very modestly slowing our network evolution plan” — which includes upgrades to its hybrid fiber-coaxial footprint.
Winfrey said Charter expects to add approximately 300,000 new subsidized rural (NSR) passings in 2023 and to accelerate that pace in 2024. In the third quarter, 78,000 rural passings were activated. He added that Charter is ahead with its Rural Digital Opportunity Fund (RDOF) builds and “will end up with more (rural) passings than originally expected.”
However, NSR said Charter’s results in core markets were “disappointing,” with adds of 47,000 way below their estimate of 79,000. While NSR expected stabilization in pressure from fixed wireless access (FWA), Charter continues to see some impact from FWA competitors in the lower usage and price sensitive customer segments of its residential and SMB businesses.
Charter is raising its capital-expenditures (CAPEX) forecast for the year as it pours billions back into upgrading its network and its Xumo business. The company now expects to spend about $7.2 billion in CapEx, up from prior guidance of $6.5 billion to $6.8 billion. That excludes line-extension CapEx, which is still expected to be about $4 billion for the year. The $7.2 billion will be put to work upgrading and maintaining the cable company’s network. Some of it will also go toward sending Xumo stream boxes to customers. Xumo is a joint venture between Charter and Comcast that offers free ad-supported streaming TV. Charter shares fall 6%.
References:
https://corporate.charter.com/newsroom/charter-announces-third-quarter-2023-results
https://www.fiercetelecom.com/broadband/charter-adds-63k-subscribers-q3-eyes-more-rural-builds
Precision Optical Technologies (OT) in multi-year “strategic partnership” to upgrade Charter Communications optical network
Charter Communications selects Nokia AirScale to support 5G connectivity for Spectrum Mobile™ customers
T-Mobile and Charter propose 5G spectrum sharing in 42GHz band
Comcast Xfinity Communities Wi-Fi vs Charter’s Advanced Wi-Fi for Spectrum Business customers
Huawei reports 1% YoY revenue growth in 3Q-2023; smartphone sales increase in China
Huawei reported a flat third quarter, with sales of 145.7 billion Chinese yuan ($19.9 billion), up just 1% over last year and a net profit margin of 16.0%. The Shenzhen based telecom equipment and mobile phone vendor said the profit margin had been boosted by the latest tranche from the sale of the Honor handset assets three years ago. It said improved efficiencies and optimized sales and product strategies had also had a positive impact on profitability.
“The company’s performance is in line with forecast,” said Ken Hu, Huawei’s Rotating Chairman. “I’d like to thank our customers and partners for their ongoing trust and support. Moving forward, we will continue to increase our investment in R&D to make the most of our business portfolio and take the competitiveness of our products and services to new heights. As always, our goal is to create greater value for our customers, partners, and society.”
Huawei reported growth in the consumer business unit and “strong growth” in the new digital power and cloud businesses, but the company was silent on its carrier equipment unit, its largest, suggesting it has also been hit by the decline in operator spending.
Huawei smartphone summary:
Huawei was the fastest-growing smartphone maker in China in the third quarter after the company released a smartphone with a surprisingly advanced chip inside.
- In September, Huawei launched the Mate 60 Pro in China. It’s equipped with an advanced chip and 5G connectivity, technology that U.S. sanctions had been designed to stop Huawei getting its hands on.
- The success of that device helped Huawei’s smartphone sales in China grow 37% year on year, according to a report from Counterpoint Research.
- Sales of Honor, the largest smartphone maker by market share, rose just 3% year on year. Vivo, Oppo and Apple all saw double-digit declines, according to Counterpoint Research.
References:
https://www.huawei.com/en/news/2023/10/businessresults-threequarters
https://www.lightreading.com/5g/huawei-reports-no-real-growth-in-q3
https://www.lightreading.com/5g/huawei-lifts-handset-outlook-wins-1b-in-5g-orders