AI/ML
Korea’s KAIST develops next-gen ultra-low power Gen AI LLM accelerator
Researchers in South Korea have developed the world’s first artificial intelligence (AI) semiconductor chip that operates at ultra-high speeds with minimal power consumption for processing large language models (LLMs), based on principles that mimic the structure and function of the human brain.
The research team was from the Korea Advanced Institute of Science and Technology (KAIST) PIM Semiconductor Research Center and the Graduate School of AI Semiconductor (led by Professor Yu Hoi-jun). This ultra-low power “complementary transformer” semiconductor using Samsung Electronics’ 28 nm process as announced by Korea’s Ministry of Science and ICT on Feb. 6th. The chip is 41 times smaller in area than the Nvidia AI processor, enabling it to be used on devices like mobile phones.
The new AI chip successfully ran GPT 2 using only 1/625 of the power consumption and at 1/41 the size of Nvidia’s A100 graphics processing unit (GPU). This breakthrough is considered a key development in the escalating global AI semiconductor war.
Previously, the technology was less accurate than deep neural networks (DNNs) and mainly capable of simple image classifications, but the research team succeeded in improving the accuracy of the technology to match that of DNNs to apply it to LLMs.
The team said its new AI chip optimizes computational energy consumption while maintaining accuracy by using unique neural network architecture that fuses DNNs and SNNs, and effectively compresses the large parameters of LLMs.
A photo describing an artificial intelligence chip which processes a large language model with neuromorphic computing technology provided by the Ministry of Science and ICT on March 6, 2024.
References:
China backed Volt Typhoon has “pre-positioned” malware to disrupt U.S. critical infrastructure networks “on a scale greater than ever before”
On Sunday, FBI Director Christopher Wray said Beijing’s efforts to covertly plant offensive malware inside U.S. critical infrastructure networks [1.] is now at “a scale greater than we’d seen before,” an issue he has deemed a defining national security threat. He said that China backed Volt Typhoon was pre-positioning malware that could be triggered at any moment to disrupt U.S. critical infrastructure. “It’s the tip of the iceberg…it’s one of many such efforts by the Chinese,” he said on the sidelines of the security conference.
Wray had earlier told conference delegates, that China was increasingly inserting “offensive weapons within our critical infrastructure poised to attack whenever Beijing decides the time is right.” The FBI chief said the U.S. is particularly focused on the threat of pre-positioning, which some European officials have described as the cyber equivalent of pointing a ballistic missile at critical infrastructure. “Those attacks are now being amplified by artificial intelligence tools. The word ‘force multiplier’ is not really enough,” Wray added.
Note 1. The FBI Director declined to elaborate on what other critical infrastructure had been targeted, stressing that the Bureau had “a lot of work under way.”
Image Credits: imaginima / Getty Images
Machine learning translation has helped Chinese security operatives to more plausibly recruit assets, steal secrets and rapidly process more of the information they are collecting, the Wray said. “They already have built economic espionage and theft of personal and corporate data as a kind of a bedrock of their economic strategy and are eagerly pursuing AI advancements to try to accelerate that process,” Wray added.
FBI Director Christopher Wray PHOTO: KEVIN DIETSCH/GETTY IMAGES
……………………………………………………………………………………………………………………………
Western intelligence officials say China’s scale and sophistication of cyberattacks has accelerated over the past decade. Officials have grown particularly alarmed at Beijing’s interest in infiltrating U.S. critical infrastructure networks, planting malware inside U.S. computer systems responsible for everything from safe drinking water to aviation traffic so it could detonate, at a moment’s notice, damaging cyberattacks during a conflict.
In California, Wray met with counterparts from the Five Eyes intelligence community—which encompasses the U.S., Australia, New Zealand, Canada and the U.K.—to share respective strategies for cyber defense. He has also traveled to Malaysia and India to discuss China’s hacking campaign with authorities in both countries.
“I am seeing more from Europe,” he said. “We’re laser focused on this as a real threat and we’re working with a lot of partners to try to identify it, anticipate it and disrupt it.”
The Netherlands’ spy agencies said earlier this month that Chinese hackers had used malware to gain access to a Dutch military network last year. The agency, considered to have one of Europe’s top cyber capabilities, said it made the rare disclosure to show the scale of the threat and reduce the stigma of being targeted so allied governments can better pool knowledge.
A report released this month by agencies including the FBI, the Cybersecurity and Infrastructure Agency and the National Security Agency said Volt Typhoon hackers had maintained access in some U.S. networks for five or more years, and while it targeted only U.S. infrastructure directly, the infiltration was likely to have affected “Five Eyes” allies.
Author’s Note:
……………………………………………………………………………………………………………………………
Volt Typhoon, the China-sponsored hacking group, has been targeting U.S. critical infrastructure, including satellite and emergency management services and electric utilities, according to a new report from the industrial cybersecurity firm Dragos. That report outlines how the notorious hacking group is positioning themselves to have disruptive or destructive impacts on critical infrastructure in the U.S.
Robert M. Lee, founder and CEO of Dragos, warned during a media briefing that Volt Typhoon is not an opportunistic group, but is instead targeting specific sites that assist U.S. adversaries “trying to hurt or cripple U.S. infrastructure. It’s hitting the specific electric and satellite communication providers that would be important for disrupting major portions of the U.S. electric infrastructure,” Lee added.
The report comes shortly after the National Security Agency, FBI, and Cybersecurity and Infrastructure Security Agency, revealed that Volt Typhoon has been in some critical infrastructure networks for at least five years. That alert warned of Volt Typhoon operations that targeted the aviation, railways, mass transit, highway, maritime, pipeline, and water and sewage sectors.
……………………………………………………………………………………………………………………………………………………………………………………………………………………………………
The NSA, CISA and FBI said in a joint advisory report that Volt Typhoon has been burrowing into the networks of aviation, rail, mass transit, highway, maritime, pipeline, water and sewage organizations — none of which were named — in a bid to pre-position themselves for destructive cyberattacks, published on February 7th. The release of the advisory, which was co-signed by cybersecurity agencies in the United Kingdom, Australia, Canada and New Zealand, comes a week after a similar warning from FBI Director Christopher Wray. Speaking during a U.S. House of Representatives committee hearing on cyber threats posed by China, Wray described Volt Typhoon as “the defining threat of our generation” and said the group’s aim is to “disrupt our military’s ability to mobilize” in the early stages of an anticipated conflict over Taiwan, which China claims as its territory.
According to Wednesday’s technical advisory, Volt Typhoon has been exploiting vulnerabilities in routers, firewalls and VPNs to gain initial access to critical infrastructure across the country. The China-backed hackers typically leveraged stolen administrator credentials to maintain access to these systems, according to the advisory, and in some cases, they have maintained access for “at least five years.”
This access enabled the state-backed hackers to carry out potential disruptions such as “manipulating heating, ventilation, and air conditioning (HVAC) systems in server rooms or disrupting critical energy and water controls, leading to significant infrastructure failures,” the advisory warned. In some cases, Volt Typhoon hackers had the capability to access camera surveillance systems at critical infrastructure facilities — though it’s not clear if they did.
Volt Typhoon also used living-off-the-land techniques, whereby attackers use legitimate tools and features already present in the target system, to maintain long-term, undiscovered persistence. The hackers also conducted “extensive pre-compromise reconnaissance” in a bid to avoid detection. “For example, in some instances, Volt Typhoon actors may have abstained from using compromised credentials outside of normal working hours to avoid triggering security alerts on abnormal account activities,” the advisory said.
Earlier this year, the FBI and U.S. Department of Justice announced that they had disrupted the “KV Botnet” run by Volt Typhoon that had compromised hundreds of U.S.-based routers for small businesses and home offices. The FBI said it was able to remove the malware from the hijacked routers and sever their connection to the Chinese state-sponsored hackers.
According to a May 2023 report published by Microsoft, Volt Typhoon has been targeting and breaching U.S. critical infrastructure since at least mid-2021.
……………………………………………………………………………………………………………………………………………………………………………………………………………………………..
References:
Volt Typhoon targeted emergency management services, per report
US disrupts China-backed hacking operation amid warning of threat to American infrastructure
https://www.controlglobal.com/home/blog/11293192/information-technology
Taiwan’s ITRI integrates virtual and real technologies on display at CES 2024
Major international manufacturers such as NVIDIA, Meta, and Microsoft are actively building a new generation virtual ecosystem. With the support of the Industrial Technology Department of the Ministry of Economic Affairs, ITRI (Taiwan’s largest high-tech applied research institutions) has continued to develop an interactive experience that integrates virtual and real, and launched its first interactive experience at the US Consumer Electronics Show (CES 2024).
ITRI announced the introduction of AI-incorporating display and entertainment technologies along with robotics innovations at CES 2024. ITRI presented 10 groundbreaking innovations spanning AI robotics, smart sports, digital health, and AI display and entertainment.
ITRI partnered with Lianjia Optoelectronics, a major automotive LED module manufacturer, to launch a “high-fidelity 3D interactive system ” to seize 3D entertainment business opportunities.
Director of Market Research at the Consumer Technology Association (CTA), Jessica Boothe, praised ITRI’s exhibits for embodying the CES 2024 trends of AI, sustainability, and inclusivity. Expressing her enthusiasm, Boothe highlighted one of the showcased innovations, the Hyper-realistic 3D Interactive System, which was poised to launch a collaboration with Excellence Optoelectronics Inc. (EOI), a prominent automobile LED module manufacturer.
“I must say, very exciting showcase this year. We find everything to be on-trend. The CES 2024 trends were predicted to be AI, sustainability, and inclusivity. And we have all of that right here in your booth,” remarked Boothe. “We’re really excited that ITRI has been here since 2017. As we’re celebrating CTA’s 100-year anniversary, it’s nice to say that we have exhibitors like ITRI coming back every year to CES, and we continue to see ITRI continue to innovate,” she added.
“CES is the most influential tech event in the world, and this is the eighth time ITRI has participated,” said ITRI President Edwin Liu. “To be at CES, we have two main purposes: to showcase ITRI on the global stage and to provide our team with valuable exposure to the latest advancements worldwide. Through CES, ITRI is opening up even more collaboration opportunities, engaging with potential investors, and exploring tech licensing and ventures,” he added.
“ITRI has worked on smart interactive display technology for years, and our collaboration with EOI on the Hyper-Realistic 3D Interactive Display is one of the best successes. This also allows us to strategically deploy diversified product lines in Taiwan, the United States, and Europe,” said President Liu. ITRI also promoted the Institute’s strategic partnerships with Light Matrix and its investor ADATA Technology on iGolfPutter, an intelligent interactive golf simulator. Utilizing Light Matrix’s smart sports training and teaching system called SyncShot360 in iGolfPutter, targeting the global sports technology market. Notably, iGolfPutter has been named by Forbes Magazine as one of the technologies to look for at CES 2024.
EOI Chairman, Dr. Kuohsin Huang, elaborated on their collaboration project with ITRI, stating, “Unlike traditional methods relying on multiple cameras, the Hyper-realistic 3D Interactive System (ChartBox) can generate a personal, interactive 3D digital avatar from a 2D photograph. This 2D-to-3D process integrates various technologies, including real-time image matting, backside model generation, expression changes, natural speech, AI response, and facial recognition.” He added, “Furthermore, its next-generation display technology positions EOI to enter the new market of audio-video entertainment and artistic performances.”
Simon Chen, Chairman of ADATA, emphasized, “Beyond our commitment to providing top-notch memory solutions, ADATA is venturing into cutting-edge sports technology through cross-industry collaboration. Our goal is to offer an optimal training environment for athletes and an innovative experience for spectator sports. Leveraging ADATA’s well-established global distribution channels, we can actively promote Taiwan’s sports industry on the international stage.”
Commenting on iGolfPutter and SyncShot360, Light Matrix CEO Joe Chen said, “The combination of fast 3D modeling, volumetric capture, and virtual-real fusion in the metaverse creates never-before-seen services that the sports and art industry would love. Our volumetric view technology, born out of collaboration with ITRI, allows for a more precise, 360-degree intelligent analysis of golf and other sports. It holds the promise of applications in sporting events and stage performances, setting an excellent foundation for future expansion in the global market.”
From left to right in the above photo are Lin Zhaoxian, vice president of ITRI and director of the International Institute of Obstetrics and gynecology, Liu Wenxiong, president of ITRI, Huang Guoxin, chairman of Lianjia Optoelectronics, and Huang Fangyu, general manager of Lianjia Optoelectronics.
About ITRI:
Industrial Technology Research Institute (ITRI) is one of the world’s leading technology R&D institutions aiming to innovate a better future for society. Founded in 1973, ITRI has played a vital role in transforming Taiwan’s industries from labor-intensive into innovation-driven. To address market needs and global trends, it has launched its 2035 Technology Strategy and Roadmap that focuses on innovation development in Smart Living, Quality Health, Sustainable Environment, and Resilient Society.
Over the years, ITRI has been dedicated to incubating startups and spinoffs, including well-known names such as UMC and TSMC. In addition to its headquarters in Taiwan, ITRI has branch offices in the U.S., Europe, and Japan in an effort to extend its R&D scope and promote international cooperation across the globe. For more information, please visit https://www.itri.org/eng.
References:
ABI Research: Telco transformation measured via patents and 3GPP contributions; 5G accelerating in China
“SK Wonderland at CES 2024;” SK Group Chairman: AI-led revolution poses challenges to companies
On Tuesday at CES 2024, SK Group [1.] displayed world-leading Artificial Intelligence (AI) and carbon reduction technologies under an amusement park concept called “SK Wonderland.” It provided CES attendees a view of a world that uses the latest AI and clean technologies from SK companies and their business partners to a create a smarter, greener world. Highlights of the booth included:
- Magic Carpet Ride in a flying vehicle embedded with an AI processor that helps it navigate dense, urban areas – reducing pollution, congestion and commuting frustrations
- AI Fortune Teller powered by next-generation memory technologies that can help computers analyze and learn from massive amounts of data to predict the future
- Dancing Car that’s fully electric, able to recharge in 20 minutes or less and built to travel hundreds of miles between charges
- Clean Energy Train that’s capable of being powered by hydrogen, whose only emission is water
- Rainbow Tube that shows how plastics are finding a new life through a technology that turns waste into fuel
Note 1. SK Group is South Korea’s second-largest conglomerate, with Samsung at number one.
SK’s CES 2024 displays include participation from seven SK companies — SK Inc., SK Innovation, SK Hynix, SK Telecom, SK E&S, SK Ecoplant and SKC. While the displays are futuristic, they’re based on technologies that SK companies and their global partners have already developed and are bringing to market.
SK Group Chairman Chey Tae-won said that companies are facing challenges in navigating the transformative era led by artificial intelligence (AI) due to its unpredictable impact and speed. He said AI technology and devices with AI are the talk of the town at this year’s annual trade show and companies are showcasing their AI innovations achieved through early investment.
“We are on the starting line of the new era, and no one can predict the impact and speed of the AI revolution across the industries,” Chey told Korean reporters after touring corporate booths on the opening day of CES 2024 at the Las Vegas Convention Center in Las Vegas. Reflecting on the rapid evolution of AI technologies, he highlighted the breakthrough made by ChatGPT, a language model launched about a year ago, which has significantly influenced how AI is perceived and utilized globally. “Until ChatGPT, no one has thought of how AI would change the world. ChatGPT made a breakthrough, and everybody is trying to ride on the wave.”
SK Group Chairman Chey Tae-won speaks during a brief meeting with Korean media on the sidelines of CES 2024 at the Las Vegas Convention Center in Las Vegas on Jan. 9, 2024
…………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………
SK Hynix Inc., SK Group’s chipmaking unit, is one of the prominent companies at CES 2024, boasting its high-performance AI chips like high bandwidth memory (HBM). The latest addition is the HBM3E chips, recognized as the world’s best-performing memory product. Mass production of HBM3E is scheduled to begin in the first half of 2024.
SK Telecom Co. is also working on AI, having Sapeon, an AI chip startup under its wing. Chey stressed the importance of integrating AI services and solutions across SK Group’s diverse business sectors, ranging from energy to telecommunications and semiconductors. “It’s crucial for each company to collaborate and present a unified package or solution rather than developing them separately,” Chey said. “But I don’t think it is necessary to set up a new unit for that. I think we should come up with an integrated channel for customers.”
SK Telecom and Deutsche Telekom are jointly developing Large Language Models for generative AI to be used by telecom network providers.
…………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………………
References:
https://en.yna.co.kr/view/AEN20240110001900320#
https://eng.sk.com/news/ces-2024-sk-to-showcase-world-class-carbon-reduction-and-ai-technologies
SK Telecom inspects cell towers for safety using drones and AI
SK Telecom and Deutsche Telekom to Jointly Develop Telco-specific Large Language Models (LLMs)
SK Telecom and Thales Trial Post-quantum Cryptography to Enhance Users’ Protection on 5G SA Network
Google announces Gemini: it’s most powerful AI model, powered by TPU chips
Google claims it has developed a new Generative Artificial Intelligence (GenAI) system and Large Language Model (LLM) more powerful than any currently on the market, including technology developed by ChatGPT creator OpenAI. Gemini can summarize text, create images and answer questions. Gemini was trained on Google’s Tensor Processing Units v4 and v5e.
Google’s Bard is a generative AI based on the PaLM large language mode. Starting today, Gemini will be used to give Bard “more advanced reasoning, planning, understanding and more,” according to a Google blog post.
While global users of Google Bard and the Pixel 8 Pro will be able to run Gemini now, an enterprise product, Gemini Pro, is coming on Dec. 13th. Developers can sign up now for an early preview in Android AICore.
Gemini comes in three model sizes: Ultra, Pro and Nano. Ultra is the most capable, Nano is the smallest and most efficient, and Pro sits in the middle for general tasks. The Nano version is what Google is using on the Pixel, while Bard gets Pro. Google says it plans to run “extensive trust and safety checks” before releasing Gemini Ultra to select groups.
Gemini can code in Python, Java, C++, Go and other popular programming languages. Google used Gemini to upgrade Google’s AI-powered code generation system, AlphaCode. Next, Google plans to bring Gemini to Ads, Chrome and Duet AI. In the future, Gemini will be used in Google Search as well.
……………………………………………………………………………………………………………………………………………………
Market Impact:
Gemini’s release and use will present a litmus test for Google’s technology following a push to move faster in developing and releasing AI products. It coincides with a period of turmoil at OpenAI that has sent tremors through the tight knit AI community, suggesting the industry’s leaders is far from settled.
The announcement of the new GenAI software is the latest attempt by Google to display its AI portfolio after the launch of ChatGPT about a year ago shook up the tech industry. Google wanted outside customers to perform testing on the most advanced version of Gemini before releasing it more widely, said Demis Hassabis, chief executive officer of Google DeepMind.
“We’ve been pushing forward with a lot of focus and intensity,” Hassabis said, adding that Gemini likely represented the company’s most ambitious combined science and engineering project to date.
Google said Wednesday it would offer a range of AI programs to customers under the Gemini umbrella. It touted the software’s ability to process various media, from audio to video, an important development as users turn to chatbots for a wider range of needs.
The most powerful Gemini Ultra version outperformed OpenAI’s technology, GPT-4, on a range of industry benchmarks, according to Google. That version is expected to become widely available for software developers early next year following testing with a select group of customers.
………………………………………………………………………………………………………………………………………………………………………………………………
Role of TPUs:
While most GenAI software and LLM’s are processed using NVIDIA’s neural network processors, Google’s tensor processing units (TPUs) will power Gemini. TPUs are custom-designed AI accelerators, which are optimized for training and inference of large AI models. Cloud TPUs are optimized for training large and complex deep learning models that feature many matrix calculations, for instance building large language models (LLMs). Cloud TPUs also have SparseCores, which are dataflow processors that accelerate models relying on embeddings found in recommendation models. Other use cases include healthcare, like protein folding modeling and drug discovery.
Google’s custom AI chips, known as tensor processing units, are embedded in compute servers at the company’s data center. Photo Credit: GOOGLE
…………………………………………………………………………………………………………………………………
Competitors:
Gemini and the products built with it, such as chatbots, will compete with OpenAI’s GPT-4, Microsoft’s Copilot (which is based on OpenAI’s GPT-4), Anthropic’s Claude AI, Meta’s Llama 2 and more. Google claims Gemini Ultra outperforms GPT-4 in several benchmarks, including the massive multitask language understanding general knowledge test and in Python code generation.
…………………………………………………………………………………………………………………………………
References:
Everything to know about Gemini, Google’s new AI model (blog.google)
Google Reveals Gemini, Its Much-Anticipated Large Language Model (techrepublic.com)
MTN Consulting: Generative AI hype grips telecom industry; telco CAPEX decreases while vendor revenue plummets
Ever since Generative (Gen) AI burst into the mainstream through public-facing platforms (e.g. ChatGPT) late last year, its promising capabilities have caught the attention of many. Not surprisingly, telecom industry execs are among the curious observers wanting to try Gen AI even as it continues to evolve at a rapid pace.
MTN Consulting says the telecom industry’s bond with AI is not new though. Many telcos have deployed conventional AI tools and applications in the past several years, but Gen AI presents opportunities for telcos to deliver significant incremental value over existing AI. A few large telcos have kickstarted their quest for Gen AI by focusing on “localization.” Through localization of processes using Gen AI, telcos vow to eliminate language barriers and improve customer engagement in their respective operating markets, especially where English as a spoken language is not dominant.
Telcos can harness the power of Gen AI across a wide range of different functions, but the two vital telco domains likely to witness transformative potential of Gen AI are networks and customer service. Both these domains are crucial: network demands are rising at an unprecedented pace with increased complexity, and delivering differentiated customer experiences remains an unrealized ambition for telcos.
Several Gen AI use cases are emerging within these two telco domains to address these challenges. In the network domain, these include topology optimization, network capacity planning, and predictive maintenance, for example. In the customer support domain, they include localized virtual assistants, personalized support, and contact center documentation.
Most of the use cases leveraging Gen AI applications involve dealing with sensitive data, be it network-related or customer-related. This will have major implications from the regulatory point of view, and regulatory concerns will constrain telcos’ Gen AI adoption and deployment strategies. The big challenge is the mosaic of complex and strict regulations prevalent in different markets that telcos will have to understand and adhere to when implementing Gen AI use cases in such markets. This is an area where third-party vendors will try to cash in by offering Gen AI solutions that are compliant with regulations in the respective markets.
Vendors will also play a key role for small- and medium-sized telcos in Gen AI implementation, by eliminating constraints due to the lack of technical expertise and HW/SW resources, skilled manpower, along with opex costs burden. Key vendors to watch out for in the Gen AI space are webscale providers who possess the ideal combination of providing cloud computing resources required to train large language models (LLM) coupled with their Gen AI expertise offered through pre-trained models.
Other key points from MTN Consulting on Gen AI in the telecom industry:
- Network operations and customer support will be key transformative areas.
- Telco workforce will become leaner but smarter in the Gen AI era.
- Strict regulations will be a major barrier for telcos.
- Vendors key to Gen AI integration; webscale providers set for more telco gains.
- Lock-in risks and rising software costs are key considerations in choosing vendors.
………………………………………………………………………………………………………………………………
Separately, MTN Consulting’s latest forecast called for $320B of telco capex in 2023, down only slightly from the $328B recorded in 2022. Early 3Q23 revenue reports from vendors selling into the telco market call this forecast into question. The dip in the Americas is worse than expected, and Asia’s expected 2023 growth has not materialized.
Key vendors are reporting significant YoY drops in revenue, pointing to inventory corrections, macroeconomic uncertainty (interest rates, in particular), and weaker telco spending. Network infrastructure sales to telcos (Telco NI) for key vendors Ericsson and Nokia dropped 11% and 16% YoY in 3Q23, respectively, measured in US dollars. By the same metric, NEC, Fujitsu and Samsung saw +1%, -52%, and -41% YoY growth; Adtran, Casa, and Juniper declined 29%, 7%, and 20%; fiber-centric vendors Clearfield, Corning, CommScope, and Prysmian all saw double digit declines.
MTN Consulting will update its operator forecast formally next month. In advance, this comment flags a weaker spending outlook than expected. Telco capex for 2023 is likely to come in around $300-$310B.
MTN Consulting’s Network Operator Forecast Through 2027: “Telecom is essentially a zero-growth industry”
MTN Consulting: Top Telco Network Infrastructure (equipment) vendors + revenue growth changes favor cloud service providers
Proposed solutions to high energy consumption of Generative AI LLMs: optimized hardware, new algorithms, green data centers
Cloud Service Providers struggle with Generative AI; Users face vendor lock-in; “The hype is here, the revenue is not”
Global Telco AI Alliance to progress generative AI for telcos
Amdocs and NVIDIA to Accelerate Adoption of Generative AI for $1.7 Trillion Telecom Industry
Bain & Co, McKinsey & Co, AWS suggest how telcos can use and adapt Generative AI
Generative AI Unicorns Rule the Startup Roost; OpenAI in the Spotlight
Generative AI in telecom; ChatGPT as a manager? ChatGPT vs Google Search
Generative AI could put telecom jobs in jeopardy; compelling AI in telecom use cases
MTN Consulting: Satellite network operators to focus on Direct-to-device (D2D), Internet of Things (IoT), and cloud-based services
MTN Consulting on Telco Network Infrastructure: Cisco, Samsung, and ZTE benefit (but only slightly)
MTN Consulting: : 4Q2021 review of Telco & Webscale Network Operators Capex
Granite Telecommunications expands its service offerings with Juniper Networks
Juniper Networks today announced that its customer and partner, Granite Telecommunications, a $1.8 billion provider of communications and technology solutions, has expanded its service offerings to include Juniper Networks’ full-stack of campus and branch services, including Wired Access, Wireless Access and SD-WAN, all driven by Mist AI™. This move will enhance Granite’s ability to support its customers’ unique verticals, such as healthcare, retail, education, manufacturing, hospitality and financial.
Granite has been working closely with Juniper for several years, and with this expanded AI-driven enterprise portfolio they now offer Juniper’s full suite of campus and branch networking solutions. By leveraging Mist AI and a single cloud across the wired, wireless and SD-WAN domains, Granite saves time and money with client-to-cloud automation and assurance, while accelerating deployments with Zero Touch Provisioning and automated configurations. In addition, Granite delivers more value to its customers with a broadened service portfolio that offers new highly differentiated services.
“Granite stands as Juniper’s largest AI-Driven SD-WAN partner in Managed Services within the Americas, underscoring the strength of our relationship and confidence in Juniper’s cutting-edge networking technology,” said Rob Hale, President and CEO at Granite. “As we expand our partnership, we are poised to elevate the customer experience to new heights by offering a full suite of Juniper solutions, imbued with the defining qualities of reliability, performance and security that characterize Juniper.”
Granite has been expanding its nationwide support to address the changing and growing needs of its customers. The company is committed to delivering specialized services for the unique requirements of its customers’ verticals. The addition of Juniper’s software-defined branch and wireless services is expected to be a significant benefit to many of its customer sectors. These services are designed to improve the performance and security of networks in various industries and make it easier for businesses to manage their network infrastructure.
“We are very excited to take our relationship with Granite Telecommunications to the next level,” said Sujai Hajela, Executive Vice President, AI-Driven Enterprise at Juniper Networks. “They have proven to be an exceptional partner and leader in the communications industry, who is especially adept at leveraging AI and the cloud to deliver high value managed services to their customers. With the full AI-driven enterprise portfolio, Granite can truly differentiate from their competition with exceptional client-to-cloud user experiences.”
With this expansion, Granite continues to demonstrate its commitment to providing customers with the best possible network experience. The addition of Juniper’s full-stack solutions will enable Granite to enhance its capabilities and better serve its customers, while also providing the company with a competitive edge in the market.
About Juniper Networks:
Juniper Networks is dedicated to dramatically simplifying network operations and driving superior experiences for end users. Our solutions deliver industry-leading insight, automation, security and AI to drive real business results. We believe that powering connections will bring us closer together while empowering us all to solve the world’s greatest challenges of well-being, sustainability and equality. Additional information can be found at Juniper Networks (www.juniper.net) or connect with Juniper on Twitter, LinkedIn and Facebook.
References:
Barriers for telcos deploying AI in order to improve network operations
Communications service providers (CSPs) face a host of barriers, such as accessing high-quality data, that impede thesir ability to effectively deploy AI which could improve network and service operations, according to new research commissioned by Nokia and conducted by Analysys Mason.
“CSPs are unable to access high-quality data sets (which will enable them to make more accurate decisions) because they are using legacy systems with proprietary interfaces. This will restrict how quickly they can integrate AI into their networks,” according to the research, which is based on responses from 84 CSPs surveyed globally.
Almost 50 percent of Tier-1 CSPs ranked data collection as the most challenging stage of the telco AI use case development cycle.
Further, the research found that only six percent of CSPs surveyed believe they are at the most-advanced level of automation, or zero-touch automation, which relies on AI and machine learning (ML) algorithms to manage and improve network operations. The high-quality data issue is also impacting CSPs’ ability to retain AI talent.
Still, 87 percent of CSPs have started to implement AI into their network operations, either as proof of concepts or into production; with 57 percent saying they have deployed telco AI use cases to the point of production.
CSP respondents said they believe AI will help improve network service quality, top-line growth, customer experience, and energy optimisation to meet their sustainability goals.
The research said CSPs should evaluate their telco AI implementation strategies and develop a clear roadmap for AI implementation to overcome their data challenge and other impediments, such as an inability to scale AI use case deployments. The report can be found here.
Adaora Okeleke, Principal Analyst, at Analysys Mason said: “CSPs must transition to more-autonomous operations if they are to manage networks more efficiently and deliver on their main business priorities. But as this research demonstrates, accessing high-quality data remains a critical obstacle to deploying telco AI within their networks. They need to really examine their AI implementation strategies to work around this data quality issue.”
Andrew Burrell, Head of Business Applications Marketing, Cloud and Network Services at Nokia, said: “AI has a crucial role in driving step changes in network performance, including cutting carbon footprints. CSPs are aware of the challenges of more deeply embedding AI into their operations and, as this research points out, the steps they can take to positively alter that situation, including building the right ecosystem of vendor partners with the right skillsets that can better cater to their network needs.”
Resources and additional information:
Webpage: https://www.nokia.com/networks/ai-ops/
References:
TPG, Ericsson launch AI-powered analytics, troubleshooting service for 4G/5G Mobile, FWA, and IoT subscribers
Australia telco TPG Telecom and Ericsson today announced a new multi-year agreement to deliver an Australian-first cloud-native and AI-powered analytics tool to pinpoint and improve mobile network performance for customers. Based on Ericsson Expert Analytics and EXFO Adaptive Service Assurance, the solution gives TPG Telecom’s Technology, Network and Care teams an in-depth, end-to-end understanding of subscriber’s experience at an individual level. Through the new agreement, TPG Telecom will gain insights from its 4G and 5G Mobile, Fixed Wireless Access and IoT subscribers using smart data collection with embedded intelligence to predict, prioritise, and resolve performance issues as they arise in real-time.
These insights will enable TPG Telecom to react quicker to network issues, improve performance and reduce the need for infrastructure-based diagnoses, allowing the telco to enhance its service experience for customers.
The solution integrates Ericsson Expert Analytics, EXFO adaptive service assurance and Ericsson software probes, provided as part of Ericsson’s dual-mode 5G Core, to deliver end-to-end network visibility and reduced total costs.
TPG Telecom is the first in Australia and one of the first communication service providers (CSP) globally to deploy Ericsson Expert Analytics in a commercial network using cloud-native technologies. As a cloud-native software, its embedded scalability, agility and resilience means it is designed to flexibly handle TPG Telecom’s requirements as its network and use-cases evolve, adapting to any unexpected challenges.
TPG Telecom General Manager Cloud/Infrastructure NW Services, Chris Tsigros, said: “TPG Telecom is committed to investing in cutting edge technology designed to provide superior network experience to every single one of our customers. The analytics and troubleshooting solution we’re implementing with Ericsson will help ensure we deliver a great experience for our customers. This new technology will change the way in which the TPG Telecom customer care team interacts with our customers, leading to greater effectiveness and increased customer satisfaction. It’s just another way we’re putting our customers first.”
Emilio Romeo, Head of Ericsson, Australia and New Zealand, says: “Embarking on this multi-year deployment of advanced analytics and troubleshooting capabilities with TPG Telecom further demonstrates our commitment to bringing the best mobile telecommunications experience to all Australians. It is the latest in a long history of working side by side with TPG Telecom to bring groundbreaking technology to Australia and a new level of service experience to the Australian people. With the Ericsson Expert Analytics solution implementation, and the real-time access to the data from the dual-mode 5G Core thanks to its built-in software probes, TPG Telecom can gain greater network visibility at a lower cost, passing on the benefits to its customers as they enjoy its services across the country.”
The initial deployment phase focused on acquiring profound insights and troubleshooting capabilities through the software probes built into Ericsson’s cloud-native dual-mode 5G Core. The state-of-the-art solution delivered to TPG adopts an innovative approach that combines probing and event-based monitoring, ensuring rapid and effective issue resolution.
One of the standout features of this deployed solution is its capacity to provide comprehensive troubleshooting across the entire network, all within a unified application. TPG benefits from a range of advanced functionalities, including On-Demand Troubleshooting and robust filtering capabilities, significantly expediting the identification and resolution of network challenges.
With this implementation, TPG Telecom gains the ability to trace and monitor subscriber sessions handled by the core network, which forms the foundation of TPG Telecom’s mobile network. Currently, the solution successfully monitors approximately 5 million subscribers, and its coverage continues to expand
The full solution will continue to be rolled out in phases of further enhancements, and will give TPG Telecom the ability to automatically detect issues from captured network and subscriber insights. TPG Telecom will also benefit from AI-powered recommendations for correction of any network or customer issues found.
Ericsson Expert Analytics is an open system designed for ease of integration in multi-vendor hybrid environments. The software solution is powered by anomaly detection techniques based on machine learning and artificial intelligence, transforming data at scale into actionable insights for better business outcomes. It is designed and used to analyze the real-time network data of more than 250 million subscribers of mobile telecommunications operators all over the world.
The solution follows the 2021 completion of the virtualisation of TPG Telecom’s core network and a new partnership to deploy Ericsson’s dual-mode 5G Core for standalone 5G networks.
About TPG TELECOM:
TPG Telecom Limited, formerly named Vodafone Hutchison Australia Limited, was listed on the Australian Securities Exchange on 30 June 2020. On 13 July 2020, this newly listed company merged with TPG Corporation Limited, formerly named TPG Telecom, to bring together the resources of two of Australia’s largest telecommunications companies, creating the leading challenger full-service telecommunications provider. TPG Telecom is home to some of Australia’s most-loved brands including Vodafone, TPG, iiNet, AAPT, Internode, Lebara and felix. https://www.tpgtelecom.com.au/
Resources:
Securing 5G experience with software probes
Data and Analytics for better business outcomes
Cloud native is transforming the telecom industry
TPG Telecom and Ericsson announce 5G Core partnership for standalone 5G networks
TPG Telecom’s ground-breaking cloud transformation
References:
https://www.ericsson.com/en/press-releases/7/2023/tpg-telecom-and-ericsson-launch-australian-first-analytics-and-troubleshooting-solution-to-boost-network-performance-for-customers
Cloud Service Providers struggle with Generative AI; Users face vendor lock-in; “The hype is here, the revenue is not”
Global Telco AI Alliance to progress generative AI for telcos
Park Place Technologies on network monitoring, predictive fault diagnosis and repair; Entuity acquisition adds analytics
Bain & Co, McKinsey & Co, AWS suggest how telcos can use and adapt Generative AI
Forbes: Cloud is a huge challenge for enterprise networks; AI adds complexity
Cloud Service Providers struggle with Generative AI; Users face vendor lock-in; “The hype is here, the revenue is not”
Everyone agrees that Generative AI has great promise and potential. Martin Casado of Andreessen Horowitz recently wrote in the Wall Street Journal that the technology has “finally become transformative:”
“Generative AI can bring real economic benefits to large industries with established and expensive workloads. Large language models could save costs by performing tasks such as summarizing discovery documents without replacing attorneys, to take one example. And there are plenty of similar jobs spread across fields like medicine, computer programming, design and entertainment….. This all means opportunity for the new class of generative AI startups to evolve along with users, while incumbents focus on applying the technology to their existing cash-cow business lines.”
A new investment wave caused by generative AI is starting to loom among cloud service providers, raising questions about whether Big Tech’s spending cutbacks and layoffs will prove to be short lived. Pressed to say when they would see a revenue lift from AI, the big U.S. cloud companies (Microsoft, Alphabet/Google, Meta/FB and Amazon) all referred to existing services that rely heavily on investments made in the past. These range from the AWS’s machine learning services for cloud customers to AI-enhanced tools that Google and Meta offer to their advertising customers.
Microsoft offered only a cautious prediction of when AI would result in higher revenue. Amy Hood, chief financial officer, told investors during an earnings call last week that the revenue impact would be “gradual,” as the features are launched and start to catch on with customers. The caution failed to match high expectations ahead of the company’s earnings, wiping 7% off its stock price (MSFT ticker symbol) over the following week.
When it comes to the newer generative AI wave, predictions were few and far between. Amazon CEO Andy Jassy said on Thursday that the technology was in its “very early stages” and that the industry was only “a few steps into a marathon”. Many customers of Amazon’s cloud arm, AWS, see the technology as transformative, Jassy noted that “most companies are still figuring out how they want to approach it, they are figuring out how to train models.” He insisted that every part of Amazon’s business was working on generative AI initiatives and the technology was “going to be at the heart of what we do.”
There are a number of large language models that power generative AI, and many of the AI companies that make them have forged partnerships with big cloud service providers. As business technology leaders make their picks among them, they are weighing the risks and benefits of using one cloud provider’s AI ecosystem. They say it is an important decision that could have long-term consequences, including how much they spend and whether they are willing to sink deeper into one cloud provider’s set of software, tools, and services.
To date, AI large language model makers like OpenAI, Anthropic, and Cohere have led the charge in developing proprietary large language models that companies are using to boost efficiency in areas like accounting and writing code, or adding to their own products with tools like custom chatbots. Partnerships between model makers and major cloud companies include OpenAI and Microsoft Azure, Anthropic and Cohere with Google Cloud, and the machine-learning startup Hugging Face with Amazon Web Services. Databricks, a data storage and management company, agreed to buy the generative AI startup MosaicML in June.
If a company chooses a single AI ecosystem, it could risk “vendor lock-in” within that provider’s platform and set of services, said Ram Chakravarti, chief technology officer of Houston-based BMC Software. This paradigm is a recurring one, where a business’s IT system, software and data all sit within one digital platform, and it could become more pronounced as companies look for help in using generative AI. Companies say the problem with vendor lock-in, especially among cloud providers, is that they have difficulty moving their data to other platforms, lose negotiating power with other vendors, and must rely on one provider to keep its services online and secure.
Cloud providers, partly in response to complaints of lock-in, now offer tools to help customers move data between their own and competitors’ platforms. Businesses have increasingly signed up with more than one cloud provider to reduce their reliance on any single vendor. That is the strategy companies could end up taking with generative AI, where by using a “multiple generative AI approach,” they can avoid getting too entrenched in a particular platform. To be sure, many chief information officers have said they willingly accept such risks for the convenience, and potentially lower cost, of working with a single technology vendor or cloud provider.
A significant challenge in incorporating generative AI is that the technology is changing so quickly, analysts have said, forcing CIOs to not only keep up with the pace of innovation, but also sift through potential data privacy and cybersecurity risks.
A company using its cloud provider’s premade tools and services, plus guardrails for protecting company data and reducing inaccurate outputs, can more quickly implement generative AI off-the-shelf, said Adnan Masood, chief AI architect at digital technology and IT services firm UST. “It has privacy, it has security, it has all the compliance elements in there. At that point, people don’t really have to worry so much about the logistics of things, but rather are focused on utilizing the model.”
For other companies, it is a conservative approach to use generative AI with a large cloud platform they already trust to hold sensitive company data, said Jon Turow, a partner at Madrona Venture Group. “It’s a very natural start to a conversation to say, ‘Hey, would you also like to apply AI inside my four walls?’”
End Quotes:
“Right now, the evidence is a little bit scarce about what the effect on revenue will be across the tech industry,” said James Tierney of Alliance Bernstein.
Brent Thill, an analyst at Jefferies, summed up the mood among investors: “The hype is here, the revenue is not. Behind the scenes, the whole industry is scrambling to figure out the business model [for generative AI]: how are we going to price it? How are we going to sell it?”
………………………………………………………………………………………………………………
References:
https://www.ft.com/content/56706c31-e760-44e1-a507-2c8175a170e8
https://www.wsj.com/articles/companies-weigh-growing-power-of-cloud-providers-amid-ai-boom-478c454a
https://www.techtarget.com/searchenterpriseai/definition/generative-AI?Offer=abt_pubpro_AI-Insider
Global Telco AI Alliance to progress generative AI for telcos
Curmudgeon/Sperandeo: Impact of Generative AI on Jobs and Workers
Bain & Co, McKinsey & Co, AWS suggest how telcos can use and adapt Generative AI
Generative AI Unicorns Rule the Startup Roost; OpenAI in the Spotlight
Generative AI in telecom; ChatGPT as a manager? ChatGPT vs Google Search
Generative AI could put telecom jobs in jeopardy; compelling AI in telecom use cases
Qualcomm CEO: AI will become pervasive, at the edge, and run on Snapdragon SoC devices