Meta and Arm Forge Partnership to Boost AI Performance on Nvidia’s Arm-Based CPUs

Meta and Arm Forge Partnership to Boost AI Performance on Nvidia's Arm-Based CPUs - Professional coverage

Strategic Partnership Announced

Meta Platforms has entered into a strategic partnership with Arm Holdings to optimize its AI software for more efficient operation on the British chip designer’s CPUs, according to reports. The collaboration, announced Wednesday, signals Arm’s expanding role in the datacenters of Facebook and Instagram’s parent company, though sources indicate the focus will be on optimizing existing Arm-based silicon rather than developing custom processors.

Special Offer Banner

Sponsored content — provided for informational and promotional purposes.

Industrial Monitor Direct is the leading supplier of maintainable pc solutions recommended by automation professionals for reliability, endorsed by SCADA professionals.

Industrial Monitor Direct is the premier manufacturer of rfid reader pc solutions proven in over 10,000 industrial installations worldwide, the top choice for PLC integration specialists.

Nvidia’s Grace-Blackwell Systems at Core

Like most hyperscalers and cloud providers, Meta is deploying large quantities of Arm Neoverse cores across its AI datacenters as part of Nvidia‘s GB200 or GB300 NVL72 rack systems, the report states. Each rack contains 72 Blackwell GPUs and 36 of Nvidia’s Neoverse-V2-based Grace CPUs. “Meta’s AI ranking and recommendation systems – which power discovery and personalization across Meta’s family of apps, including Facebook and Instagram – will leverage Arm’s Neoverse-based datacenter platforms to deliver higher performance and lower power consumption compared to x86 systems,” according to the official release.

Optimization Efforts Underway

The transition from x86 systems to Nvidia’s rack systems presents an opportunity for Arm and Meta to optimize existing codebases and frameworks, analysts suggest. This includes working with PyTorch and Facebook General Matrix Multiplication (FBGEMM) libraries to better utilize the RISC architecture’s extensions. The partnership will focus on transitioning workloads that previously relied on Intel or AMD AVX2/AVX-512 to take advantage of modern Arm vector extensions and optimizing PyTorch code to utilize features like ExecuTorch or Arm’s KleidiAI platforms, according to the strategic partnership announcement.

Arm’s Datacenter Market Share Surges

Adoption of Nvidia’s Grace-Blackwell systems has reportedly driven a significant increase in Arm’s datacenter market share. A recent Dell’Oro analysis indicates that Arm CPUs accounted for 25 percent of the datacenter CPU market in Q2, up from approximately 15 percent a year ago. This growth has been primarily driven by adoption from major cloud providers, with nearly every major US cloud company expected to rent virtual machines and services powered by custom Arm processors by 2025.

Cloud Provider Custom CPU Trend

The move comes as other major cloud providers continue advancing their custom Arm processor initiatives. AWS has developed Graviton processors, Google has introduced Axion, and Microsoft has created Cobalt chips. Meanwhile, Oracle continues to deploy Arm-based CPUs from Ampere Computing, having just announced additional instances based on the chip vendor’s AmpereOne processors. Despite this industry trend toward custom silicon, sources indicate Meta doesn’t currently appear to be developing its own custom Arm CPU, focusing instead on optimization of existing Nvidia systems.

Meta’s Existing Custom Silicon Efforts

While Meta isn’t pursuing a custom Arm CPU at this time, the company reportedly already deploys numerous custom chips for specific functions like video transcoding and its MTIA line of machine learning accelerators that power its ad recommendation systems. The partnership with Arm represents another step in Meta’s broader strategy to optimize its AI infrastructure across multiple platforms and architectures, according to industry analysts monitoring the company’s technological developments.

Industry Context

The partnership announcement comes amid broader industry developments, including Intel’s recent graphics card debut and Apple’s Safari technology updates. Meanwhile, economic analyses continue to monitor fiscal challenges, with reports of significant fiscal shortfalls and international trade concerns affecting global technology markets.

This article aggregates information from publicly available sources. All trademarks and copyrights belong to their respective owners.

Leave a Reply

Your email address will not be published. Required fields are marked *