Advancing AI: AMD Ryzen AI Pro 300 Series Brings CoPilot+ GenAI Experiences for Enterprise

0
Oct 16, 2024
  • AMD’s Ryzen AI Pro 300 series can offer up to 55 TOPS AI performance, the highest so far.
  • The new processors get up to 12 cores, 24 threads and peak clock speed of up to 5.1GHz.
  • AMD is expecting more than 100 design wins with the AI Pro 300 series through 2025.

At the Advancing AI event in San Francisco, AMD announced its new EPYC CPUs, Instinct GPUs and third-generation enterprise processors under the Ryzen AI Pro 300 series, bringing the Microsoft Copilot+ AI PCs to the enterprise. These new processors combine leadership AI performance, optimized enterprise apps and data models, and enterprise-level security from chip to cloud along with improved efficiency over the previous generation, the Ryzen Pro 8040 series.

AMD Ryzen AI Pro 300 Series: Specifications

Source: AMD

The new Ryzen AI Pro 300 processors are built on TSMC’s 4nm process node. The lineup includes the Ryzen AI 9 HX Pro 375, HX Pro 375 and 7 Pro 360. These processors feature the next-generation XDNA 2 NPU for GenAI workloads, Zen 5 CPU architecture sporting up to 12 cores and 24 threads, and the next-generation RDNA 3.5 GPU with up to 16 compute units.

The top-of-the-line Ryzen AI 9 HX Pro 375 has 12 CPU cores with 24 threads, up from 8 cores and 16 threads on the predecessor, the Ryzen Pro 8040. The RDNA 3.5 GPU (Radeon 890M) has 16 compute cores, up from 12 compute units in the Ryzen Pro 8040, with 33% more computing units offering greater performance per watt. But the biggest upgrade features the XDNA 2 NPU with 55 TOPS AI performance, compared to 16 TOPS in the Ryzen Pro 8040. With a maximum CPU boost frequency of 5.1GHz, it also comes with a 36MB cache.

The Ryzen AI 9 HX Pro 370 shares the same CPU and GPU configuration as the 375. The changes come in the form of NPU’s 50 TOPS AI performance. The Ryzen AI 7 Pro 360, on the other hand, comes with an 8-core CPU with 16 threads and a maximum boost frequency of 5GHz. The processor has a 24MB cache, 50 TOPS AI performance and Radeon 880M GPU. All three processors also support TDP between 15W and 54W, making them suitable for different form factors, from laptops to workstations.

Source: AMD

AMD Ryzen AI Pro 300 AI features and experiences

As the new processors are designed for Microsoft’s Copilot+ PCs, they support experiences like Windows Studio Effects, which let you add background blur to video calls and AI noise isolation. They also support live captions and on-device real-time translation of over 40 languages. There is also support for Cocreator, where users can draw and generate images in the Paint app using strokes and text prompts. Finally, there is also support for the “Recall” feature when Microsoft rolls out the same in the coming months.

Talking about AI experiences, AMD is already working with multiple enterprise ISVs to optimize next-generation AI experiences on these platforms. The third-generation AMD Ryzen AI software is the key glue here to help enterprises and ISVs deploy (ONNX Runtime) AI-powered commercial applications quickly and easily.

This will unlock business LLMs for data processing, real-time threat detection, software coding assistant and more advanced GenAI experiences. Businesses can also take advantage of collaboration features like speech recognition and transcription, intelligent meeting assistant to summarize notes, and more.

Source: AMD

In terms of privacy features, the new processors leverage AMD Pro Technologies to support advanced multi-layer security, privacy and manageability features. These include threat/anomaly detection and the ability to diagnose and resolve security issues. Some new capabilities include the Cloud Bare Metal Recovery (cBMR) support, which lets enterprise IT admins recover the system via cloud remotely, something that is not available on consumer laptops. Besides, AMD has included a new Watch Dog timer to improve application resiliency for smooth performance without hiccups, and a Supply Chain Security feature for the traceability of AMD chips across the supply chain and to maintain the ingenuity of the chip.

AMD’s advantage over competition

AMD has a first-mover advantage over its competitors in the enterprise segment. Qualcomm’s Snapdragon X-series processors are not yet available for the enterprise, and Intel is yet to announce its Lunar Lake vPRO processors. And while these processors meet Microsoft’s Copilot+ PC criteria of 40 TOPS NPU performance, there is one area where AMD differentiates – concurrency of multiple AI workloads, as we estimate over 5-10 advanced LLMs to SLMs running in the background in future. AMD is also promising up to 9 hours of battery life with heavy applications such as Microsoft Teams as a measure of the platform’s power efficiency.

In terms of the AI PC momentum for enterprise, there is already support from big names like Zoom, Microsoft, Adobe, Blackmagic Design, GoPro, Topaz Labs, Grammarly, LM Studio, Maxon and Webex, to name a few. Bufferzone brings AI-based anti-phishing for enhanced privacy and protection, whereas Dynamo AI ensures transparent AI decisions compliant with a regulated standard for industries like finance and healthcare.

A group of white logosDescription automatically generated

Source: AMD

Key takeaways

  • AMD’s new Ryzen AI Pro 300 series accelerates the vendor’s mindshare and market share in the enterprise AI PC segment ahead of rivals Intel, Qualcomm and Apple.

  • Offering higher performance, better battery life and bunch of enterprise features and optimization with key enterprise ISVs, along with the AI workloads concurrency, should be a big differentiator for AMD.

  • The three SKUs will drive more than 100 design wins over the next 12 months, accelerating AI PC adoption in enterprises.

Summary

Published

Oct 16, 2024

Author

Team Counterpoint

Counterpoint research is a young and fast growing research firm covering analysis of the tech industry. Coverage areas are connected devices, digital consumer goods, software & applications and other adjacent topics. We provide syndicated research reports as well as tailored. Our seminars and workshops for companies and institutions are popular and available on demand. Consulting and customer

Back To List