AMD Unveils 5th Gen EPYC CPUs for Data Centres

AMD Unveils 5th Gen EPYC CPUs for Data Centres

Surprisingly Useful AI Article Enhancements

AMD has launched its 5th Gen EPYC processors, designed to handle a wide range of workloads in data centres, including enterprise, Ai, and cloud-based infrastructures. The new processors, formerly codenamed “Turin,” aim to deliver improved performance and energy efficiency.

Using the “Zen 5” core architecture, these processors offer a broad range of core counts, from 8 to 192. The flagship 192-core CPU delivers up to 2.7 times the performance compared to competing processors, making it a strong option for handling complex tasks in modern data centres.

Dan McNamara, Senior Vice President and General Manager of AMD’s Server Business, said, “AMD has earned the trust of customers who value performance, innovation, and energy efficiency. With five generations of on-time roadmap execution, AMD has shown it can meet the needs of the data centre market.”

Tailored for Ai and Enterprise Solutions

A notable addition to the EPYC 9005 Series is the 64-core EPYC 9575F, designed for Ai workloads that rely on GPU support. This processor boosts up to 5GHz, providing up to 28 per cent faster processing than its closest competitor. This speed is crucial for feeding GPUs with the data needed for demanding Ai tasks.

“From powering supercomputers to leading enterprises, AMD has consistently delivered performance and innovation,” McNamara added, highlighting the versatility of the new processors.

Performance for a Variety of Workloads

The 5th Gen EPYC processors are built to handle an array of tasks. Whether supporting corporate Ai initiatives, powering cloud-based infrastructures, or managing business-critical applications, the new processors offer enhanced capabilities for a broad spectrum of server workloads.

With the “Zen 5” core architecture, customers can expect up to 17 per cent better instructions per clock (IPC) for enterprise and cloud workloads. For Ai and high-performance computing (HPC) tasks, the processors deliver up to 37 per cent higher IPC compared to the previous generation.

For businesses relying on EPYC 9965 processor-based servers, this translates into significant improvements across real-world applications. Tasks like video transcoding and virtual infrastructure performance are expected to run much faster. For instance, servers equipped with the EPYC 9965 CPU can complete video transcoding tasks up to four times faster than Intel Xeon-based servers.

Ai-Specific Capabilities

The EPYC processors also support Ai deployments, whether a company is using CPUs alone or a combination of CPUs and GPUs. AMD’s focus on Ai-specific performance is evident in the new processors’ ability to handle end-to-end Ai workloads.

For example, the 192-core EPYC 9965 CPU offers up to 3.7 times the performance on Ai tasks like TPCx-Ai. It also provides nearly twice the throughput performance compared to competitors when handling smaller generative Ai models, such as Meta’s Llama 3.1-8B.

The EPYC 9575F, built for Ai workloads, can boost to 5GHz, helping Ai clusters manage inference processes more efficiently. AMD claims that with this CPU, a 1,000-node Ai cluster can drive up to 700,000 more inference tokens per second.

Efficiency and Sustainability in Data Centres

Upgrading to a data centre powered by the new EPYC processors can yield impressive results. According to AMD, customers could achieve up to 391,000 units of SPECrate general-purpose computing performance while using 71 per cent less power and reducing the number of servers required by about 87 per cent.

This provides IT leaders with a choice: either benefit from the space and power savings or invest in higher performance for day-to-day tasks while also improving Ai performance.

Widespread Adoption and Ecosystem Support

The 5th Gen AMD EPYC processors have already gained widespread adoption, with support from major OEMs like Cisco, Dell, Hewlett Packard Enterprise, Lenovo, and Supermicro. The processors are also supported by cloud service providers, offering organisations a straightforward upgrade path for enhancing their compute and Ai capabilities.

Key Features of 5th Gen AMD EPYC Processors

The latest EPYC CPUs come with several high-level features, including:

  • Core count options ranging from 8 to 192
  • Zen 5 and Zen 5c core architectures
  • 12 channels of DDR5 memory per CPU
  • Support for DDR5-6400 MT/s
  • Boost frequencies up to 5GHz
  • AVX-512 support
  • Trusted I/O for confidential computing

With these features, AMD continues to push the envelope in performance and efficiency for modern data centres. The entire lineup of 5th Gen AMD EPYC processors is now available, offering businesses a versatile option to meet the growing demands of their IT environments.

Model

(AMD EPYC)
CoresCCD

(Zen5/Zen5c)
Base/Boost5

(up to GHz)
Default

 TDP (W)
L3 Cache

(MB)
Price

(1 KU, USD)
9965192 cores“Zen5c”2.25 / 3.7500W384$14,813
9845160 cores“Zen5c”2.1 / 3.7390W320$13,564
9825144 cores“Zen5c”2.2 / 3.7390W384$13,006
9755

9745
128 cores“Zen5”

“Zen5c”
2.7 / 4.1

2.4 / 3.7
500W

400W
512

256
$12,984

$12,141
9655

9655P

9645
96 cores“Zen5”

“Zen5”

“Zen5c”
2.6 / 4.5

2.6 / 4.5

2.3 / 3.7
400W

400W

320W
384

384

384
$11,852

$10,811

$11,048
956572 cores“Zen5”3.15 / 4.3400W384$10,486
9575F

9555

9555P

9535
64 cores“Zen5”

“Zen5”

“Zen5”

“Zen5”
3.3 / 5.0

3.2 / 4.4

3.2 / 4.4

2.4 / 4.3
400W

360W

360W

300W
256

256

256

256
$11,791

$9,826

$7,983

$8,992
9475F

9455

9455P
48 cores“Zen5”

“Zen5”

“Zen5”
3.65 / 4.8

3.15 / 4.4

3.15 / 4.4
400W

300W

300W
256

192

192
$7,592

$5,412

$4,819
936536 cores“Zen5”3.4 / 4.3300W256$4,341
9375F

9355

9355P

9335
32 cores“Zen5”

“Zen5”

“Zen5”

“Zen5”
3.8 / 4.8

3.55 / 4.4

3.55 / 4.4

3.0 / 4.4
320W

280W

280W

210W
256

256

256

256
$5,306

$3,694

$2,998

$3,178
9275F

9255
24 cores“Zen5”

“Zen5”
4.1 / 4.8

3.25 / 4.3
320W

200W
256

128
$3,439

$2,495
9175F

9135

9115
16 cores“Zen5”

“Zen5”

“Zen5”
4.2 / 5.0

3.65 / 4.3

2.6 / 4.1
320W

200W

125W
512

64

64
$4,256

$1,214

$726
90158 cores“Zen5”3.6 / 4.1125W64$527

Last Updated on October 14, 2024 by Nick Ross

Surprisingly Useful AI Article Enhancements

Sign-up to the SMBtech Daily Newsletter

We will not spam you. You can easily unsubscribe any time. Read our privacy policy.