Be the first, order the brand new Galaxy S24 FE, Galaxy Tab S10 Ultra, order the KING Galaxy S24 Ultra!

SamMobile has affiliate and sponsored partnerships. If you buy something through one of these links, we may earn a commission.

News For You
News For You
Notifications

Samsung unveils its HBM3E memory and new CXL memory modules

General
By 

Last updated: March 27th, 2024 at 05:14 UTC+01:00

Samsung is the world's biggest semiconductor memory chip maker and is often the first to launch new technologies in the segment. Today, the company unveiled its new CXL (Compute Express Link) memory modules and the HBM3E memory. These products are meant to be used in cloud servers and supercomputers for AI and other high-performance computing needs.

At the Memory Con 2024 expo happening at Santa Clara’s Computer History Museum in Silicon Vallery, California, USA, Samsung introduced the CXL Memory Module – Box (CMM-B), CXL Memory Module – DRAM (CMM-D), CXL Memory Module Hybrid for Tiered Memory (CMM-H TM) and HBM3E 12H chip.

Samsung showcases a CXL-based DRAM memory module and box form factor

Samsung CXL Memory Module Box

CMM-B

CXL Memory Module – Box (CMM-B) is a DRAM product. It can accommodate eight CMM-D devices with the E3.S form factory, offering up to 2TB of DRAM capacity. It has a bandwidth of 60GB/s and a latency of just 596ns. It can be used in applications such as AI, Data Analytics, Generative AI, and In-Memory Database (IMDB).

CMM-D

But what is CMM-D? It is a CXL Memory Module – DRAM, which uses Samsung's DRAM chips with the CXL open standard interface. It offers efficient and low-latency connectivity between the CPU and memory expansion devices.

Red Hat, the global leader in open-source software, validated Samsung's CMM-D devices with its enterprise software last year. The two companies will continue their collaboration to develop CXL open-source and reference models. They will also partner on a range of other memory and storage products.

Samsung partnered with Supermicro to showcase the industry's first Rack-Level memory solution based on the CXL Memory Module Box. It is highly scalable and is used to increase memory bandwidth and capacity for data centers that handle demanding workloads. It is highly flexible and can replace standard architectures that lack efficiency and flexibility for modern applications.

CMM-H TM

In partnership with VMWare by Broadcom, Samsung introduced Project Peaberry. It is the world's first Field Programmable Gate Arrays (FPGA)-based tiered memory solution for hypervisors (machines that run multiple virtual machines). It is called CXL Memory Module Hybrid for Tiered Memory (CMM-H TM). It is a hybrid solution that combines DRAM and NAND flash memory in the form of an Add-In Card (AIC). It can tackle memory management challenges, improve performance, reduce downtime, and optimize scheduling. It also reduces the total cost of ownership (TCO).

Samsung's HBM3E 12H memory chip offers the highest HBM capacity ever

Samsung HBM3E 12H DRAM Chip

Samsung also showcased its HBM3E 12H chip at Memcon 2024. It is the world’s first 12-stack HBM3E DRAM memory chip, offering the highest capacity ever achieved using HBM technology. HBM3E 12H chips feature Samsung's advanced thermal compression non-conductive film (TC NCF) technology to enhance the vertical density of the chip by over 20% compared to its predecessor. It also offers better product yield. Samsung is sampling HBM3E 12H chips to customers and is planning to start mass production in the first half of this year.

Jin-Hyeok Choi, SangJoon Hwang, Paul Turner, and Gunnar Hellekson were present on stage during the announcements. SangJoon Hwang is the Corporate Executive Vice President and Head of DRAM Product and Technology at Samsung Electronics. Jin-Hyeok Choi is the Corporate Executive Vice President of Device Solutions Research America – Memory at Samsung Electronics. Paul Turner is the Vice President of the Product Team in the VCF Division at VMware by Broadcom. Gunnar Hellekson is the Vice President and General Manager at Red Hat.

Jin-Hyeok Choi, said, “AI innovation cannot continue without memory technology innovation. As the market leader in memory, Samsung is proud to continue advancing innovation – from the industry’s most advanced CMM-B technology, to powerful memory solutions like HBM3E for high-performance computing and demanding AI applications. We are committed to collaborating with our partners and serving our customers to unlock the full potential of the AI era together.

General AICXLDRAMGenerative AIHBMHBM3ESamsung Semiconductor
Galaxy AI summarized

Scroll for more related content
News For You

You might also like

Samsung about to cut high-ranking executive jobs across key divisions

Samsung about to cut high-ranking executive jobs across key divisions

Although Samsung recently said it has no plans to spin off its Foundry and System LSI divisions, the tech conglomerate will reportedly cut significant executive job numbers throughout its chip-making arms before the end of 2024. A new report citing industry sources says the head of the Device Solutions (DS) division, under which Samsung's semiconductor […]

  • By Mihai Matei
  • 4 days ago
Samsung maintains Global Top 5 brand status for 5th year in a row

Samsung maintains Global Top 5 brand status for 5th year in a row

Despite Samsung Electronics going through a rough patch and having to apologize to investors, customers, and employees, not everything the company did this year was questionable. The tech giants launched some amazing products and led several initiatives and tech advancements. For these reasons, the global brand consultancy firm Interbrand recognized Samsung as a Global Top […]

  • By Mihai Matei
  • 4 days ago
Samsung reportedly facing low yields of Galaxy S25’s 3nm Exynos 2500 chip

Samsung reportedly facing low yields of Galaxy S25’s 3nm Exynos 2500 chip

The phones in the Galaxy S25 lineup are expected to be the company's first to use 3nm chips. Earlier, it was rumored that Samsung would use 3nm Exynos 2500 in the Galaxy S25 and the Galaxy S25+ and the 3nm Snapdragon 8 Elite in the Galaxy S25 Ultra. However, that might change as the company […]

  • By Asif Iqbal Shaik
  • 1 week ago
Samsung launches industry’s fastest PCIe 5.0 SSD

Samsung launches industry’s fastest PCIe 5.0 SSD

A couple of months ago, Samsung announced its first PCIe 5.0 SSD, the PM9E1. Last month, it was reported that Samsung will start mass production of the new SSD with extra anti-forgery measures. The company has now announced its latest SSD's mass production has begun. Samsung PM9E1 PCIe 5.0 SSD mass production has started Samsung […]

  • By Asif Iqbal Shaik
  • 1 week ago
SmartThings to offer AI-powered suggestions via Home Insight

SmartThings to offer AI-powered suggestions via Home Insight

Samsung unveiled several new features for its platforms last night at the Samsung Developer Conference (SDC) 2024. In addition to Bixby, One UI 7.0, and Tizen, the company showcased how it is planning to improve its smart home platform, SmartThings, with AI. One of those new features is SmartThings Home Insight. SmartThings Home Insight offers […]

  • By Asif Iqbal Shaik
  • 1 week ago
An overview of what Samsung is announcing at its developer conference

An overview of what Samsung is announcing at its developer conference

We are in San Jose for the Samsung Developer Conference (SDC24), where the company offered an overview of its software-related plans for the future. Jong-Hee Han, Vice Chairman, CEO, and Head of the Samsung Device eXperience (DX) Division, talked about the company's strategy. An even greater focus on AI experiences Unsurprisingly, Samsung's current vision involves […]

  • By Mihai Matei
  • 2 weeks ago