Marvell Delivers Advanced Packaging Platform for Custom AI Accelerators
Marvell Technology (NASDAQ: MRVL) has unveiled an innovative multi-die packaging platform for custom AI accelerators. The solution enables 2.8x larger multi-chip accelerator designs compared to conventional single-die implementations, featuring a novel RDL interposer that integrates 1390 mm² of silicon and four HBM3/3E memory stacks. The platform has been qualified with a major hyperscaler and is entering production.
Key advantages include more efficient die-to-die interconnect, lower power consumption, increased chiplet yields, and reduced total cost of ownership. The modular RDL interposer design offers an alternative to traditional silicon interposers, providing supply chain flexibility. Marvell is currently collaborating with three of the top four hyperscalers to develop custom XPUs and CPUs for clouds and AI clusters.
Marvell Technology (NASDAQ: MRVL) ha presentato una piattaforma innovativa di packaging multi-die per acceleratori AI personalizzati. Questa soluzione consente di realizzare progetti di acceleratori multi-chip 2,8 volte più grandi rispetto alle implementazioni tradizionali su singolo die, grazie a un nuovo interposer RDL che integra 1390 mm² di silicio e quattro stack di memoria HBM3/3E. La piattaforma è stata qualificata con un importante hyperscaler ed è in fase di produzione.
I principali vantaggi includono un’interconnessione die-to-die più efficiente, un minor consumo energetico, un aumento della resa dei chiplet e una riduzione del costo totale di proprietà. Il design modulare dell’interposer RDL rappresenta un’alternativa agli interposer in silicio tradizionali, offrendo maggiore flessibilità nella catena di approvvigionamento. Marvell sta attualmente collaborando con tre dei primi quattro hyperscaler per sviluppare XPUs e CPU personalizzati destinati a cloud e cluster AI.
Marvell Technology (NASDAQ: MRVL) ha presentado una innovadora plataforma de empaquetado multi-die para aceleradores AI personalizados. La solución permite diseños de aceleradores multi-chip 2.8 veces más grandes en comparación con implementaciones convencionales de un solo die, contando con un novedoso interposer RDL que integra 1390 mm² de silicio y cuatro pilas de memoria HBM3/3E. La plataforma ha sido certificada con un importante hyperscaler y está entrando en producción.
Las ventajas clave incluyen una interconexión die-a-die más eficiente, menor consumo de energía, mayor rendimiento de chiplets y reducción del costo total de propiedad. El diseño modular del interposer RDL ofrece una alternativa a los interposers de silicio tradicionales, proporcionando flexibilidad en la cadena de suministro. Marvell está colaborando actualmente con tres de los cuatro principales hyperscalers para desarrollar XPUs y CPUs personalizados para nubes y clústeres de AI.
Marvell Technology (NASDAQ: MRVL)는 맞춤형 AI 가속기를 위한 혁신적인 멀티 다이 패키징 플랫폼을 공개했습니다. 이 솔루션은 기존 단일 다이 구현에 비해 2.8배 더 큰 멀티 칩 가속기 설계를 가능하게 하며, 1390 mm² 실리콘과 4개의 HBM3/3E 메모리 스택을 통합한 새로운 RDL 인터포저를 특징으로 합니다. 이 플랫폼은 주요 하이퍼스케일러와의 인증을 마쳤으며 생산 단계에 진입했습니다.
주요 장점으로는 더 효율적인 다이 간 인터커넥트, 낮은 전력 소비, 향상된 칩렛 수율, 그리고 총 소유 비용 감소가 있습니다. 모듈형 RDL 인터포저 설계는 기존 실리콘 인터포저의 대안으로서 공급망 유연성을 제공합니다. Marvell은 현재 상위 4대 하이퍼스케일러 중 3곳과 협력하여 클라우드 및 AI 클러스터용 맞춤형 XPU와 CPU를 개발 중입니다.
Marvell Technology (NASDAQ : MRVL) a dévoilé une plateforme innovante d’emballage multi-die pour accélérateurs AI personnalisés. Cette solution permet des conceptions d’accélérateurs multi-puces 2,8 fois plus grandes que les implementations classiques sur un seul die, grâce à un nouvel interposeur RDL intégrant 1390 mm² de silicium et quatre piles de mémoire HBM3/3E. La plateforme a été qualifiée avec un hyperscaler majeur et entre en production.
Les principaux avantages incluent une interconnexion die-à-die plus efficace, une consommation d’énergie réduite, un rendement accru des chiplets et une diminution du coût total de possession. Le design modulaire de l’interposeur RDL offre une alternative aux interposeurs en silicium traditionnels, apportant une flexibilité dans la chaîne d’approvisionnement. Marvell collabore actuellement avec trois des quatre principaux hyperscalers pour développer des XPUs et CPUs personnalisés destinés aux clouds et aux clusters AI.
Marvell Technology (NASDAQ: MRVL) hat eine innovative Multi-Die-Packaging-Plattform für maßgeschneiderte KI-Beschleuniger vorgestellt. Die Lösung ermöglicht 2,8-mal größere Multi-Chip-Beschleuniger-Designs im Vergleich zu herkömmlichen Single-Die-Implementierungen und verfügt über einen neuartigen RDL-Interposer, der 1390 mm² Silizium und vier HBM3/3E-Speicherstapel integriert. Die Plattform wurde mit einem großen Hyperscaler qualifiziert und geht nun in die Produktion.
Zu den wichtigsten Vorteilen zählen effizientere Die-zu-Die-Interkonnektivität, geringerer Stromverbrauch, höhere Chiplet-Ausbeuten und reduzierte Gesamtbetriebskosten. Das modulare RDL-Interposer-Design bietet eine Alternative zu herkömmlichen Silizium-Interposern und sorgt für Flexibilität in der Lieferkette. Marvell arbeitet derzeit mit drei der vier größten Hyperscaler zusammen, um maßgeschneiderte XPUs und CPUs für Cloud- und KI-Cluster zu entwickeln.
- Platform enables 2.8x larger multi-chip accelerator designs than conventional single-die implementations
- Solution is already production-qualified and ramping with a major hyperscaler
- Reduces total cost of ownership through improved yields and modular design
- Partnerships with 3 of top 4 hyperscalers for custom XPU/CPU development
- Addresses supply chain flexibility concerns in advanced packaging
- None.
Insights
Marvell's advanced packaging platform significantly enhances AI accelerator capabilities while reducing costs through innovative multi-die solutions.
Marvell's new multi-die packaging platform represents a significant technological breakthrough in the AI semiconductor space. The solution enables AI accelerator designs 2.8x larger than traditional single-die implementations, a substantial leap in computing density that addresses one of the fundamental bottlenecks in AI infrastructure scaling.
What makes this particularly noteworthy is the modular re-distribution layer (RDL) interposer approach, which offers several critical advantages over conventional silicon interposers. The platform integrates 1390 mm² of silicon and four HBM3/3E memory stacks with six interposer RDL layers. This modular approach creates form-fitted interposers that connect to individual dies rather than spanning entire packages, dramatically improving yield management – a critical factor in production economics.
The technical specifications indicate superior die-to-die interconnect efficiency, which translates to lower power consumption and better thermal management – essential considerations as AI models continue to grow in size and complexity. By enabling replacement of individual dies rather than entire packages when defects occur, this approach significantly improves manufacturing yields and reduces costs.
The platform's qualification with a major hyperscaler and current production ramp demonstrates market validation beyond mere technical innovation. The endorsements from key ecosystem partners including ASE, Amkor, SEMCO, and SPIL underscore the industry alignment behind this approach. This packaging innovation complements Marvell's previously announced custom HBM and CPO solutions, creating a comprehensive platform for custom XPU design that addresses the challenging economics of AI infrastructure scaling.
- Novel multi-die packaging platform enables multi-die architectures with lower power consumption and reduced total cost
- Industry-first modular RDL interposer offers an alternative to traditional silicon interposers and enables supply chain flexibility for data center infrastructure
- Solution is production-qualified and now entering production ramp in support of customer-specific AI accelerator designs
In the AI era, chip packaging has become critical for increasing compute density while effectively managing power, thermal dissipation, optical I/O, signal integrity, and other factors that impact the performance and reliability in multi-die chiplet designs. Simultaneously, rising supply chain complexity and extended lead times present significant challenges for scaling advanced packaging solutions. The new Marvell packaging solution enables hyperscalers to overcome these barriers, accelerating time-to-market while offering supply chain flexibility.
This is the latest innovation in a series of advancements for customers of Marvell custom XPU solutions. This highly optimized multi-chip packaging platform was designed from the ground up with the recently announced Marvell custom HBM and CPO solutions in mind. Taken together, Marvell is building the industry's broadest technology platform to enable custom XPU design for the future.
"Advanced packaging is one of the primary vehicles for advancing compute density in AI clusters and cloud," said Will Chu, senior vice president and general manager of Custom Cloud Solutions at Marvell. "Without it, AI infrastructure would be significantly more expensive and power-hungry. We look forward to collaborating with our partners and customers to further unlock the potential of advanced packaging."
"Chiplets constitute one of the most dynamic segments of the semiconductor market. We anticipate that chiplet processor revenue will grow by
Interposers serve as the foundational layer with compute, dies, memory, and other components stacked above and communicating through the interposer. The Marvell re-distribution layer (RDL) offers a compelling alternative to traditional silicon interposers for data center applications. The Marvell approach integrates 1390 mm2 of silicon and four pieces of high-bandwidth memory 3/3E (HBM3/3E) memory stacks and utilizes six interposer RDL layers. This enables multi-die AI accelerator solutions that are 2.8 times larger than the largest possible single-chip design. The Marvell multi-die packaging solution allows for shorter die-to-die interconnects and a modular RDL interposer.
The Marvell RDL interposer reduces design cost through its modular design. In conventional chiplets, a single interposer will span the floor space of the chips it connects well as any area between them. If two computing cores are on opposite sides of a chiplet package, the interposer will cover the entire space. By contrast, Marvell RDL interposers are form-fitted to individual computing dies and connected by high-bandwidth paths. Not only does this approach reduce materials, it also increases chiplet yields by enabling manufacturers to replace individual dies.
The Marvell multi-die packaging platform enables the integration of passive devices to reduce potential signal noise within the chiplet package caused by the power supply. In collaboration with the packaging ecosystem, Marvell has extended the solution to support multiple components within a single package, enabling the integration of the most complex AI designs.
In addition, hyperscalers can now employ the packaging technology to build XPUs with HBM3 and HBM3E memory and Marvell is actively qualifying the technology for future HBM4 designs.
Ecosystem Quotes
"Leading-edge packaging technologies are critical to the adoption of chiplet architectures in current and future generations of AI and accelerated compute devices," said Dr. Mike Hung, senior vice president at Advanced Semiconductor Engineering (ASE). "Our close collaboration with Marvell enables us to develop solutions that deliver higher levels of performance and efficiency, while reaching a broader audience across the design ecosystem."
"2.5D packaging technology continues to modernize heterogeneous IC packaging, enabling high-performance, cost-effective integration of multiple chiplet and memory modules," said Kevin Engel, chief operating officer at Amkor Technology. "This technology not only increases I/O and circuit density, but also paves the way for advanced 3D structures, making it indispensable for the next generation of applications."
"The most complicated issue in the AI/ML solution design is to create an effective power delivery network, as GPUs are increasingly using more power. SEMCO is proud to have collaborated with Marvell to create a leading power delivery solution using its custom designed silicon capacitors and passive components," said Taegon Lee, executive vice president and head of the Strategic Marketing Center at Samsung Electro-Mechanics (SEMCO). "The ecosystem approach we collectively took in developing this solution will rapidly become the norm. We look forward to continued collaboration with Marvell."
"RDL-based chiplet integration gives Marvell the flexibility to choose the optimal process technology for each part of their design," said CB Chang, president and CEO at Siliconware
Marvell Custom Strategy
The Marvell custom platform strategy seeks to deliver breakthrough results through unique semiconductor designs and innovative approaches. By combining expertise in system and semiconductor design, advanced process manufacturing, and a comprehensive portfolio of semiconductor platform solutions and IP—including electrical and optical serializer/deserializers (SerDes), die-to-die interconnects for 2D and 3D devices, silicon photonics, co-packaged copper, custom HBM, system-on-chip (SoC) fabrics, optical IO, and compute fabric interfaces such as PCIe Gen 7— Marvell is able to create platforms in collaboration with customers that transform infrastructure performance, efficiency and value.
Marvell is currently collaborating with three of the top four hyperscalers to develop custom XPUs and CPUs for clouds and AI clusters as well as custom network interface controllers, CXL controllers and other devices to further optimize accelerated infrastructure.
About Marvell
To deliver the data infrastructure technology that connects the world, we're building solutions on the most powerful foundation: our partnerships with our customers. Trusted by the world's leading technology companies for over 25 years, we move, store, process and secure the world's data with semiconductor solutions designed for our customers' current needs and future ambitions. Through a process of deep collaboration and transparency, we're ultimately changing the way tomorrow's enterprise, cloud, automotive, and carrier architectures transform—for the better.
Marvell and the M logo are trademarks of Marvell or its affiliates. Please visit www.marvell.com for a complete list of Marvell trademarks. Other names and brands may be claimed as the property of others.
This press release contains forward-looking statements within the meaning of the federal securities laws that involve risks and uncertainties. Forward-looking statements include, without limitation, any statement that may predict, forecast, indicate or imply future events, results or achievements. Actual events, results or achievements may differ materially from those contemplated in this press release. Forward-looking statements are only predictions and are subject to risks, uncertainties and assumptions that are difficult to predict, including those described in the "Risk Factors" section of our Annual Reports on Form 10-K, Quarterly Reports on Form 10-Q and other documents filed by us from time to time with the SEC. Forward-looking statements speak only as of the date they are made. Readers are cautioned not to put undue reliance on forward-looking statements, and no person assumes any obligation to update or revise any such forward-looking statements, whether as a result of new information, future events or otherwise.
For further information, contact:
Kim Markle
pr@marvell.com
View original content to download multimedia:https://www.prnewswire.com/news-releases/marvell-delivers-advanced-packaging-platform-for-custom-ai-accelerators-302467968.html
SOURCE Marvell