OpenAI unveils its first custom chip, built by Broadcom
TechCrunch
OpenAI has introduced Jalapeño, its first custom-designed inference processor developed in collaboration with Broadcom to optimize AI model performance and reduce costs.Summary
OpenAI has unveiled its first custom-designed inference processor, codenamed Jalapeño, developed in partnership with Broadcom. Designed specifically to handle the unique workloads of OpenAI's AI models, the chip aims to improve performance-per-watt and lower the operational costs of running real-time inference. By vertically integrating chip architecture alongside its software and data centers, OpenAI seeks to reduce its reliance on Nvidia hardware and gain greater control over its infrastructure's efficiency and reliability.
(Source：TechCrunch)