Intel Releases GenAI Examples v1.5 - While Validating This AI Showcase On Old Xeon CPUs
Summary
Intel engineers, as part of the OPEA Project, have released Generative AI Examples v1.5, an open-source collection demonstrating the capabilities of the Open Platform for Enterprise AI (OPEA) and Intel's hardware for generative AI. Key updates include a new use-case for automating repetitive web tasks, an Arbitration Post Hearing Assistant Application, a Polylingua Translation Service, OpenAI API-compatible endpoints, new GenAI Microservices, faster Intel Arc GPU support via an updated LLM-Scaler-vLLM container, and drag-and-drop fine-tuning application creation in GenAI Studio. Interestingly, the hardware validated for this release still relies on prior-generation Intel offerings, specifically Intel Gaudi Gen2 AI accelerators and 3rd Gen Xeon Scalable processors (Ice Lake from 2021), rather than the newer Gaudi 3 or current Xeon platforms.
(Source:Phoronix)