Intel Releases GenAI Examples v1.5 - While Validating This AI Showcase On Old Xeon CPUs

Phoronix
Intel released GenAI Examples v1.5, showcasing new features while validating performance on older 3rd Gen Xeon CPUs.

Summary

Intel engineers, as part of the OPEA Project, have released Generative AI Examples v1.5, an open-source collection demonstrating the capabilities of the Open Platform for Enterprise AI (OPEA) and Intel's hardware for generative AI. Key updates include a new use-case for automating repetitive web tasks, an Arbitration Post Hearing Assistant Application, a Polylingua Translation Service, OpenAI API-compatible endpoints, new GenAI Microservices, faster Intel Arc GPU support via an updated LLM-Scaler-vLLM container, and drag-and-drop fine-tuning application creation in GenAI Studio. Interestingly, the hardware validated for this release still relies on prior-generation Intel offerings, specifically Intel Gaudi Gen2 AI accelerators and 3rd Gen Xeon Scalable processors (Ice Lake from 2021), rather than the newer Gaudi 3 or current Xeon platforms.

(Source:Phoronix)