Intel LLM-Scaler vllm-0.14.0-b8.2 Released With Official Arc Pro B70 Support - Phoronix
Phoronix
Intel has released an update for its LLM-Scaler stack, vllm-0.14.0-b8.2, which introduces official support for the Arc Pro B70 graphics card.Summary
Intel has released vllm-0.14.0-b8.2, an update to its LLM-Scaler initiative designed to streamline the deployment of large language models on Intel Arc hardware. The primary feature of this update is the official support for the Intel Arc Pro B70 GPU, which features 32GB of vRAM and is part of the latest-generation Battlemage graphics lineup.
In addition to hardware support, the update migrates the platform image to intel/llm-scaler-platform:26.18.8.2. This initiative, part of the broader Project Battlematrix, emphasizes Docker-ized deployments for AI inferencing on Intel hardware, including multi-GPU configurations.
(Source：Phoronix)