AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
Phoronix
AMD has released Lemonade 10.7, an open-source local AI server SDK that now includes support for NVIDIA CUDA hardware.Summary
AMD has updated its Lemonade SDK to version 10.7, expanding its local AI server capabilities to include support for NVIDIA CUDA. While originally designed for AMD CPUs, GPUs, and NPUs, Lemonade aims to provide an OpenAI and Anthropic API-compatible environment. This release integrates Llama.cpp and stable-diffusion.cpp CUDA back-ends on Linux and Windows, alongside new Vulkan support for stable-diffusion.cpp. Additionally, the update introduces LMX-Omni model support, a Prometheus endpoint for monitoring, and a new benchmarking tool, 'lemonade bench', for evaluating performance across various AI software stacks.
(Source：Phoronix)