Red Hat Device Edge

Red Hat AI Inference

by Red Hat

Red Hat AI Inference is an integrated, enterprise-grade inference stack powered by vLLM and llm-d that enables fast, scalable, and cost-effective deployment of AI models across hybrid cloud environments, supporting any model on any hardware accelerator with distributed inference, model optimization, and GenAI-specific telemetry.