Red Hat offers Red Hat Enterprise Linux AI (RHEL AI) and Red Hat OpenShift AI, a suite of platforms that allow enterprise customers to fine-tune, serve, and manage open-source large language models — including IBM's Granite family — on their own hardware and cloud environments.

RHEL AI, which reached general availability in September 2024, packages IBM's open-source Granite LLMs and the InstructLab model alignment tools into a bootable RHEL image, allowing organizations with limited data science expertise to fine-tune AI models on their own proprietary data. Red Hat OpenShift AI is a broader MLOps platform for managing the full lifecycle of both predictive and generative AI models at scale across hybrid cloud environments, including training, serving, monitoring, and model registry. Red Hat AI 3 (announced late 2025) introduced distributed inference with LLM-D and a foundation for agentic AI. These products are sold as enterprise subscriptions and are available on major cloud providers including AWS, Google Cloud, and Azure.