dsx-ai-factory /run-ai

Run:ai is the AI workload orchestration platform for Kubernetes. This monorepo contains the control plane services, in-cluster Kubernetes operator/controllers, shared libraries and clients, the installer, and the local dev environment.

★ 763⑂ 129👁 1⑃ 4,972● 231▤ 27
GoApache-2.0Created 2026-08-25docs.nvidia.com/run-ai/
TA的项目
下载:3.0.243.0.24 ↓3.0.242026-11-12
+1
日增长
763
stars
129
forks
1
watchers
4,972
prs
231
issues
27
releases

README

!NVIDIA Run:ai: AI Workload and GPU Orchestration

 NVIDIA Run:ai






Docs | Roadmap | Installation | API Reference | Contributing | License

NVIDIA Run:ai is an open-source AI workload and GPU orchestration platform for managing shared AI infrastructure on Kubernetes.

NVIDIA Run:ai provides a consistent way to run development, training, and inference workloads across Kubernetes environments, whether deployed on-premises, in the cloud, or across hybrid infrastructure. It combines GPU scheduling, resource management, workload orchestration, governance, and observability to help organizations share GPU resources efficiently across teams and clusters.

This monorepo contains the NVIDIA Run:ai control plane and cluster services, installer, CLI, MCP server, documentation, shared client packages, and the local development environment.

 Architecture


  


Architecture Overview →

NVIDIA Run:ai is made up of two components, both installed on a Kubernetes cluster:

- NVIDIA Run:ai control plane - Provides centralized resource management, handles workload submission, and delivers cluster monitoring and analytics. The control plane is the management layer; it connects to one or more NVIDIA Run:ai clusters and gives administrators and users a single place to operate across them.
- NVIDIA Run:ai cluster - Set of cluster services that provide enhanced scheduling and workload management on each Kubernetes cluster where workloads run. The cluster component extends Kubernetes native scheduling with Run:ai’s GPU-aware capabilities.

At a high level:

- Users and external systems interact with NVIDIA Run:ai through the web UI, CLI, or REST API.
- The NVIDIA Run:ai control plane manages workloads, organizational resources, policies, and configuration across connected Kubernetes clusters.
- NVIDIA Run:ai cluster services synchronize configuration and workload requests from the control plane to the appropriate cluster.
- NVIDIA Run:ai applies scheduling and resource policies to determine where and how workloads run on available GPU and compute resources.
- Workload and cluster status is synchronized back to the NVIDIA Run:ai control plane, providing centralized visibility across connected clusters.

 Core Capabilities

| Capability                        | What it does                                                                                                                                |
| --------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------- |
| AI-aware GPU scheduling       | Schedules GPU workloads using fair-share, preemption, bin-packing, priorities, and topology-aware placement.                                |
| Dynamic GPU allocation        | Shares GPU resources across workloads with fractional GPU allocation and dynamic use of available capacity.                                 |
| Resource quotas and policies  | Allocates GP

Top issues

Discussions

Latest release

3.0.24 3.0.24 2026-11-12
Full Changelog: https://github.com/dsx-ai-factory/run-ai/compare/3.0.23...3.0.24

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON