Nvidia's New Tool Lets Companies Run AI Clusters on Their Own Servers
This could cut cloud costs and give firms more control over their AI infrastructure.
NVIDIA Kubernetes Engine (NVKE) is available as a preview. It is not a Kubernetes distribution and not a Cluster API flavour; it is a self-hosting factory for Kubernetes clusters: a throwaway seed cluster stands up a management cluster, and the management plane then provisions and lifecycle-manages many isolated workload clusters on demand. Platform teams install the NVKE management plane to create and operate Kubernetes clusters for their customers. Each workload cluster has its own Kubernetes control plane, etcd and node pools, and customers use their clusters through the Kubernetes API and kubectl.
NVKE is not recommended for production workloads during preview, and APIs, configuration and behavior can change between releases. For a real installation, you supply the machines, networking, node images and registries, and configure access to NVIDIA Infra Controller (NICo), the sole compatible infrastructure provider at preview. The preview needs explicit operator configuration: API authentication is off and the API uses plain HTTP after installation, so configure API authentication and protected access before admitting callers. The management cluster does not upgrade, scale or replace itself, and there is no management-plane upgrade or backup/restore procedure. FDE node images are for evaluation and provide no data-at-rest confidentiality.
- Nvidia's NVKE lets companies manage their own GPU clusters for AI, potentially reducing cloud costs.
- It's a preview with security and management limitations, so not recommended for production yet.
- Aimed at platform teams, it could lead to more private and cost-effective AI deployments.
Why It Matters
Businesses could save money on AI computing and have more control over their data, but security risks remain.