Rutu

On-prem AI Infrastructure Series

This series is dedicated to advancing on-prem AI research. We go through tools and technologies for setting up AI Infrastructure on Kubernetes.

1. Using Nvidia GPUs with Kubernetes
Kubernetes Icon NVIDIA Cilium Containerd

This article takes you through the process of making the GPU resources available in your Kubernetes cluster. It contains steps for setting up a Kubernetes cluster with GPU nodes, crafted after a painstaking process and multiple retries.

2. Setting up the Istio Service Mesh
Kubernetes Icon Metallb Icon Cilium Istio

The Kubeflow manifests for Istio are quite complex and may be too much for an initial setup. Furthermore, integrating with Cilium and setting up Metallb needs additional configurations that are not defined in the Kubeflow manifests. This article provides you with the instructions to setup the Istio service mesh for Kubeflow.