CUDA Time-Slicing

• https://github.com/NVIDIA/k8s-device-plugin?tab=readme-ov-file#with-cuda-time-slicing

version: v1
sharing:
  timeSlicing:
    renameByDefault: <bool>
    failRequestsGreaterThanOne: <bool>
    resources:
    - name: <resource-name>
      replicas: <num-replicas>
    ...

Nvidia tools: CUDA, NVIDIA Data Center GPU Manager (DCGM), nvcc, Nvidia Management Library (NVML), nvidia-smi, nvidia-device-plugin, CUDA Time-Slicing

GPU, CUDA, CUDA Toolkit, ROCm, Stable Diffusion, cuda-keyring, nvcc, NVIDIA Data Center GPU Manager (DCGM)