Prerequisite

If you are new to virtualization, it is recommended to review VMware’s ESXi Getting Started , which includes courses and guidance on potentially any current configuration that you may already have.

  • One or more supported NVIDIA GPUs

  • NVIDIA Enterprise AI Early Access License

  • VMware ESXi 7 Update 2 Hypervisor ISO

  • NVIDIA vGPU software:

    • NVIDIA vGPU manager VIB

    • NVIDIA guest driver

Note

The vGPU Manager VIB is loaded like a driver in the vSphere hypervisor and is then managed by the vCenter Server.

You may leverage the NVIDIA System Management interface (NV-SMI) management and monitoring tool for testing and benchmarking.

The following server configuration details are considered best practices:

  • Hyperthreading – Enabled

  • Power Setting or System Profile– High Performance

  • CPU Performance (if applicable) – Enterprise or High Throughput

  • Memory Mapped I/O above 4-GB - Enabled (if applicable)

  • Single Root I/O Virtualization (SR-IOV) – Enabled

  • VT-d/IOMMU - Enabled