Prerequisites

Before you begin using NVIDIA-Ingest, ensure the following hardware and software prerequisites outlined are met.

Hardware

GPU	Family	Memory	# of GPUs (min.)
H100	SXM or PCIe	80GB	2
A100	SXM or PCIe	80GB	2

Software

• Linux operating systems (Ubuntu 22.04 or later recommended)
• Docker
• Docker Compose
• CUDA Toolkit (NVIDIA Driver >= 535, CUDA >= 12.2)
• NVIDIA Container Toolkit

[!Note] You install Python later. NVIDIA-Ingest only supports Python version 3.10.