Unified memory is not dedicated GPU memory
The CPU and GPU share 128GB of LPDDR5x memory, which is also used by the OS, runtime environment and models. When assessing whether a model will fit, account for weight precision, context, cache and application processes. Not all of the reported capacity is available for model weights.
Confirm the software environment before choosing a rental period
NVIDIA DGX OS is based on Ubuntu 24.04 and includes CUDA and the NVIDIA AI software stack; models are not preinstalled. Model weights and application dependencies must be prepared separately. If existing software relies on x86 binaries or Windows, choose a compatible technical approach before renting.
Fixed network capacity does not guarantee download times
Unmetered 1 Gbps is suitable for downloading model weights and exporting results, but actual speeds depend on the model host, network path and application. Budget for preparation, execution and export—not just inference or training time.