GPU Drivers

Our Trooper.AI Blibs come pre-configured with NVIDIA drivers installed and tested during the provisioning process, ensuring immediate compatibility and optimal performance. We utilize the latest stable drivers for Ubuntu to support a wide range of applications and workloads. While we handle the initial configuration, advanced users have the flexibility to change driver versions independently via SSH access or by leveraging our dedicated GPU driver update template. This allows for customization based on specific application requirements or experimentation with newer driver releases. We recommend testing any custom driver changes in a non-production environment first.

Example Driver Output

The powerai.l1 Blib, optimized for high-performance workloads such as large-language-model (LLM) operations, operates on Ubuntu 22.04 LTS (upgradable). It comes pre-configured with NVIDIA driver version 580.x, ensuring seamless compatibility with both CUDA 13.x and CUDA 12.x.

Designed for maximum efficiency, this instance delivers an unthrottled power draw, unlocking peak GPU performance. With full root-level access, customers retain complete control over their environment, enabling independent upgrades to newer driver versions whenever required. This flexibility ensures tailored configurations aligned with specific application demands or experimental workflows.

Below is the example NVIDIA driver output:

nvidia-smi output example
nvidia-smi output example

All functionality remains accessible through standard administrative methods, reinforcing operational autonomy.

Updating the GPU Drivers

Use our optimized GPU Driver Update Template to streamline the process. Navigate to Actions > GPU Driver Update, then follow the guided workflow. This template ensures compatibility with your selected CUDA version, installs the required drivers automatically, and handles system restarts—eliminating manual configuration entirely.

It is not allowed to go below version 580 of GPU driver.

Official Nvidia Driver Support and SLA

Read more about official driver support for Linux here. This is an ongoing posting, which will be regulary updated by Nvidia devs: https://forums.developer.nvidia.com/t/unix-graphics-feature-deprecation-schedule/60588