Linux GPU CLI Monitoring

This page provides how to monitor the usage of NVIDIA on Ubuntu.

nvidia-smi

nvidia-smi: The NVIDIA System Management Interface included with NVIDIA GPU drivers.

$ nvidia-smi

This allows for real-time monitoring reflashing every 1 second.

$ watch -n 1 nvidia-smi

nvtop

nvtop shows utilizaing the GPU, detailed memory usage statictics in text terminal.

$ sudo apt install nvtop
$ nvtop

Note: This method may not work in WSL environment.

$ nvtop
No GPU to monitor.

gpustat

gpustat is a simple CLI works only with NVIDIA.

$ pip install gpustat

To periodically watch:

$ gpustat --watch

nvitop

nvitop is an NVIDA-GPU process viewer. However processes may not show in WSL environment.

$ pip3 install nvitop

To run

$ nvitop

Note: Processes may not be shown in WSL environment.