Nvidia Driver
Go to Nvidia's driver download website and find a menu that looks like this at the top of the page
The first three dropdown boxes just define which GPU you are using. Click through the options to select your GPU
"Download Type" should always be set to "Production Branch" and "Language" can be set to whatever you prefer
If using standard Ubuntu 20.04
Select "Linux 64-bit" for the "Operating System" dropbox
If using WSL2
Select "Windows 10 64-bit" or "Windows 11" for the "Operating System" dropbox
Click "Search"
Click "Download"
Open the terminal and run the installer (in the case of WSL2, it will be an exe file)
Click on "NVIDIA Graphics Driver", then "AGREE AND CONTINUE "
Choose "Express" then click "NEXT"
The installer will then execute
Then "CLOSE" the installer
Restart the terminal and then run the command
nvidia-smi
Cuda
Get the new Nvidia keys
sudo apt-key del 7fa2af80
wget https://developer.download.nvidia.com/compute/cuda/repos/wsl-ubuntu/x86_64/cuda-wsl-ubuntu.pin
sudo mv cuda-wsl-ubuntu.pin /etc/apt/preferences.d/cuda-repository-pin-600
Check this chart to see the latest version of CUDA that is supported by cuDNN
As you can see above, CUDA 11.6 is the latest version to be supported by cuDNN. Click on that number on the webpage to be redirected to the release page
You should not click any links here - just see that 11.6.2 in this case is the newest version of CUDA 11.6, so we will install that version
Set the CUDA version number that you would like to download in order of "XX.Y.Z". The example of downloading 11.6.2 is shown below. All the rest of the commands can be copy-pasted directly
export XX=11
export Y=6
export Z=2
Download the debian file
wget https://developer.download.nvidia.com/compute/cuda/${XX}.${Y}.${Z}/
local_installers/cuda-repo-wsl-ubuntu-${XX}-${Y}-local_${XX}.${Y}.${Z}-1_amd64.deb
Configure the installer to be available to the "apt" system
sudo dpkg -i cuda-repo-wsl-ubuntu-${XX}-${Y}-local_${XX}.${Y}.${Z}-1_amd64.deb
Install cuda
sudo apt update
sudo apt install cuda=${XX}.${Y}.${Z}-1 -y
Add CUDA to your system PATH. Open ~/.bashrc ("gedit ~/.bashrc") and add this line to the bottom of the file
export PATH=/usr/local/cuda/bin:${PATH}
Reflect those changes in your current terminal session
source ~/.bashrc
Check that your version of cuda is installed
nvcc --version
CUDNN
Export the CUDA version, which can be found as shown above, using "nvcc --version"
export CUDA_VERSION=11.6
Install the CUDNN driver for ubuntu 20.04
Go the the CUDNN home page
Click on "Download cuDNN"
Check "I Agree To the Terms..." and then click on "Download cuDNN vW.X.Y for CUDA ...". just choose the latest version
Click on "Local Installer for Ubuntu 20.04 x86_64"
Configure the installer to be available to the "apt" system
sudo dpkg -i cudnn-local-repo-ubuntu2004-*_1.0-1_amd64.deb
sudo apt update
Install CudaNN
sudo apt install libcudnn8=*-1+cuda${CUDA_VERSION}
sudo apt-get install libcudnn8-dev=*-1+cuda${CUDA_VERSION}
sudo apt-get install libcudnn8-samples=*-1+cuda${CUDA_VERSION}
Validate the install
cp /usr/src/cudnn_samples_v8/ $HOME -rfv
cd ~/cudnn_samples_v8/conv_sample
make clean
make -sj
./conv_sample