AWS Deep Learning ARM64 AMI OSS GPU PyTorch 2.8 (Ubuntu 24.04)

For help getting started, see Getting started with DLAMI.

AMI name format

• Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.8 (Ubuntu 24.04) ${YYYY-MM-DD}

Supported EC2 instances

• G5g

The AMI includes the following:

• Supported AWS Service: Amazon EC2

• Operating System: Ubuntu 24.04

• Compute Architecture: ARM64

• Linux Kernel: 6.14

• NVIDIA Driver: 570.172.08

• NVIDIA CUDA 12.9 stack:

  • CUDA, NCCL and cuDDN installation directories: /usr/local/cuda-12.9/

  • Default CUDA: 12.9

    • PATH /usr/local/cuda points to CUDA 12.9

    • Updated below env vars:

      • LD_LIBRARY_PATH to have /usr/local/cuda/lib:/usr/local/cuda/lib64:/usr/local/cuda:/usr/local/cuda/targets/sbsa-linux/lib

      • PATH to have /usr/local/cuda/bin/:/usr/local/cuda/include/

• AWS CLI v2 at /usr/local/bin/aws

• EBS volume type: gp3

• Nvidia container toolkit: 1.17.8

  • Version command: nvidia-container-cli -V

• Docker: 28.4.0

• Python: /opt/pytorch/bin/python

• Query AMI-ID with SSM Parameter (example region is us-east-1):

  SSM_PARAMETER="oss-nvidia-driver-gpu-pytorch-2.8-ubuntu-24.04/latest/ami-id" && \
  aws ssm get-parameter \
      --region us-east-1 \
      --name "/aws/service/deeplearning/ami/arm64/${SSM_PARAMETER}" \
      --query "Parameter.Value" \
      --output text

• Query AMI-ID with AWSCLI (example region is us-east-1):

  aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.8 (Ubuntu 24.04) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text

Notices

PyTorch Deprecation of Anaconda Channel

Starting with PyTorch 2.6, PyTorch has deprecated support for Conda (see official announcement). As a result, PyTorch 2.6 and above will move to using Python Virtual Environments. To activate the PyTorch venv, please use source /opt/pytorch/bin/activate

Release Date: 2025-09-12

AMI name: Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.8 (Ubuntu 24.04) 20250912

Added

• Initial release of Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.8 (Ubuntu 24.04) series. Including a Python virtual environment pytorch (source /opt/pytorch/bin/activate) complimented with NVIDIA Driver R570, CUDA=12.9, cuDNN=9.10, and PyTorch NCCL=2.27.3