Supported Devices, Chip Architectures, and Systems - Amazon SageMaker

Supported Devices, Chip Architectures, and Systems

Amazon SageMaker Neo supports the following devices, chip architectures, and operating systems.

Devices

You can select a device using the dropdown list in the Amazon SageMaker console or by specifying the TargetDevice in the output configuration of the CreateCompilationJob API.

You can choose from one of the following edge devices:

Device List System on a Chip (SoC) Operating System Architecture Accelerator Compiler Options Example
aisage Linux ARM64 Mali
amba_cv22 CV22 Arch Linux ARM64 cvflow
amba_cv25 CV25 Arch Linux ARM64 cvflow
coreml iOS, macOS {"class_labels": "imagenet_labels_1000.txt"}
deeplens Intel Atom Linux X86_64 Intel Graphics
imx8qm NXP imx8 Linux ARM64
imx8mplus i.MX 8M Plus Linux ARM64 NPU
jacinto_tda4vm TDA4VM Linux ARM TDA4VM
jetson_nano Linux ARM64 NVIDIA {'gpu-code': 'sm_53', 'trt-ver': '5.0.6', 'cuda-ver': '10.0'}
jetson_tx1 Linux ARM64 NVIDIA {'gpu-code': 'sm_53', 'trt-ver': '6.0.1', 'cuda-ver': '10.0'}
jetson_tx2 Linux ARM64 NVIDIA {'gpu-code': 'sm_62', 'trt-ver': '6.0.1', 'cuda-ver': '10.0'}
jetson_xavier Linux ARM64 NVIDIA {'gpu-code': 'sm_72', 'trt-ver': '5.1.6', 'cuda-ver': '10.0'}
qcs605 Android ARM64 Mali {'ANDROID_PLATFORM': 27}
qcs603 Android ARM64 Mali {'ANDROID_PLATFORM': 27}
rasp3b ARM A56 Linux ARM_EABIHF {'mattr': ['+neon']}
rasp4 ARM A72
rk3288 Linux ARM_EABIHF Mali
rk3399 Linux ARM64 Mali
sbe_c Linux x86_64 {'mcpu': 'core-avx2'}
sitara_am57x AM57X Linux ARM64 EVE and/or C66x DSP
x86_win32 Windows 10 X86_32
x86_win64 Windows 10 X86_32

For more information about JSON key-value compiler options for each target device, see the CompilerOptions field in the OutputConfig API data type.

Systems and Chip Architectures

The following look-up tables provide information regarding available operating systems and architectures for Neo model compilation jobs.

Linux
X86_64 X86 ARM64 ARM_EABIHF ARM_EABI
No accelerator (CPU) X X X X
Nvidia GPU X X
Intel_Graphics X
ARM Mali X X X
Android
X86_64 X86 ARM64 ARM_EABIHF ARM_EABI
No accelerator (CPU) X X X X
Nvidia GPU
Intel_Graphics X X
ARM Mali X X
Windows
X86_64 X86 ARM64 ARM_EABIHF ARM_EABI
No accelerator (CPU) X X