Supported Devices, Chip Architectures, and Systems

Amazon SageMaker Neo supports the following devices, chip architectures, and operating systems.

Devices

You can select a device using the dropdown list in the Amazon SageMaker console or by specifying the TargetDevice in the output configuration of the CreateCompilationJob API.

You can choose from one of the following edge devices:

Device List	System on a Chip (SoC)	Operating System	Architecture	Accelerator	Compiler Options Example
aisage		Linux	ARM64	Mali
amba_cv2	CV2	Arch Linux	ARM64	cvflow
amba_cv22	CV22	Arch Linux	ARM64	cvflow
amba_cv25	CV25	Arch Linux	ARM64	cvflow
coreml		iOS, macOS			{"class_labels": "imagenet_labels_1000.txt"}
imx8qm	NXP imx8	Linux	ARM64
imx8mplus	i.MX 8M Plus	Linux	ARM64	NPU
jacinto_tda4vm	TDA4VM	Linux	ARM	TDA4VM
jetson_nano		Linux	ARM64	NVIDIA	{'gpu-code': 'sm_53', 'trt-ver': '5.0.6', 'cuda-ver': '10.0'} For TensorFlow2, {'JETPACK_VERSION': '4.6', 'gpu_code': 'sm_72'}
jetson_tx1		Linux	ARM64	NVIDIA	{'gpu-code': 'sm_53', 'trt-ver': '6.0.1', 'cuda-ver': '10.0'}
jetson_tx2		Linux	ARM64	NVIDIA	{'gpu-code': 'sm_62', 'trt-ver': '6.0.1', 'cuda-ver': '10.0'}
jetson_xavier		Linux	ARM64	NVIDIA	{'gpu-code': 'sm_72', 'trt-ver': '5.1.6', 'cuda-ver': '10.0'}
qcs605		Android	ARM64	Mali	{'ANDROID_PLATFORM': 27}
qcs603		Android	ARM64	Mali	{'ANDROID_PLATFORM': 27}
rasp3b	ARM A56	Linux	ARM_EABIHF		{'mattr': ['+neon']}
rasp4b	ARM A72
rk3288		Linux	ARM_EABIHF	Mali
rk3399		Linux	ARM64	Mali
sbe_c		Linux	x86_64		{'mcpu': 'core-avx2'}
sitara_am57x	AM57X	Linux	ARM64	EVE and/or C66x DSP
x86_win32		Windows 10	X86_32
x86_win64		Windows 10	X86_32

For more information about JSON key-value compiler options for each target device, see the CompilerOptions field in the OutputConfig API data type.

Systems and Chip Architectures

The following look-up tables provide information regarding available operating systems and architectures for Neo model compilation jobs.

Linux

	X86_64	X86	ARM64	ARM_EABIHF	ARM_EABI
No accelerator (CPU)	X		X	X	X
Nvidia GPU	X		X
Intel_Graphics	X
ARM Mali			X	X	X

Android

	X86_64	X86	ARM64	ARM_EABIHF	ARM_EABI
No accelerator (CPU)	X	X	X		X
Nvidia GPU
Intel_Graphics	X	X
ARM Mali			X		X

Windows

	X86_64	X86	ARM64	ARM_EABIHF	ARM_EABI
No accelerator (CPU)	X	X