Supported Devices, Chip Architectures, and Systems
Amazon SageMaker Neo supports the following devices, chip architectures, and operating systems.
Devices
You can select a device using the dropdown list in the Amazon SageMaker consoleTargetDevice
in the output configuration of the
CreateCompilationJob
API.
You can choose from one of the following edge devices:
Device List | System on a Chip (SoC) | Operating System | Architecture | Accelerator | Compiler Options Example |
---|---|---|---|---|---|
aisage | Linux | ARM64 | Mali | ||
amba_cv2 | CV2 | Arch Linux | ARM64 | cvflow | |
amba_cv22 | CV22 | Arch Linux | ARM64 | cvflow | |
amba_cv25 | CV25 | Arch Linux | ARM64 | cvflow | |
coreml | iOS, macOS | {"class_labels": "imagenet_labels_1000.txt"} |
|||
deeplens | Intel Atom | Linux | X86_64 | Intel Graphics | |
imx8qm | NXP imx8 | Linux | ARM64 | ||
imx8mplus | i.MX 8M Plus | Linux | ARM64 | NPU | |
jacinto_tda4vm | TDA4VM | Linux | ARM | TDA4VM | |
jetson_nano | Linux | ARM64 | NVIDIA | {'gpu-code': 'sm_53', 'trt-ver': '5.0.6', 'cuda-ver':
'10.0'} For |
|
jetson_tx1 | Linux | ARM64 | NVIDIA | {'gpu-code': 'sm_53', 'trt-ver': '6.0.1', 'cuda-ver': '10.0'} |
|
jetson_tx2 | Linux | ARM64 | NVIDIA | {'gpu-code': 'sm_62', 'trt-ver': '6.0.1', 'cuda-ver': '10.0'} |
|
jetson_xavier | Linux | ARM64 | NVIDIA | {'gpu-code': 'sm_72', 'trt-ver': '5.1.6', 'cuda-ver': '10.0'} |
|
qcs605 | Android | ARM64 | Mali | {'ANDROID_PLATFORM': 27} |
|
qcs603 | Android | ARM64 | Mali | {'ANDROID_PLATFORM': 27} |
|
rasp3b | ARM A56 | Linux | ARM_EABIHF | {'mattr': ['+neon']} |
|
rasp4b | ARM A72 | ||||
rk3288 | Linux | ARM_EABIHF | Mali | ||
rk3399 | Linux | ARM64 | Mali | ||
sbe_c | Linux | x86_64 | {'mcpu': 'core-avx2'} |
||
sitara_am57x | AM57X | Linux | ARM64 | EVE and/or C66x DSP | |
x86_win32 | Windows 10 | X86_32 | |||
x86_win64 | Windows 10 | X86_32 |
For more information about JSON key-value compiler options for
each target device, see the CompilerOptions
field in the OutputConfig
API data type.
Systems and Chip Architectures
The following look-up tables provide information regarding available operating systems and architectures for Neo model compilation jobs.