Magics supported by AWS Glue Ray interactive sessions - AWS Glue

Magics supported by AWS Glue Ray interactive sessions

Magics for the AWS Glue Jupyter kernel when it powers Ray interactive sessions are similar to those for the Spark sessions. For reference, see Configuring AWS Glue interactive sessions for Jupyter and AWS Glue Studio notebooks .

Sessions magics

Sessions magics are mostly the same as prior to the AWS Glue for Ray preview. For more information about session magics outside of this preview, see Magics supported by AWS Glue interactive sessions for Jupyter. We introduce a new magic to set the session type to AWS Glue for Ray.

Name Type Description
%glue_ray String Changes the session type to AWS Glue for Ray.

AWS Glue config magics

Magics to configure AWS Glue in an interactive session may be different between session types. Currently, we only support this subset of existing magics when using AWS Glue for Ray.

Warning

Known Issue: additional_python_modules

In the Ray interactive sessions preview, use of the additional_python_modules magic will cause problems when saving your notebook. To configure python modules for Ray sessions, use the %%configure magic to set the pip-install parameter defined in Using job parameters in Ray jobs.

Name Type Description
%%configure Dictionary Specify a JSON-formatted dictionary consisting of all configuration parameters for a session. Each parameter can be specified here or through individual magics.
%iam_role String Specify an IAM role ARN to execute your session with. Default from ~/.aws/configure
%number_of_workers int The number of workers of a defined worker_type that are allocated when a job runs. worker_type must be set too.
%worker_type String In the AWS Glue for Ray preview, the only supported worker type is Z.2X.
%additional_python_modules List Comma separated list of additional Python modules to include in your cluster (can be from Pypi or S3).

Action magics

AWS Glue Ray sessions do not support any action magics.