Deadline Cloud queues

A queue is a farm resource that manages and processes jobs.

To work with queues, you should already have a monitor and farm set up.

Create a queue

1. From the Deadline Cloud console, dashboard, select the farm that you want to create a queue for.

   1. Alternatively, in the left side panel choose Farms and other resources, then select the farm you want to create a queue for.

2. In the Queues tab, choose Create queue.

3. Enter a Name for your queue.

4. For Description, enter the queue description. A clear description can help you quickly identify your queue's purpose.

5. For Job attachments, you can either create a new Amazon S3 bucket or choose an existing Amazon S3 bucket.

   1. To create a new Amazon S3 bucket

      1. Select Create new job bucket.

      2. Enter a name for the bucket. We recommend naming the bucket deadlinecloud-job-attachments-[MONITORNAME].

      3. Enter a Root prefix to define or change your queue's root location.

   2. To choose an existing Amazon S3 bucket

      1. Select Choose an existing S3 bucket > Browse S3.

      2. Select the Amazon S3 bucket you want to use for your queue from the list of available buckets.

6. (Optional) To associate your queue with a customer-managed fleet, select Enable association with customer-managed fleets.

7. If you enable association with customer-managed fleets, you need to complete the following steps.

   Important

   We strongly recommend specifying users and groups for run-as functionality. If you bypass it, it will degrade your farm’s security posture because the jobs can then do everything the worker's agent can do. For more information about the potential security risks, see Run jobs as users and groups.

   1. For Run as user:

      To provide credentials for the queue's jobs, select Queue-configured user.

      Or, to opt out of setting your own credentials and run jobs as the worker agent user, select Worker agent user.

   2. (Optional) For Run as user credentials, enter a user name and group name to provide credentials for the queue's jobs.

8. Requiring a budget can help you manage costs for your queue. Select either Don't require a budget or Require a budget based on your prefence.

9. Your queue requires permission to access Amazon S3 on your behalf. You can create a new service role or use an existing service role. If you don't have an existing service role, create and use a new service role.

   1. To use an existing service role, select Choose a service role, and then select a role from the dropdown.

   2. To create a new service role, select Create and use a new service role, and then enter a Role name and Description.

10. (Optional) To add environment variables for the queue environment, choose Add new environment variable, and then enter a Name and Value for each variable you add.

11. (Optional) Choose Add new tag to add one or more tags to your queue.

12. To create a default Conda queue environment, keep the checkbox selected. To learn more about queue environments, see Create a queue environment.

13. Choose Create queue. After creation, your queue displays.

Create a queue environment

With queue environments you can add environments or execute commands on workers in specific queues. You can add queue environments using a simple form, or by editing the json or YAML data directly. This procedure describes how to create an environment with a form.

1. To add a queue environment to a queue, navigate to the queue and select the Queue environments tab.

2. Choose Actions > Create new with form. The create queue environment page displays.

3. Enter a Name and Description for the queue environment.

4. Choose Add new environment variable, and then enter a Name and Value for each variable you add.

5. (Optional) Enter a Priority for the queue environment. The priority indicates the order that this queue environment will run on the worker. Higher priority queue environments will run first.

6. Choose Create queue environment. After creation, your queue environment displays in the queue.

Delete a queue

Warning

You can't recover the jobs in a queue if you delete the queue. Deleting the queue also deletes the jobs in that queue.

1. From the Deadline Cloud dashboard, choose Farms and other resources.

2. In the farms list, select the farm that contains the queue you want to delete.

3. Select the queue, and then choose Delete.

4. In the confirmation window, choose Delete. Your queue and all of the jobs in the queue are deleted and your farm displays.

Edit a queue

1. From the Deadline Cloud dashboard, choose Farms and other resources.

2. In the farms list, select the farm that contains the queue you want to edit.

3. Select the queue, and then choose Edit.

4. You can edit the name, description, budget requirement, Run as user option, and assigned service role. You can also associate an existing fleet with your queue.

5. Choose Save changes. Your edited queue displays.

Associate a queue and fleet

1. Select the Queue you want to work to associate with a fleet.

2. To select a fleet to associate with your queue, choose Associate fleets. The Associate fleets window displays.

3. Select the Select fleets dropdown. A list of available fleets displays.

4. From the list of available fleets, select the checkbox next to the fleet or fleets you want to associate with your queue .

5. Choose Associate. The Associate fleets window closes. The Fleet association status should now be Associated.