View a markdown version of this page

Migrate from Deadline 10 to AWS Deadline Cloud - Deadline Cloud

Migrate from Deadline 10 to AWS Deadline Cloud

A Deadline 10 farm consists of a repository file share, a MongoDB database, and worker hosts that select their own jobs. Pools and groups organize the farm, limits control shared resources, and event plugins and job scripts extend it. AWS Deadline Cloud (Deadline Cloud) has equivalents for most of these concepts, but several of them moved, changed names, or split into more focused features.

Use the tables on this page to find the Deadline Cloud equivalent of each Deadline 10 concept, then follow the link for details.

Some equivalents depend on the fleet type. With a service-managed fleet (SMF), Deadline Cloud provisions, scales, and operates the workers. With a customer-managed fleet (CMF), you operate the worker hosts—in the cloud or on premises—and the service schedules work to them. For more information, see Deadline Cloud fleets in the Deadline Cloud User Guide.

Farm components you no longer operate

Deadline Cloud replaces the server components of a Deadline 10 farm with a managed service. There is no repository file share to mount, no database to back up, and no maintenance server to run. Your farm's state lives in the service, and every application communicates with it through authenticated AWS API endpoints over TLS. If your pipeline is built around a shared file system, you can keep using it for application installs and production data—the service doesn't require one.

Deadline 10 component In Deadline Cloud

Repository (shared file system)

Nothing to operate. Job files move through job attachments in Amazon Simple Storage Service (Amazon S3). Job bundles and queue environments replace the plugins, scripts, and settings stored in the repository.

Database (MongoDB)

Nothing to operate. The service stores farm state, which you query through the Deadline Cloud API.

Remote Connection Server (RCS)

Nothing to operate. All clients connect to the service API endpoints using AWS Identity and Access Management (IAM) credentials over TLS.

Pulse (house cleaning, pending job scan)

The service performs scheduling and maintenance. On a CMF, you're responsible for worker host health. The CMF farm templates sample includes a health check template.

Worker application and Launcher

The Deadline Cloud worker agent. An SMF runs it for you; on a CMF you install it on your own hosts.

Monitor (desktop application)

The AWS Deadline Cloud monitor, available as a desktop application and in the browser.

deadlinecommand and the REST API

The deadline CLI, the Deadline Cloud API, and the AWS SDKs.

Map Deadline 10 concepts to Deadline Cloud

The following table maps the Deadline 10 concepts you use to organize and automate a farm to their Deadline Cloud equivalents.

Deadline 10 Deadline Cloud For more information

Pools and groups

Queue–fleet associations select which fleets serve a queue. Host requirements and fleet capabilities select workers within those fleets.

Route jobs to specific workers (pools and groups)

Job scheduling order (pool, priority, weighted, balanced)

Queue scheduling configurations: priority first-in-first-out, priority balanced, and weighted balanced.

Scheduling configurations

Limits (license limits, resource limits, machine limits)

Resource limits, acquired per task and associated with queues.

Create resource limits for jobs

Job dependencies and pending jobs

Step dependencies within a job. There is no built-in job-to-job dependency. To chain separate jobs, you build your own automation from Amazon EventBridge (EventBridge) events.

Step dependencies, Hooks, events, and integration points for jobs

Frame list and ChunkSize

Task parameter ranges and task chunking in the job template.

Task chunking for job templates

Auxiliary files

Job attachments, stored in an Amazon S3 bucket in your account.

Use job attachments to share files

Path mapping rules

Storage profiles describe each machine's file system locations, and the service derives path mapping rules from them.

Storage profiles and path mapping

Application installation (on each host or on shared file storage)

On an SMF, many applications are available as conda packages, and you can package your own. On a CMF, you typically install applications on each host or on shared file storage, as in Deadline 10.

Deploy and configure custom software on workers

Application plugins and job files

Open Job Description (OpenJD) job templates, packaged as job bundles. Application adaptors wrap interactive applications such as Maya and Nuke.

Open Job Description (OpenJD) templates for Deadline Cloud, adaptor runtime on GitHub

Integrated submitters

Deadline Cloud submitters for supported digital content creation (DCC) applications.

Supported software

Event plugins, and pre and post job and task scripts

Integration points: submitter hooks, queue environments, job and step environments, dependent steps, and EventBridge events.

Hooks, events, and integration points for jobs

AWS Portal

An SMF, which includes automatic scaling, usage-based licensing, and job attachments for asset transfer.

Configure and use Deadline Cloud service-managed fleets

Spot Event Plugin

An SMF scales automatically. If you need a CMF, use Amazon Elastic Compute Cloud (Amazon EC2) Auto Scaling driven by fleet size recommendation events.

Configure and use Deadline Cloud service-managed fleets, Create fleet infrastructure with an Amazon EC2 Auto Scaling group

Usage-based licensing (UBL) and the License Forwarder

Usage-based licensing, built into an SMF and available to a CMF through license endpoints.

Using software licenses with Deadline Cloud

User management, Power User mode, and Secrets Management

IAM policies, AWS IAM Identity Center users and groups, and per-resource access levels.

Security in Deadline Cloud

Farm statistics and reports

Amazon CloudWatch (CloudWatch) metrics and logs, and session data aggregation for usage queries.

Monitoring AWS Deadline Cloud, Querying session statistics aggregated data using the AWS CLI

Notifications (email, SQS)

No built-in user notifications. Deadline Cloud delivers EventBridge events to your account's event bus, and you build your own delivery, such as email through Amazon SNS.

Managing Deadline Cloud events using Amazon EventBridge

Idle workstation rendering

CMF workers running on workstations alongside your existing farm.

Extend your on-premises render farm to the cloud

Route jobs to specific workers (pools and groups)

In Deadline 10, you assign workers to pools and groups, and each job targets a pool and a group. Deadline Cloud splits those responsibilities between two resources:

  • Queues organize work and control access. A queue holds jobs, sets their scheduling order, and defines who can submit to it and view it. Use queues the way you used pools: to separate shows, departments, or clients.

  • Fleets and host requirements select workers. A fleet declares the capabilities that its workers guarantee: hardware minimums and custom attributes such as installed software or a site label. Each step in a job states its host requirements. The service routes the step to a compatible fleet associated with the queue. Use fleets and host requirements the way you used groups: to make sure work only runs on appropriately equipped machines.

To dedicate workers to sensitive work, such as content under a security or privacy restriction, create a separate fleet for those workers. Associate that fleet only with the queues that are allowed to use it. You don't need a separate queue for each worker partition—one queue can be associated with several fleets, and host requirements select between them.

For more information, see Determine fleet compatibility.

Features without a direct equivalent

Some Deadline 10 features don't have a named equivalent in Deadline Cloud. In most cases, you can express the same outcome with a job bundle:

  • Draft and Quick Draft – To encode rendered frames into a movie, add a dependent step that runs an encoding tool. For a worked example, see Encode a movie from another Deadline Cloud job's output with FFmpeg.

  • Jigsaw and tile rendering – Split a frame into tiles with a parameterized step and assemble the result in a dependent step. For a worked example, see Tile rendering on Deadline Cloud.

  • Power management – An SMF starts and stops workers automatically. On a CMF, you're responsible for starting and stopping worker hosts—by scaling your Amazon EC2 fleet in the cloud, or with your own tooling on premises.

Choose a starting point

Use the following guidance to choose where to start your migration: