Leveraging the Deadline Spot Event Plugin to Address Rendering Requirements
VFX and animation studios are regularly faced with the challenge of shrinking budgets and a limited on-prem capacity unable to accommodate peak rendering requirements at the tail end of projects. Leveraging cloud-based render farms allow studios to address both these challenges simultaneously by scaling rapidly and cost-effectively.
This article discusses the process of leveraging Amazon EC2 Spot Instances with the Deadline Spot Event Plugin to address rendering requirements in a cost-effective manner.
Amazon EC2 Spot and Spot Instances
Amazon EC2 Spot Instances allow users to take immediate advantage of unused EC2 capacity in the AWS cloud. Spot Instances are available for less than the on-demand price by enabling companies to request unused EC2 instances as they become available. These steep discounts can lower the overall Amazon EC2 costs significantly.
The hourly price for a Spot Instance is called the ‘Spot price’. The Spot price of each instance type in each Availability Zone is set by Amazon EC2 and is gradually adjusted based on the long-term supply and demand for Spot Instances. These Spot Instances run whenever capacity is available and can be a cost-effective choice for users who have some flexibility on the availability of applications and can tolerate possible interruption.
Thinkbox Deadline and using Spot Instances for Render Farms
AWS Thinkbox Deadline is a hassle-free hybrid administration and compute management software for Windows, Linux, and Mac OS-based render farms that supports more than 80 different content creation applications.
To take advantage of Spot instances on the cloud, the Spot Plugin was created. It seamlessly manages the creation, allocation, and deletion of dynamic nodes in the cloud. The Spot Plugin is used in the following 3 situations:
- Bursting render farms: Ideal for projects involving high workloads where there are limited on-premise nodes available. For example, assume a job has been started containing 16 frames but only 8 on-premise nodes are available. It is possible through the use of grouping and pooling to create the missing nodes on AWS.
- Special projects in which users want to leave on-premise nodes available: Users can group projects to render only with nodes triggered by the Spot Plugin. When the project is submitted nodes are created. After the completion of the project, these nodes are deleted without manual intervention.
- Full cloud pipeline: If users prefer to do all rendering in the cloud, the most cost-effective method for allocating nodes will be to use the Spot Plugin.
Using tools available in Deadline such as Spot Plugin, Groups, and Pools, studios can seamlessly address their rendering needs in a transparent and cost-effective manner.
TrackIt has recently published a detailed Tutorial on Using Deadline Spot to Burst Render Farms. The tutorial focused solely on the first scenario that applies to the majority of creative studios – Burst Render Farms that cost-effectively meet rendering requirements while reducing dependency on-premise hardware.
Using AWS Thinkbox Deadline, VFX and animation studios can realize significant cost savings while also achieving ideal project completion speeds with minimum hiccups and almost unlimited scalability. Studios looking for assistance in implementing Deadline Spot Instances can seek the expertise of a trusted AWS Advanced Tier Services Partner like TrackIt to maximize efficiency.
TrackIt is an Amazon Web Services Advanced Consulting Partner specializing in cloud management, consulting, and software development solutions based in Marina del Rey, CA.
TrackIt specializes in Modern Software Development, DevOps, Infrastructure-As-Code, Serverless, CI/CD, and Containerization with specialized expertise in Media & Entertainment workflows, High-Performance Computing environments, and data storage.
TrackIt’s forté is cutting-edge software design with deep expertise in containerization, serverless architectures, and innovative pipeline development. The TrackIt team can help you architect, design, build and deploy a customized solution tailored to your exact requirements.
In addition to providing cloud management, consulting, and modern software development services, TrackIt also provides an open-source AWS cost management tool that allows users to optimize their costs and resources on AWS.