Speaker
Description
Creating a DreamWorks Animation feature film involves millions of hours of compute time to render tens of thousands of images, each contributing to the frames that bring our stories to life. This colossal task demands the efficient management and scheduling of millions of jobs across thousands of compute servers.
In this talk, we'll dive into how DreamWorks Animation leverages HTCondor, a sophisticated open-source workload orchestration and scheduling system, to handle these massive workloads. We’ll also explore how other open-source technologies such as Grafana, InfluxDB, PostgreSQL, and Greenplum play a crucial role in monitoring and optimizing our large-scale workload processing. Learn how we consistently achieve over 95% utilization of our render farm, ensuring the efficient production of animated films.
Session author's bio
Mark Jackels is the Senior Director of Production Software at DreamWorks Animation. With a career spanning aerospace, automotive, and commercial industries, he joined DreamWorks in 2002, contributing to film franchises like Shrek, Kung Fu Panda, Madagascar, and How to Train Your Dragon. Mark leads teams focused on large-scale applications, distributed computing, data pipelines, and visualizations. Recently, he has driven efforts to integrate machine learning into film production, enhancing imaging techniques, quality, and workflow optimization.
| Level of Difficulty | Beginner |
|---|---|
| Social Media | LinkedIn: https://www.linkedin.com/in/markjackels/ |