Above: Filmmakers used Unity to create Baymax Dreams.
Image Credit: Unity
Unity Technologies has been known among developers as the maker of a “game engine” since the tool debuted in 2005. But these days, “creation engine” might be a better name for it.
That’s because experiences created with Unity are more often than not films, interactive movies, advertisements, or augmented reality and virtual reality content. The game engine has grown up beyond games, and it is being used to expand the definition of entertainment, according to Isabelle Riva, head of the Made with Unity developer program at the San Francisco-based company.
In advance of the Siggraph computer graphics show in Vancouver, Canada, I spoke with Riva. Disney Television Animation said last week it is making the Baymax Dreams series, a trio of short films in the Big Hero 6 world, as an animated series using the Unity engine. You can see various films embedded in this post that were all built using Unity. These short films have become showcases for how Unity will not only democratize games with universally accessible tools. It will also democratize film, Riva said.
Here’s an edited transcript of our interview.
,
,
Above: Isabelle Riva is head of Made with Unity.
Image Credit: Unity
GamesBeat: I saw the four films that were attached. The Baymax one is the only Disney one. Is that right?
Isabelle Riva: Right. It’s a partnership with the Big Hero 6 TV series. Disney produced those shorts, the Baymax Dreams, with Unity’s support. Also, if you saw, Disney is releasing their first VR film, Cycles, which will be at Siggraph 2018. That project was made in Unity by Disney. Those were our most recent Disney partnerships.
GamesBeat: Unity-made films are catching some momentum, then?
Riva: Absolutely. These projects validate what people have been working toward for many years, which is having a real-time render engine as part of a mainstream animation pipeline — for all the benefits it brings. It’s definitely catching on now.
GamesBeat: What’s the common thread among the films and newer projects here, as far as how they’re using Unity?
Riva: The Big Hero 6 episodes were created differently than the ones that Neill Blomkamp did with ADAM. These were entirely made in Unity. We had the benefit of this amazing direct link to Autodesk, who produces the Maya software used for keyframing animation. All of Disney’s animation is keyframed in Maya. Apart from that, everything else is made in Unity. We have this connection between animation and engine going, which is really efficient.
We got rid of storyboards. We went straight from scripts into pre-vis. Once all the assets and modeling and texturing were done, once the characters were in there, the director was able to play and decide where the camera goes, what time of day it is. All those changes could be made in real time. It was very empowering as a pipeline for the storytellers.
The director would call for performances from the animators and say, “Hey, can you do one of these but with that goofy squeaking around on the top of a fence?” The animators could provide a performance, and it would appear directly in Unity. Then, the director could set their cameras up, almost as if they were right there on set. That’s how it evolved. It was kind of like game development, where you start rough with pre-vis and gray boxes, and the more you go, the more it becomes refined and polished, the closer you get to your target.
It was a very non-linear way to make an animated story. The well was set continually by all of the departments, including lighting and everything. It was instant compositing. Normally, the director would be in an edit suite, making judgment calls on timing and camera positions. Now, they can change the character’s color, the lights, everything in real time. That really shrunk our team. It sped up our production time. We basically got a new work flow into a steady state. Disney was very pleased.
,
,
GamesBeat: That ability to work concurrently, I assume you could do that remotely as well? Has that been around for a while, or is that relatively recent?
Riva: Game development has been doing that for a long time because people are able to share a build and work in that same build. That technology is at play here. For animators and filmmakers, it’s newer. The team that Disney put together with our help was distributed from Montreal to Singapore, across many time zones, and they all worked together from their respective cities on the same project.
GamesBeat: I remember that was part of MaxPlay’s pitch from a few years ago, that you could work concurrently in the same file with somebody else.
Riva: Right. That’s definitely happening now but across the whole pipeline. It’s not just between two animators in Max. It’s happening between lighters and animators and editors and music and sound.
GamesBeat: Are you going to show a lot of stuff at Siggraph? What do you have lined up?
Riva: We have some great talks at Siggraph. It’s really exciting. Two of the three episodes are in the can and approved for broadcast, so we’re using those at Siggraph to demonstrate what we learned through the whole experience with Disney. One of the talks is almost an unplugged kind of demonstration, where the director is going to take a scene from one of the episodes in Unity, and they’re going to completely change the scene into another story using the same elements within minutes. That will show the audience, live, just how powerful the engine is.
We have another talk dedicated to tooling, which explains how we were able to do this concurrent, parallel work and roundtrip with Maya and Autodesk really well. We have a talk that focuses more on the lighting and effects we were able to achieve in-engine for the animated episodes. It looks like film quality, beyond broadcast. That’s really exciting to show as well because for animators, especially episodic producers who are making really high-volume animation, changing the color of a character’s costume on the fly is really useful when you want to have asset re-use from episode to episode. You can do that in Unity.
GamesBeat: The Book of the Dead. I recall you showed that at GDC. Was there something new in the latest trailer?
Riva: The Book of the Dead is going to make an appearance at Real Time Live at Siggraph. It’s being used by the team at MPC, Motion Picture Company, who are showing their virtual production tools that are built on Unity. We also have ADAM 2, the Blomkamp ADAM 2. That’ll be at Real Time Live as well. We got into the Electric Theater animation festival with ADAM 2.
We have some other films, like Sunder, which is a gorgeous short film made by an animator at Pixar. We have a lot of episodes coming from France that were built with Unity. Of course, we all know Monsieur Carton. That will be on display at the booth.
GamesBeat: If you made a comparison to past years at Siggraph, what would you say is new? Is there a lot more presence for Unity films?
Riva: There’s absolutely more presence. We’re humbled to be participating at the table with so many brilliant engineers and artists who’ve been preaching the real-time gospel for years now. We feel we bring some contributions this year. We’ve been able to get a real-time workflow into a steady state for animated series with Disney. We want to share a lot of that knowledge with the community. Our relationship with Autodesk will benefit everyone, and we’re excited to celebrate that as well.
,
,
GamesBeat: How far are we from something like a Pixar feature, a two-hour animated film in theaters, made with Unity?
Riva: [Laughs] If it were up to me, I’d love to see it next week. I can’t say more about what’s in the works right now. It’s definitely coming, though. We’re excited to be part of some of those groundbreaking projects. We definitely want to see that in the future.
GamesBeat: Anything else you’d like to call out while we have the chance?
Riva: We’re well positioned to fuel the next generation of filmmakers. Our scriptable render pipeline allows for the kind of control filmmakers need. Our graphics aren’t even in question. The graphics are inspiring people who come from feature animation to produce with our engine. The performance is great. The creativity that comes from the tools and working together makes filmmaking more fun. We have something great here to contribute to the community, and we’re very excited to share some of that at Siggraph.
The Baymax shorts, actually, are going to be premiering on YouTube on September 15. There’s more information to come around that as well.
Source: Venture Beat