Game development platform Unity has made a major move in the race toward photorealistic next-gen graphics by buying Weta Digital, Peter Jackson’s visual effects house that has worked on everything from the Lord of the Rings Trilogy, to Avatar, Planet of the Apes, and The Suicide Squad. This $1.65 billion purchase isn’t just about adding to Unity’s portfolio of businesses – the plan is to take Weta Digital’s groundbreaking tools and give them to all Unity developers, making movie-quality visuals and effects possible. You can check out a quick video announcing Unity’s acquisition of Weta, below.
Weta founder Peter Jackson had the following to say about the deal with Unity…
Weta Digital’s tools created unlimited possibilities for us to bring to life the worlds and creatures that originally lived in our imaginations. Together, Unity and Weta Digital can create a pathway for any artist, from any industry, to be able to leverage these incredibly creative and powerful tools. Offering aspiring creatives access to Weta Digital’s technology will be nothing short of game changing, and Unity is just the company to bring this vision to life.
So, what kind of fancy new toys will Unity devs be getting once Weta tools start to be added to the platform? Here’s a taste…
- Manuka: Manuka is the flagship path-tracing renderer used to generate final frames and is able to produce physically accurate results based upon specific spectral lighting profiles.
- Gazebo: Gazebo is the core interactive renderer used for viewing scenes in real time with visual fidelity inside any pipeline attached application. Since the Gazebo real-time rendering of the 3D viewport approaches the same results from Manuka, artists can iterate in context of the final frame regardless of which application they use. Gazebo is also the core of the production pipeline for pre-visualization and virtual production workflows.
- Loki: Loki provides physics-based simulation of visual effects including water, fire, smoke, hair, cloth, muscles, and plants. Physical accuracy for complex simulations is delivered through the use of cross-domain coupling and high-accuracy numerical solvers.
- Physically-based workflows: Tools including PhysLight, PhysCam, and HDRConvert provide the foundation for lighting and color workflows. Using these tools, artists can create spectral-based lighting and accurately replicate effects of different lenses, sensors, and other parts of the pipeline, resulting in a physically accurate rendering workflow for both Gazebo and Manuka.
- Koru: Koru is an advanced puppet rigging system optimized for speed and multi-character performance. Using Koru, technical directors and developers can create constraints, rigs, deformers, and puppets to support high-performance animation, cloth simulation, and similar applications.
- Facial Tech: Facial Tech provides advanced facial capture and manipulation workflows, using machine learning to support direct manipulation of facial muscles and transferring actor face capture onto a target (puppet) model.
- Barbershop: Barbershop is a suite of tools for hair and fur that supports the entire workflow from growth through grooming. Artists can use a combination of procedural and artist-guided tools to grow hair and fur, adjust growth patterns, and groom the final model. Advanced procedural tools support concepts such as braided hair, and the resulting models are simulation-ready to provide realistic dynamics resulting from motion and wind.
- Tissue: Tissue enables artists and animators to create biologically accurate anatomical character models that accurately represent behaviors of muscle and skin, and transfer the resulting characters into simulation tools.
- Apteryx: Apteryx provides artists with a complete workflow starting with procedural generation of feathers, hand sculpting, and grooming for animated feathered creatures and costumes.
- World Building: These tools include Scenic Designer and Citybuilder to support world building, layout, and set dressing ranging from planet-scale to small-scale scenes. With these tools, artists can procedurally create scenes with node graphs, place content programmatically, and manually adjust placement.
- Lumberjack: Lumberjack provides the core toolset for vegetation and includes modeling, editing, and deformation tools. Using Lumberjack, artists can author and edit plant topology including animated geometry, manage levels of detail, instancing, and variability among individual assets.
- Totara: Totara is a procedural growth and simulation system for vegetation and biomes that integrates with Lumberjack to create large-scale and complex scenes procedurally. Using Totara, artists can grow individual trees and entire forest biomes, grow other vegetation such as vines, adjust growth parameters and control biomechanics, add snow cover, and reduce the complexity and size of scenes.
- Eddy: Eddy is an advanced liquid, smoke and fire compositing plug-in for refining volumetric effects. Eddy allows artists to generate new, high-quality fluid simulations and render them directly inside their compositing environment.
- Production Review: HiDef and ShotSub are the foundation for production review. HiDef is a core tool for production review, with features for note taking, version browsing, and more, integrated with a color-accurate browser and playback engine. ShotSub is a core tool for production review, with tools to prepare artist work for review with the appropriate color space, frame ranges, and settings for frame rate and resolution.
- Live Viewing: Live viewing tools support the mixing of computer-generated (CG) content in real-time with on-set camera feeds. These tools support live mixing for on-set viewing, live compositing of CG elements onto chromakey or other CG elements, depth-based live compositing and projection of face capture onto a motion capture puppet.
- Projector: Projector is a production tool supporting scheduling, resourcing, and prediction, with controls for data access and analytics to improve production decision-making.