“AI has the potential to revolutionise VFX” says Chaos’ Kam Star

Kam Star: Our mission is to develop intelligent, intuitive tools, bringing the power of machine learning to artists in ways that make sense and are most valuable to them.

First and foremost, we want to develop AI that removes drudge work and allows artists to focus on creativity. This means giving customers tools they haven’t seen before, as well as meaningful quality of life improvements in their day-to-day tasks. 

There are numerous tools that we have in-flight, many on Chaos Next, that we’re looking forward to showing. Another exciting function of the AI team is to explore the deeper questions that AI poses for our industry, such as how generative AI intersects with traditional rendering, and how to best empower artists on this AI journey.

KS: Our Text to PBR Materials AI models are trained on large datasets of high-quality, appropriately licensed materials and photographs. This ensures that the AI learns from the best examples and can generate realistic, diverse, and physically accurate materials based on textual descriptions.

The training process involves developing multimodal data (images/textures and associated text descriptions) machine learning models, including diffusion models and generative networks as well as rule-based systems. These models learn to generate realistic PBR material textures and maps based on the input textual prompts, while attempting to match the quality and characteristics of the manually created ground-truth examples.

KS: We envision our AI tools being used by a wide range of creators, from 3D artists at VFX studios rapidly generating photorealistic material variations for assets, to architects using voice commands to quickly populate building interiors with AI-placed furniture during conceptual design. 

Our focus is on empowering users to tackle mundane, laborious, or repetitive tasks more efficiently, while also inspiring creative exploration and expression. By integrating AI seamlessly into their workflows, we aim to help creators achieve more in less time, without sacrificing fine-grained control over the outcomes.

KS: The PBR Material Generator is being integrated via Chaos Cosmos, our powerful asset management system. Cosmos is already integrated with V-Ray, Vantage, and Corona, and will be integrated into Enscape later this year. This ensures that the AI-generated materials will be optimised and easily accessible across our entire product ecosystem.

KS: Absolutely. We have deliberately prioritised developing AI tools that produce content in parametric formats, such as 3D models and material definitions, which can be further edited and refined by artists. This approach ensures that our AI tools are more controllable, iterative, and adaptable to professional workflows, as opposed to tools that only output static, final pixel renders.

KS: AI is likely to significantly expand the hobbyist and consumer market by making 3D creation more accessible to untrained users. In the professional market, AI will be adopted more gradually to augment designer and artist workflows. 

For example, a VFX studio may use AI to handle mundane tasks like material creation or crowd simulation, freeing artists to focus on hero assets and creative direction, rather than replacing artists entirely. The openness to AI adoption may vary across sectors, depending on the specific needs and challenges faced by each industry.

KS: AI has the potential to revolutionise various stages of the VFX pipeline. It could automate laborious tasks like secondary asset creation, where AI generates varied background props from concept art, allowing artists to focus on primary hero models and storytelling. 

AI-driven character animation tools could provide high-quality first-pass results, comparable to motion capture. Lighting artists could leverage AI to suggest moods or automatically analyse footage and propose lighting setups for seamlessly matching CG elements into live-action plates.

KS: Indeed, AI denoising and upscaling solutions have been transforming the usability of path-traced rendering for over seven years now. These practical applications of AI are well-established across renderers and industries, and are not just accepted but expected. 

While they may receive less media attention compared to flashy generative image tools, they represent a significant way in which AI is already enhancing production workflows. It’s important to recognise and celebrate these “under the hood” AI innovations that are making a real impact on artists’ day-to-day work.

KS: At Chaos, our AI strategy is aligned with our core products and user needs, rather than chasing every new AI tool or research breakthrough. We prioritise AI features that output editable, reusable assets or massively simplify workflows, as these align with the needs of our professional user base and encourage deeper integration of AI into our existing ecosystem.

By focusing on solving specific challenges faced by our users, we can deliver targeted, impactful AI solutions that enhance their creative workflows.

KS: In the realm of filmmaking and VFX, AI should be aimed at addressing challenges related to asset creation, scene setup, lighting optimisation, and automating time-consuming tasks. The goal is to deliver faster iterations, more efficient pipelines, and greater creative flexibility. 

For instance, AI-powered set extension and background generation can save time and resources during pre-production and shooting, allowing filmmakers to focus on the core narrative and visual elements that drive the story forward.

KS: Yes! We are committed to seamlessly integrating AI capabilities across our entire product ecosystem, ensuring a consistent and unified user experience that enhances creative workflows. Our AI tools are designed to work harmoniously with our asset system, Cosmos, and our scattering tool, Scatter, allowing users to access and manipulate AI-generated content with ease and consistency across all of our products.

Consistency in access and user experience is crucial for the successful adoption of AI in creative workflows. Therefore prioritizing interconnectivity, editability, and ease of use, is how we see us empowering our users with AI tools that enhance their creativity and productivity, ultimately revolutionizing the way they bring their ideas to life.

KS: In the short term, AI is more likely to enhance artist workflows and automate repetitive tasks in filmmaking and VFX, rather than replace artists entirely. AI could take over laborious tasks like rotoscoping and compositing, but key creative decisions such as story development, character/creature design, and art direction are likely to remain in the hands of human experts. 

AI will be a powerful tool to augment and accelerate artist workflows, but it won’t completely replace the artistry, imagination, and director’s vision that define great filmmaking and VFX. However, in the longer term, the possibilities are endless. We may eventually see streaming, real-time storytelling AI that generates personalised, Hollywood-quality movie experiences without the need for artists at all. But for now, AI and human creativity will work hand in hand to push the boundaries of what’s possible in the world of digital storytelling.