AI Animal Explorer Extension
Overview
AI Animal Explorer is an Omniverse extension that enables creators to quickly prototype unique 3D animal meshes. This tool can help generate ideas for game or movie characters in real-time by allowing users quick access to a distribution of shapes for each part of the animal and direct control over their arrangement.
The animal creation process involves two stages. In the first stage, the user can explore different looks for each part of the animal (e.g. head, ears, etc) via sliders. These sliders interpolate through the latent space of diffusion probabilistic models which are capable of generating a diverse collection of point clouds for each animal part. The user can also scale, rotate and translate each animal part to place them in the desired location. A Deep Marching Tetrahedra (DMTet) model is used to synthesize a 3D mesh from the point cloud in the final stage or interactively during exploration to produce the final result.
Installation
AI Animal Explorer can be easily installed into an existing Omniverse application, such as Omniverse USD Composer , through the Extension Manager.
Important
AI Animal Explorer is compatible with Omniverse USD Composer
Bring up the Extension Manager by selecting Window->Extensions.
Search for “aitoybox”. Select the aitoybox.animal_explorer extension and click the Install button. (this may take a few minutes, depending on your connection speed)
Enable the extension by clicking on the toggle icon to bring up the Animal Explorer main window. (this may take a few minutes on the first launch, depending on your connection speed; and only a few seconds for further launches)
Using AI Animal Explorer
UI Overview

Ref # |
Option |
Result |
---|---|---|
1 |
Toggle Part |
Create animal part if enabled or delete part when disabled |
2 |
Part Slider |
Drag slider to explore different looks for the animal part |
3 |
Input Part Slider Value |
Type in a value for the part slider or drag to increase or decrease the value |
4 |
Preview Mesh |
Generates mesh from point cloud |
5 |
Discard |
Discard point cloud and preview mesh created and start over |
6 |
Bake Mesh |
Saves generated mesh to new layer in “/World/Animals/ID<uuid>” and discards point cloud |
Applying Transforms
After selecting an animal part, use the Move, Rotate, and Scale tools in the ToolBar to apply transformations. The ears and legs are mirrored on the Y-Z plane when either the left or the right part is moved. These parts also maintain the same scale but can be rotated independently.
Supporting Research
This extension is made possible by the works Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis by Tianchang Shen, Jun Gao, Kangxue Yin, Ming-Yu Liu, Sanja Fidler, Diffusion Probabilistic Models for 3D Point Cloud Generation by Shitong Luo, Wei Hu, and 3DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variations by Kangxue Yin, Jun Gao, Maria Shugrina, Sameh Khamis, Sanja Fidler
Release Notes
1.0.2-beta
Patch for extension window toggle via AI Toybox menu
Compatible with Omniverse Create >= 2022.3.0
1.0.1-beta
Compatible with Omniverse Create >= 2022.3.0
1.0.0-beta
Compatible with Omniverse Create >= 2021.1.1 and <= 2022.2.2