Character Creator

Overview

Reallusion’s Character Creator Omniverse Connector is a plugin for transferring digital humans and motions from Character Creator to an NVIDIA Omniverse Nucleus Server. Character Creator and Omniverse in combination help a variety of industries such as AEC, M&E, Video Games, to access and deploy characters as task performers, virtual hosts or citizens for simulations and visualizations.

For further information, demos, downloads and video tutorials for Character Creator and Omniverse, please visit Reallusion Website

User Manual

Getting Started

The Character Creator Omniverse Connector allows users to export characters, accessories, motions, and materials to USD and MDL. The file structure is well-organized, which allows users to easily replace content during collaboration. Please check the following videos to see how to generate a character from Character Creator, and import animated character USD to Omniverse Create.

Getting Started Part 1

Generating Characters with Character Creator

Getting Started Part 2

Importing Animated Character USD to Omniverse Create.

Installation Instructions

Please see Online Manual for Character Creator and Omniverse Installation for setup instructions.

Usage Instructions

If you need further information or have any questions regarding the installation or use of Character Creator, please first visit Reallusion’s Forum.

File Update with Live Sync

For Character Creator 3.41, users who wish to render on the Omniverse Create will first need to export character and motion USD files to a designated folder, and load them into Omniverse Create.

This version of Omniverse Create can only Live-Sync updated files. In order to achieve live updates, the character will first need to be exported in USD format, then activate the Live-Sync capability in Omniverse Create. Automatic updates will be triggered every time the file is overwritten (also works with textures).

Live Sync real-time automatic updates is a feature that is slated for release in a later version.

Release Notes

4.0

General

  • Support for Character Creator 4.

Material & Texture

  • Reflection Surface shader sent from iClone and Character Creator to Omniverse will map corresponding textures.

Note

The Roughness map is assigned to the Albedo texture channel, only Opacity and Roughness maps are sent.

Camera

  • Camera Exposure (Activate) settings in iClone and Character Creator are now sent to Omniverse Create/Machinima (Render Settings > Post Processing > Auto Exposure)

Note

Only the activation settings are sent without mapping other parameters (default values used).

Export

  • Props¹ and related animations² can be exported to Omniverse.

  • New Export: All, Character, and Selected options are added to the Export USD panel.

  • Activating Turntable from the Modify panel within the Scene Manager creates camera animation that is exportable to Omniverse.

¹ Spring effects and rigid bodies are baked into keyframe animations. Once they are brought into Omniverse their physics settings can not be adjusted.

² Animations do not include keys for visibility, material, and sound.

3.44

General

  • Added:

    • Added support for Character Creator 3.44

    • Support for Export USD (Omniverse) > Send to Server which sends the current file directly to Omniverse Nucleus Server.

    • 60, 30, and 24 fps options are available for Export USD > Export Range > Motion FPS.

    • Export USD > Post Effects offers several basic presets, which can be further adjusted under Create > Render Settings > Post Processing.

    • Export USD > Export Current Frame as Static Mesh for Refinement is provided to convert bone-skinned content to static meshes for subdivision in Omniverse (the bones will be removed).

  • Enhanced:

    • The export will output the main USD file along with other dependencies, such as a light, material, and motion folders, which will contain the associated MDL materials and textures.

Export

  • Enhanced:

    • Character related animations will also export to Omniverse, including the following data sets:

      • Transforms, Motion Clips (supported in v3.41).

      • Expressions, Visemes¹ (enhanced in v3.44).

      • MotionPlus data with Accessory animation exported from iClone (enhanced in v3.44) .

      • Spring Effects² and Physics Rigidbodies² (enhanced in v3.44) .

        ¹. Does not include Viseme Voices.

        ². Spring Effects and Rigidbodies are baked into keyframe animations. Once they are brought into Omniverse their physics settings can not be adjusted.

        ³. Does not include visibility keys, material animations, and sound.

Material & Texture

  • Enhanced:

    • PBR, Digital Human*, and SSS shaders sent to Omniverse from iClone and Character Creator will map corresponding textures and material attributes accordingly.

      • Digital Human Shaders include Skin, Head, Teeth, Tearline, and Eye Occlusion.

      Note

      Omniverse Digital Human and SSS shaders only support RTX Path-Traced mode at this time. Export USD (Omniverse) > Material Render Mode must be set to RTX Path-Traced for materials to map correctly to Omni-DH and Omni_SSS shaders. If Realtime Mode is selected, then every material will map to Omni-PBR shaders.

      Note

      When a Digital Human character with SSS shader is exported in RTX Path Traced mode into Omniverse and the render mode is changed to RTX Real-time within Omniverse, then the SSS shader will not take effect and the Digital Human’s material will change to pure white or pure black without any of the original material attributes and details.

      Note

      White lines can appear when Shader > Subsurface Weight is set too high, or when an improper SSS map is used, such as a solid white texture.

IBL (Image Based Lighting)

  • Fixed:

    • Inconsistent translations and rotations with IBLs sent to Omniverse.

3.43

General

  • Added support for Character Creator v3.43

Export

  • Added output option “Include Omniverse Audio2Face Mesh”: Exported characters containing only face meshes can take advantage of AudiotoFace > Character Transfer > Mesh Fitting Preset, without the need to set up corresponding points on individual meshes.

  • Exported characters with teeth, tongue, and dummy objects can perform full talking animations by using Machinima’s Pin Constraint and Create Wraptools. Pin Constraints can tie the teeth to the mouth motions, while Create Wrap can reapply the animations back to the entire character.

    Note

    This entire workflow requires the Machinima 2021.2.

Fixed

  • CC crashes while exporting a character with clashing mesh names (i.e. clothing, accessories, etc. with the same name) in USD format. Please find details on Reallusion’s Feedback Tracker .

Initial Release

General

  • Added support for Menu > Plugin > Omniverse > Export USD.

  • Added support for Export USD (Omniverse) in File > Export menu.

  • Added support for Export USD in the Toolbar.

  • If the plugin is not installed then a message prompt will appear inviting you to visit the instruction website.

  • The export will output many files with the main USD file referencing other mesh, material, motion usd files. This makes it convenient to update the files later.

Character

  • Everything put onto the character will also be exported. This includes accessories, hair, cloth, shoes, gloves, etc.

    • Does not include physics settings and collision shapes.

  • Animation can be batch exported along with the character. The number of USD motion files is dependent on the number of motions selected for export.

    • Currently, blend-shape (morph) animation are not supported.

    • Special notice: The character should be exported with the animation for the best possible result. For example, animation applied from a standard proportion to a smaller character will give unexpected/erroneous results.

Material & Texture

  • Materials and texture files will also export with the character. Different MDLs will be given depending on the Export USD (Omniverse) > Material > Render Mode settings.

  • RTX Real-Time: All Digital Human shaders and SSS materials will use the Omniverse PBR shader.

  • RTX Path-Traced: Digital Human shader Skin, Head, Tearline, Eye occlusion, and SSS will all use the Omniverse SSS shader. This is an overall visual improvement at the expense of additional system resources.

  • “CC Omniverse Connector was developed for Omniverse Create 2021.1. There are some known issues with this version that will be subsequently addressed and resolved with the release of Omniverse Create 2021.2:

    • Appearance of line segments with the SSS shader, especially on the nose and jawline with the presence of an HDR enabled light dome.

    • Appearance of excessively bright highlights with the SSS shader, e.g. oily lips.”

Live Sync

  • For Character Creator 3.41, users who wish to render on the Omniverse Create will first need to export character and motion USD files to a designated folder, and load them into Omniverse Create.

  • This version of Omniverse Create can only Live-Sync updated files. In order to achieve live updates, the character will first need to be exported in USD format, then activate the Live-Sync capability in Omniverse Create. Automatic updates will be triggered every time the file is overwritten (also works with textures).

  • Live Sync real-time automatic updates is a feature that is slated for release in a later version.”

Light

  • Rudimentary light settings such as rotations, translations, multiplier, and light textures can be brought into Omniverse Create.

    • Discrepancies in the light intensity can happen as a result of translating the Multiplier value.

IBL (Image Based Lighting)

  • The IBL map will carry over to Omniverse, basic matching will be applied to the IBL dome’s rotation and image strength.

    • Mismatch between the IBL dome position and brightness can still occur.

Roadmap

Upcoming features under consideration (in no particular order).

  • Further enhance the SSS shader by increasing support for CC’s Digital Human Shader, like adding the corresponding SSS shaders for the eyes and gums of the teeth.

  • Add support for blend-shapes, and morph animation in kind.

  • Support single-direction Live-Sync from Character Creator to Omniverse Create.