Capabilities#

The capabilities of USD Code API are detailed below.

  • Answering Knowledge Questions: USD Code can answer questions about OpenUSD knowledge, concepts, and API functions.

  • Core Python-USD Code Generation: USD Code can generate entire functions, or code snippets, based on comments or natural language instruction.

  • High-Level Python-USD Code Generation: USD Code can generate entire functions, or code snippets, to perform scene modification tasks in minimal lines of code by leveraging a utility library of custom Python-USD functions (USD Code Helper Functions). For developers who self-host USD Code API, this capability is enabled once the USD Code Helper Function library is installed after deploying the helm chart. See this section.

  • Natural Language Driven Stage Modification: When used in Omniverse Kit, USD Code can modify an existing scene based on natural language instruction by generating code using the utility library of custom Python-USD functions.

  • Code Commenting: Available to use in conjunction with VS Code and Continue, USD Code can look at blocks of code and provide commenting inline. This capability is enabled via Continue.dev.

  • Code Self-Correction: USD Code is able to perform self-correction to ensure the generated Python USD code is as correct as possible. You can choose to interact with this capability either with the sample extension UI. This is only available if you are using Omniverse sample kit extension.

The table below outlines the availability of each capability via its integration environment.

Capabilities

Answering Knowledge Questions

Core Python-USD Code Generation

High-Level Python-USD Code Generation (USD Code Helper Functions)

Natural Language Driven Stage Modification

Code Commenting

Code Self-Correction

Preview API on API Catalog

✔

✔

✔

X

X

X

USD Code Sample Kit Extension

✔

✔

✔

✔

X

✔

VS Code

✔

✔

✔

X

✔

X

For detailed usage, configuration and deployment, see the Usage page.