Capabilities#
Users can integrate USD Code NIM into their workflow in three possible ways:
Via UI - USD Code NIM is available as a Preview API on the API Catalog, where users can use and test USD Code NIM’s main capabilities in an easy-to-access way.
Via API Endpoint - USD Code NIM may also be accessed through an API endpoint via API Catalog where users can integrate the API within their own application environment, like Visual Studio Code.
Via Sample extension - USD Code NIM can also be integrated into applications built with the Omniverse Kit SDK as a Kit extension, where users can interact with the model within the Omniverse. We have made a sample extension that makes these calls to our endpoint example on the API Catalog and provide the sample code.
The capabilities of USD Code NIM are detailed below for each of the supported workflows.
Capabilities per Release Artifact |
Answering Knowledge Questions |
Code Generation |
Code Commenting |
AI Automated Stage Modification |
---|---|---|---|---|
USD Code NIM Preview API on API Catalog |
Yes |
Yes |
No |
No |
USD Code NIM Sample Kit Ext. |
Yes |
Yes |
Yes |
Yes |
VS Code |
Yes |
Yes |
Yes |
No |
Answering Knowledge Questions: USD Code NIM can answer questions about OpenUSD knowledge, concepts, and API functions.
Code Generation: USD Code NIM can generate entire functions, or code snippets, based on comments or natural language instruction.
Code Commenting: USD Code NIM can look at blocks of code and provide commenting in line.
AI Automated Stage Modification: when used in Omniverse Kit, USD Code NIM can modify an existing scene based on natural language instruction.