USD Search API 1.1.0#

Release Date: February 2025

  • VLM-based auto-captioning and auto-tagging.

  • Support for a broad range of storage backends through S3proxy functionality.

  • Search by custom metadata fields extracted from USD assets.

Added#

  • VLM-based automatic tagging and captioning.

    • Allows configuring USD Search to use a broad variety of VLM providers (e.g. NVIDIA AI Endpoints, OpenAI, Azure OpenAI, Mistral AI, Anthropic).

  • Support for a broad variety of backends through S3proxy functionality.

    • Adds a convenience helm sub-chart for s3proxy configuration.

  • Filter search results by applying regex on Asset URLs.

  • Search by custom metadata fields extracted from USD files. - Added support for searching by metadata stored in the customLayerData dict.

  • On-demand indexing endpoint that allows to prioritize processing of selected assets without the need to wait for the background job to catch up.

  • Make sure size search is happening over bounding box dimensions that are scaled by MPU.

Known Limitations#

  • USD Search API relies on Omniverse Kit for rendering and extracting scene prim hierarchy. Therefore the service should work with any scene that Omniverse Kit can work with.

  • When using the filter_by_properties query parameter in USD Search API, different filters have to be separated by a single comma (having a comma and a space is not supported).

  • At the moment, asset previews are returned together in a single response, which limits the maximum number of results to be returned to around 700. If assets are requested without previews, this number is significantly higher (around 10000).

  • Pagination of search results is currently not supported.

  • Single and double quotes are not supported as part of the filter_by_properties query parameter.