Overview#

omni.usd.schema.omni_lens_distortion provides USD schemas for representing various lens distortion models in RTX rendering. The extension defines API schemas that can be applied to Camera prims to simulate realistic lens distortion effects, supporting both analytical models and lookup table-based approaches for accurate optical simulation.

Full schema attribute tables and usage guidance are published in the Lens Calibration section of the Cameras page in the Omniverse materials-and-rendering documentation.

Key Components#

Lookup Table Model API#

OmniLensDistortionLutAPI enables custom lens distortion through pre-generated lookup tables stored as RGBA texture files. This approach allows any lens model to be converted to the RTX camera format using two lookup tables: one for ray entry directions and another for ray exit positions on the image plane.

OpenCV Fisheye Model API#

OmniLensDistortionOpenCvFisheyeAPI implements the OpenCV fisheye camera model with standard calibration parameters including focal lengths (fx, fy), principal point (cx, cy), and distortion coefficients (k1–k4). This provides compatibility with existing OpenCV camera calibration workflows.

OpenCV Pinhole Model API#

OmniLensDistortionOpenCvPinholeAPI supports the OpenCV pinhole camera model with comprehensive distortion correction including radial distortion (k1–k6), tangential distortion (p1–p2), and thin-prism distortion (s1–s4). This model bridges traditional computer vision applications with RTX rendering.

Omni-Directional Stereo API#

OmniLensDistortionOmniDirectionalStereoAPI configures a single-eye Omni-Directional Stereo (ODS) camera for 360-degree VR rendering. A full stereo ODS output is composed from separate left/right-eye cameras, typically stacked vertically (top/bottom).

Functionality#

Each schema API can be applied to USD Camera prims to modify how rays are traced through the lens system during RTX rendering. The schemas define sensor dimensions, optical centers, maximum field-of-view limits, and model-specific distortion parameters. All models include calibration metadata to ensure accurate transformation between pixel coordinates and ray directions.

The lookup table approach provides maximum flexibility by allowing conversion of any existing lens model into the RTX format through ray direction and position mapping tables. This enables integration of proprietary or specialized lens models not covered by the analytical approaches.

Relationships#

The extension depends on omni.usd.libs for core USD functionality and optionally integrates with omni.usd.core for enhanced USD operations. These schemas are designed to work with RTX rendering systems that interpret the lens distortion parameters during ray tracing operations, providing physically accurate camera simulation for synthetic data generation and visualization applications.