Perception Based Sensor Extensions

Perception based sensors use rays to sense the surroundings, which includes cameras, Lidars, and radars sensors. Omniverse Isaac Sim supports a selection of perception based sensors, modeled using both PhysX and RTX.

RTX Sensors

Isaac Sim supports RTX-based cameras, Lidars, and radars.

• Camera Sensors and Render Extensions
• RTX Lidar Sensor
• RTX Radar Sensor

RTX sensors are built using the omni.sensors extension suite. To understand more about how RTX sensors are modeled, and how to build your own, please review the following documentation:

• Omniverse Lidar Extension

• Omniverse Radar Extension

• Omniverse Non-Visual Materials Extension

• Omniverse Sensors NV Common Extension

PhysX Sensors

Isaac Sim supports PhysX-based Lidar, ultrasonic sensors(deprecated), and generic range sensors.

• Range Sensor Extension (Lidar, Ultrasonic, Generic Range)