User Guide
v8.3
v8.3
  • Extend Robotics User Manual
  • introduction
    • AMAS Overview
    • Compatible XR Systems
    • Supported Robots
      • Robots
        • Ufactory
        • Universal Robots
        • Dobot
        • Pal Robotics
        • Mitsubishi Electric
        • AGILE-X
      • Accessories
        • Robotiq
        • ROBOTIS
        • Ufactory
    • Choosing 3D Sensors
      • Limitations
      • Sensor Types
      • Visual Comparison
    • Typical Network Connection
    • Specifications
    • Release Notes
      • AMAS V7.6
      • AMAS V8.3
  • getting started
    • Getting Started with AMAS
    • Navigating Through the User Guide
  • AMAS VR Application
    • Download AMAS
      • Setup Quest Application
      • Running the Application
      • Home Scene Arrival
    • Control Panel
      • Floating Keyboard
      • Error popup
    • Interactions Modes
      • View Adjust Mode
      • Robot Control Mode
      • Interaction Utilities
    • Hand Tracking
    • Passthrough Mode
    • Manage multiple devices
      • RoboKit Addition and Configuration
      • Loading RoboKit
      • SenseKit Addition and Configuration
        • Sensor Specific Firmware Settings
        • 2D - 3D fusion
      • Loading SenseKit
      • AudioKit Addition and Configuration
      • Loading AudioKit
      • Configuration Bundles
    • Hand-eye Calibrations
      • Calibration Prerequisite
      • SenseKit to Robot Calibration
      • SenseKit to SenseKit Calibration
      • Manual Sensekit Calibration
      • Manual RoboKit Calibration
    • Motion Playback
      • Creating a Recording
      • Load a Recorded Motion
      • Replay a Recorded Motion
    • Visual Haptic
      • Force Torque Calibration
    • Speech Recognition
    • Utilities
      • Stationary Headset
    • UR Program Change
    • Mobile Robot Movement
      • Virtual Joystick
      • Quest series controller
    • Shutdown Instructions
    • Over-the-Air Firmware Updates
    • Safety Utilities
      • RoboKit Safety Utilities
      • Joint Limit Recovery Visualisation
      • Robot Rescue
  • SenseKit
    • Introduction
    • Components
      • Pre-requisite SenseKit Components
      • Shipped SenseKit Components
    • Mounting Options
    • Setup Instructions
    • Running Instructions
    • SenseKit IP Configuration
    • Calibration Instructions
    • SenseKit Manual Firmware Upgrade / Install
    • Shutdown Instructions
  • RoboKit
    • Introduction
    • Components
      • Pre-requisite RoboKit Components
      • Shipped RoboKit Components
    • Initial Setup Instructions
      • UFactory xArm
      • UR e Series
      • UR CB Series
      • Dobot CR-A Series
      • AgileX
      • Dexterous Hand with xArm
    • Instructions for Starting RoboKit
    • RoboKit IP Configuration
    • RoboKit Manual Firmware Upgrade / Install
    • Shutdown Instructions
    • Safety Protocols
  • API
    • RoboKit
      • Current Robokit Publishers, Subscribers and Services
      • Gripper Customizations
      • Message and Service Definitions
    • SenseKit
  • Other Information
    • Troubleshooting
    • Customized Hardware Integrations
    • Remote Demonstration Requirements
    • Backward Compatibility
    • Guides
      • PAL TIAGo
        • Mobile Base, Arm and Torso Control
        • 3D Sensor
        • Additional Sensor Data Visualization
        • First Person View Mode
        • Take Home Functionality
        • Audio
        • Bundle
      • Robot - Sensor Sync
      • UI Design Reference
    • Downloads
      • OTA
      • Calibration Board
  • System Requirements
    • PC Requirements
    • Network Requirements
Powered by GitBook
On this page
  • Aligned View
  • Side View

Was this helpful?

  1. introduction
  2. Choosing 3D Sensors

Visual Comparison

Comparison of 3D data from sensors in various conditions

3D sensors supply 3D data (depth image, distance measurements) and often 2D data (texture, standard colour images). Both 2D and 3D data is used to reconstruct view in VR.

Perspective from which VR user sees reconstructed view typically differs from that of the sensor.

In practice all 3D sensors provide 3D data with noise, artifacts and sensors are subject to limitations.

Test Conditions

Sensors:

  • Realsense D435/D455: depth 848x480, RGB 1280x720

  • Zed 2i: neural depth 1920x1080 downsampled to 1152x648, RGB 1920x1080

  • Kinect4A: NFOV depth 640x576, RGB 1280x720

  • MotionCam3D M+: 1120x800 depth, RGB 1932x1096

Surface reconstruction:

  • algorithm similar in spirit to PCL Organized Fast Mesh

  • triangulation constrained by edge length

  • exposes problems of original 3D data

Aligned View

When looking at reconstructed 3D view from the same or similar perspective as 3D sensor, most 3D data imperfections are not visible (with exception for missing 3D data).

Quality of 3D sensor data should not be assessed with aligned view as it hides imperfections of 3D data.

3D Sensor
3D Reconstruction

Realsense D435

Realsense D455

ZED 2i

Kinect4A/Femto Bolt

MotionCam-3D M+ (partially beyond calibration volume)

3D Sensor
3D reconstruction

Realsense D435

Realsense D455

ZED 2i

Kinect4A/Femto Bolt

MotionCam-3D M+

3D Sensor
3D Reconstruction

Realsense D435

Realsense D455

ZED 2i

Kinect4A/Femto Bolt

MotionCam-3D M+ (partially beyond calibration volume)

Side View

When looking at 3D reconstruction from the side compared to original sensor perspective we are able to see 3D data inaccuracy and noise.

3D Sensor
3D Reconstruction

Realsense D435

Realsense D455

ZED 2i

Kinect4A/Femto Bolt

MotionCam-3D M+ (partially beyond calibration volume)

3D Sensor
3D Reconstruction

Realsense D435

Realsense D455

ZED 2i

Kinect4A/Femto Bolt

MotionCam-3D M+

3D Sensor
3D Reconstruction

Realsense D435

Realsense D455

ZED 2i

Kinect4A/Femto Bolt

MotionCam-3D M+ (partially beyond calibration volume)

PreviousSensor TypesNextTypical Network Connection

Last updated 10 months ago

Was this helpful?