Introduction

A summarized exploration of the Cortex

Cortex is an edge compute device, used to connect (over a network, local or remote) and controls physical robots, enabling immersive teleoperation, real-time low-latency volumetric data streaming using, custom depth compression and standard RGB compression.

Product Objectives

The primary objective of Cortex is to modernize the control of robot arms via AMAS VR app and various Sensors, enabling precise and immersive 3D interaction.

Key Features

• Realtime Volumetric Data Streaming: Low-latency point cloud data streaming with custom depth and RGB compression.

• Statistically Lossless Depth Compression: Real-time depth data compression preserves accuracy.

• Hardware Accelerated RGB Compression: Low-latency, high-quality RGB data streaming.

• Low Latency: Under 150 ms glass-to-glass delay for real-time interactions.

• Low Bandwidth: Efficient remote volumetric streaming without sacrificing quality.

• Seamless Software Integration: AMAS VR app connects seamlessly for volumetric data streaming.

• Real-Time Inverse Kinematics: Computes and generates the robot's trajectory based on AMAS VR app commands, enabling real-time control.

• Error Handling: Implements safety protocols to prevent unexpected motions, ensuring safe operation.

• Robot Rescue: In-case of error states of robotic arm it brings the robot to the desired position for user out of the error state.

• Robot Connection: Includes drivers for sending joint commands and receiving robot state updates.

• AMAS VR App Integration: Utilizes ROS Bridge Websocket for user command reception and status/error alerts, enhancing safety awareness.