API Catalog AR/VR Spatial APIs

AR/VR Spatial APIs

Augmented & virtual reality

Spatial computing APIs for AR/VR applications, 3D positioning, and immersive experiences. Build next-generation augmented and virtual reality applications with powerful spatial computing capabilities.

3D Object Recognition

Popular

Recognize 3D objects in camera feed. Real-time object detection and classification for AR applications.

POST /api/v1/spatial/object-recognition
{ "image": "base64_encoded_frame",
  "depth_data": true,
  "model": "general-3d" }

// Response
{ "objects": [
    { "label": "chair", "confidence": 0.94,
      "bbox_3d": { "x": 1.2, "y": 0.5,
        "z": 2.1, "w": 0.6, "h": 1.0 },
      "mesh_available": true }],
  "processing_time_ms": 45 }
Real-time 3D Bounding Mesh Generation

Spatial Anchors

Create and retrieve spatial anchors. Persistent AR content placement that survives across sessions.

POST /api/v1/spatial/anchors
{ "action": "create",
  "position": { "x": 0, "y": 1.5, "z": -2 },
  "rotation": { "pitch": 0, "yaw": 45 },
  "persist": true }

// Response
{ "anchor_id": "anc_7f3a9b2c",
  "cloud_stored": true,
  "expiry": "2025-12-31",
  "shareable_code": "ABC123" }
Persistent Cloud Sync Multi-user

Surface Detection

Detect surfaces for AR placement. Identify horizontal and vertical planes for accurate content positioning.

POST /api/v1/spatial/surfaces
{ "frame_data": "base64_encoded",
  "depth_map": true,
  "surface_types": ["horizontal", "vertical"] }

// Response
{ "surfaces": [
    { "type": "horizontal", "area": 2.4,
      "center": { "x": 0, "y": 0.8, "z": -1 },
      "normal": { "x": 0, "y": 1, "z": 0 },
      "vertices": [...] }],
  "planes_detected": 3 }
Plane Detection Mesh Output Occlusion

Hand Tracking

Track hand gestures in real-time. Full skeleton tracking with gesture recognition for natural interactions.

POST /api/v1/spatial/hand-tracking
{ "frame": "base64_encoded",
  "tracking_mode": "full_skeleton",
  "gesture_detection": true }

// Response
{ "hands": [
    { "side": "right", "confidence": 0.97,
      "joints": { "wrist": {...}, "thumb": [...] },
      "gesture": "pinch",
      "pinch_strength": 0.85 }],
  "latency_ms": 12 }
26 Joints Gestures Low Latency

Room Mapping

Create 3D maps of indoor spaces. SLAM-based mapping for room-scale AR and VR experiences.

POST /api/v1/spatial/room-mapping
{ "session_id": "sess_abc123",
  "frames": ["frame1", "frame2", ...],
  "output_format": "mesh" }

// Response
{ "map_id": "map_9d8f7e6c",
  "mesh": { "vertices": 12480,
    "faces": 24960, "format": "glTF" },
  "room_dimensions": { "width": 4.2,
    "length": 5.8, "height": 2.7 },
  "features_detected": 847 }
SLAM glTF Export Feature Points

Ready to build immersive AR/VR experiences?

Get your API key and start using Spatial APIs in minutes.