AHa-3D: Real2Sim with GPT-6 Astra via Agentic Tool Use
Loading video
Loading videoCongrong Xu et al. found GPT-6 Astra alone misses objects and gets sizes and positions wrong when rebuilding a room video into a Blender scene. They built a harness handing Astra 3D tools — Pi3X for camera poses and metric-scale geometry, SAM3 for segmenting people/floors/walls, TSDF fusion, a measurement tool, the RoomKit asset library, X-Ray outline checks, and Bullet physics validation — organized as an Observe-Build-Verify-Interact-Deliver workflow. At similar cost and time, reconstructions are markedly better than using Astra directly, yielding interactive browser scenes with doors, furniture, materials, and human motion.
Category: humanoid
Author: @CongrongX
Date: 2026-09-27T00:00:00
Duration: 29.2s
