3d

Most of my professional experience so far has been focused on language and 2D vision. But lately, I’ve been getting very curious about spatial intelligence - the capability to perceive, reason about, and generate in 3D space, not just flat pixels and tokens. If you’ve been following the news, you’ll notice a surge of interest in world models (Yann LeCun’s AMI Labs, Fei-Fei Li’s World Labs) and embodied agents - systems that don’t just process text, but understand and act in physical space. Spatial intelligence is highly relevant here, although it’s more directly related to embodied agents (which need spatial intelligence directly since they have to navigate and act in physical 3D space) than world models (they are about learning an internal model of how the world works - spatial understanding is important for this, but world models also cover physics, causality, and dynamics, not just 3D geometry). This series is my first step into understanding more about spatial intelligence, starting with NeRF. ...