Humanoid robots keep falling over inside gaussian splats

Nico Heider, Michał Jan Włodarczyk and colleagues argue that Semantic Radiance Fields — captures that carry per-class meaning alongside colour and geometry — can serve as simulators for training embodied agents, closing the gap between synthetic worlds and real ones.

Why it matters: Simulators for robots come in two flavours, and both are compromised. Synthetic environments know exactly what every object is, because someone authored them, but they don't look like the world. Reconstructions of real places look right and know nothing — a splat of your kitchen has no idea which blob is a kettle.

Hossein Khalili and colleagues at UCLA and Nokia Bell Labs have built InViStream, a system that removes private content from RGB-D streams on the camera side, before anything is fused into a shared 3D scene.

Why it matters: Ordinary video can be redacted frame by frame. A volumetric pipeline can't be, because the thing you are trying to hide is reconstructed from several cameras at once — miss it in one view and it reappears in the fused scene.

Wenyu Li and colleagues at NUDT diagnosed a structural flaw in query-based feed-forward gaussian splatting — the queries have no idea where they are — and fixed it by giving each one an explicit position in 3D space.

Why it matters: Feed-forward splatting is the branch that skips per-scene optimization: images in, gaussians out, no training run per capture. It is the path to splats that appear as fast as you can photograph something.

Kiseok Choi, Min H. Kim and colleagues have adapted gaussian splatting into a reconstruction method for cone-beam CT, correcting the streaks and dark bands that metal implants throw across a scan by modeling the polychromatic X-ray beam that causes them.

Why it matters: Splatting was built to render what a camera saw. This is the same representation running in reverse, as a solver for a physical inverse problem in a medium that has nothing to do with photography.

A team led by Siddarth Gottumukkula and Priyesh Shukla has proposed ProbSplat, a compute-in-memory chip architecture that stores gaussians as physical charge and evaluates their log-likelihoods in analog — targeting the power budget of standalone AR/VR headsets and edge robots rather than a desktop GPU.

Why it matters: Every splat pipeline shipping today assumes a GPU somewhere — on the device, or in the cloud with a round trip. That assumption is what keeps live reconstruction off untethered headsets and small robots.