Sony's PS5 Camera Just Became a Cheap 3D Scanner for Robots

A tech enthusiast is trying to turn a PlayStation 5 HD camera into a powerful 3D scanner for robots. The camera costs about $60, while professional 3D sensors can cost thousands. He's using free software called ROS 2 to process the camera's two lenses into depth information—like how your eyes judge distance. The goal is to feed this data into another program that builds 3D maps, useful for robots that navigate homes or warehouses.

The problem? The camera's wide-angle lens makes it hard to get clear depth. The software either leaves big black holes on flat surfaces like walls, or adds colorful speckles everywhere. He's tried adjusting dozens of settings—like the size of the comparison window and how strict the matching is—but nothing works perfectly. He even found that one setting is capped in the graphical tool, so he has to change it manually in code.

He's asking for help from other developers. Specifically, he wonders if pre-filtering settings or a calibration issue is to blame. If the camera isn't perfectly aligned, no amount of tuning will fix it. He's also shared screenshots of his results, showing the messy output.

This matters because if he succeeds, anyone could build a robot with 3D vision for under $100. That could lead to cheaper home robots, better automated warehouses, and more hobbyist projects. But for now, it's a reminder that even with cheap hardware, getting reliable 3D vision is still a challenge.