DOT-Sim: Differentiable Optical Tactile Simulation with Precise Real-to-Sim Physical Calibration
Calibrates optical tactile simulations in minutes with under 0.9mm error
Deep Dive
DOT-Sim is a differentiable optical tactile simulation that uses the Material Point Method (MPM) for realistic soft sensor physics. It calibrates from just a few demonstrations in minutes, supporting large non-linear deformations. In zero-shot sim-to-real tests, DOT-Sim achieved 85% classification accuracy on challenging objects and 90% on embedded tumor detection. It also enables precise trajectory following with an average error of less than 0.9mm, making simulation-trained policies directly deployable on real DenseTact sensors.
Key Points
- Calibrates real-to-sim tactile sensor physics in minutes using only a few demonstrations
- Achieves 85% accuracy on object classification and 90% on tumor detection in zero-shot sim-to-real transfer
- Enables precise trajectory following with a policy trained entirely in simulation, average error <0.9 mm
Why It Matters
DOT-Sim bridges the sim-to-real gap for tactile sensors, enabling fast deployment of manipulation and medical diagnostic policies.