HandMade lets you sketch 3D objects in VR with spatial prompts
VR sketches become spatial prompts for generative AI, beating text-only baselines.
HandMade is a workflow combining VR 3D sketching and language for open-domain 3D asset generation. It treats coarse, part-labeled 3D sketches as spatial prompts, converting segmented VR strokes into multi-view part guidance and structured prompts. A technical evaluation on 20 varied examples shows HandMade better preserves user-authored spatial scaffolds than text-only and sketch-based baselines. An eight-participant user study characterizes how users use 3D sketching for spatial layout and language for identity, materials, and details across initial authoring and revision.
- HandMade converts segmented VR strokes into multi-view part guidance for generative models, preserving user spatial layouts better than text-only methods on 20 test examples.
- Users combine 3D sketching for spatial arrangement with text prompts for identity, materials, and style, enabling a more intuitive creation workflow.
- An 8-participant user study shows HandMade's effectiveness for initial authoring and revision, separating layout from semantic details.
Why It Matters
This bridges VR sketching and generative AI, giving creators precise spatial control over 3D assets without sacrificing text flexibility.