HyperSketch: Controllable Video Sketching in a Style Hyperspace

Navigating a 4D style hyperspace for controllable video sketching. Our method models the sketch as a point in a 4D style hyperspace, enabling continuous control of styles with temporal coherence. The intermediate column shows input frames (top) and output sketches (middle), each of which corresponds to a point along a trajectory in this 4D style hyperspace (bottom). Users can adjust temporal trajectories for fi delity, simplicity, and text guidance via editable curves (left).

The project website can be found in here.

Open-source codes can be found here.

Abstract: Vector sketch animation offers tremendous advantages for multimedia and creative design through concise line expressions and flexible editing. Learning-based generation methods of sketch animation have made significant progress in the last decade, but still suffer from limited style diversity and controllability. This paper presents a controllable video sketching method that automatically converts videos into multi-style vector sketch animations. A continuous style hyperspace is constructed by multi-dimensional sketch styles (fidelity, simplicity, text guidance strength) and the timeline. With this hyperspace, stroke control points are parameterized as 4-variable Bernstein polynomials, ensuring smooth and differentiable style transitions. A multi-task, multi-stage optimization framework is designed to learn stroke hyperparameters accurately and efficiently. We further developed a web-based interactive interface that allows real-time style manipulation via editable curves. Experiments show the style controllability, high-quality, and user-friendliness of our method, which outperforms SOTA methods.

Recommended citation: Xinding Zhu, Xinye Yang, Yingping Yang, Mengjian Li, Fei Gao, Jiazhou Chen. “HyperSketch: Controllable Video Sketching in a Style Hyperspace.” ACM Multimedia. 2026.