Painting++: Human–computer collaborative painting in VR with multisensory interaction

作者：Zhuoshu Li, Pei Chen, Hongbo Zhang, Yexinrui Wu, Xuanhui Liu · 发表于：Design and Artificial Intelligence · 年份：2025 · DOI：10.1016/j.daai.2025.100019 · 被引用次数：5 · 研究领域：Virtual Reality Applications and Impacts、Augmented Reality Applications、3D Surveying and Cultural Heritage

Extensive human-computer collaborative painting systems have been explored to assist people in ideating and creating the content of paintings. Recently, the popularity of VR has opened up the novel possibility of facilitating painting by providing an immersive virtual environment. To create immersion, previous VR painting systems mainly focused on simulating real painting environments. However, our preliminary study revealed that the lack of multisensory interaction in existing VR painting applications detracted from the fully immersive experience. Grounded in the findings of the preliminary study, we developed Painting++, a human-computer collaborative painting system that synthetically integrates visual, audio, haptic, and smell feedback to enhance the sense of immersion. Particularly, the content generation ability of AI is also adopted to assist users in obtaining completed stereo paintings from rough sketches. Painting++ has been evaluated in a comparative study with two mainstream VR painting applications (N=18). The results illustrate that multisensory interaction and AI assistance make Painting++ succeed in creating a highly immersive painting experience. Our work further reveals the distinct impact of VR painting systems on painting behavior and demonstrates the multiple roles that Painting++ plays in supporting human-computer collaborative painting.