Research on the interaction design of ink and wash style sound and picture based on Leap Motion

디지털 정보 기술의 급속한 발전에 따라 사람들은 점점 더 자연스럽고 편리한 방식으로 인간과 컴퓨터의 상호작용을 실현하는 경향이 있습니다. 본고에서는 Leap Motion 센서를 하드웨어 플랫폼으로 하고 Unity3D와 Leap Motion 플러그인을 소프트웨어 플랫폼으로 하여 가상 거문고의 상호작용 설계를 개발합니다. 또한 Leap Motion 장치의 개발과 연구를 통해 Leap Motion 센서에서 수집된 제스처 정보의 처리와 인식을 알고리즘으로 구현하고, 제스처 인식 알고리즘을 이용하여 서로 다른 제스처를 분리하여 서로 다른 응답을 가능하게 합니다.

This article aims at the interactive expression of guqin music and landscape painting art, expounds the creativity and technical connotation of Ink-and-wash style audio-visual interactive design, conducts an art experience test and cultural identity measurement on ink-style sound-paint interaction design, and discusses ink-style sound and painting The cultural cognition and identity effect of the school space landscaping design of Interaction University. Ink-and-wash style audio-visual interactive design is an attempt of interactive creation of traditional music art and painting art in the era of new media. Feel the charm of guqin music while experiencing the art of painting. The combined audio-visual experience fully mobilizes aesthetic synesthesia. Under the background of the continuous development of digital technology, human perception and experience have also undergone subtle changes. The ink-and-wash style audio-visual interaction design is in line with human beings. The demand for sensory experience brings pleasant interactive effects to the experiencer. The interactive design of ink-and-wash sound and picture meets the communication needs of traditional culture in the age of science and technology. Ink-and-wash style audio-visual interactive design is composed of a three-dimensional scene module built by Unity3D, a virtual guqin module built by Leap motion, and a sound and picture interaction module based on spectrum visualization calculations. The interaction of the three modules combines the artistic image of traditional architecture painting and guqin music relevance is expressed interactively through intuitive audio-visual perception. The interactive creation of multiple art forms not only satisfies the interactive appeal of multi-channel perception of art, but also satisfies the intuitive expression of artistic imagery. The space architecture design of the ink-and-wash style, sound and picture interactive space has a progressive logical identity to the cognitive, emotional and behavioral dimensions of traditional culture. By experiencing the interactive design of ink-and-wash style sound and painting, the identity of traditional guqin and architecture painting art theory has been significantly improved, and the understanding of music imagery and architecture imagery has been inspired.