Skip to main content
Special Issue: Enhancing the Student Experience | Acta Pedagogia Asiana | Volume 5 - Issue SI - 2026 | 106−115 | https://doi.org/10.53623/apga.v5iSI.1120
© 2026 by the author(s), and is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) License Creative Commons Attribution 4.0 International (CC BY 4.0) License

Virtual Reality-based Game Development for Musical Instrument Training

Author(s): Yuqin Wang 1 , Yucheng Ma 1 , Qinglei Bu 2 , Quan Zhang 2 , Fei Ma 1 , Xiaojun Zhang 3 , Jie Sun 2
Author(s) information:
1 School of Mathematics and Physics, Xi’an Jiaotong-Liverpool University, China
2 School of Advanced Technology, Xi’an Jiaotong-Liverpool University, China
3 Academy of Future Education, Xi’an Jiaotong-Liverpool University, China

Corresponding author

Acta Pedagogia Asiana

Acta Pedagogia Asiana

Volume 5 - Issue SI - 2026

 About the journal
Submit your article

The experience and duration of musical instrument training are often constrained by several practical and pedagogical limitations, including restricted physical space, high costs of instrument acquisition and maintenance, and reliance on traditional, instructor-centered teaching methods. These challenges can limit accessibility, reduce practice opportunities, and hinder learner motivation, particularly for beginners and individuals without access to formal music education environments. This study explores the potential of VR to enhance musical instrument experience and training by providing users with interactive, virtual environments where multiple instruments can be accessed and practiced without the need for physical resources. Through VR, learners are able to engage in diverse training scenarios, experiment with different instruments, and receive immediate feedback in a controlled and customizable setting. Furthermore, VR-based musical training integrates elements of gamification such as challenges, rewards, and progression systems, which can significantly increase learner engagement, motivation, and persistence. By transforming practice into an interactive and enjoyable experience, VR has the potential to address common barriers associated with repetitive and monotonous training routines. In addition, VR platforms can support self-paced and individualized learning pathways, accommodating users with varying skill levels and learning preferences. The findings of this study suggest that VR-based musical training not only enhances user engagement but also contributes to improved learning outcomes, particularly in terms of skill acquisition, retention, and confidence building. The immersive and interactive features of VR enable learners to develop motor skills, auditory perception, and performance techniques in a more intuitive and experiential manner. This research highlights the transformative potential of VR in redefining musical education by making it more accessible, cost-effective, and engaging. It underscores the role of emerging technologies in overcoming traditional barriers and expanding opportunities for music learning across diverse populations.

Read Full-Text
Previous article
Next article

Radianti, J.; Majchrzak, T.A.; Fromm, J.; Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education, 147, 103778. https://doi.org/10.1016/j.compedu.2019.103778.

Sun, M.; Bu, Q.; Hou, Y.; Ju, X.; Yu, L.; Lim, E.G.; Sun, J. (2023). Virtual reality music instrument playing game for upper limb rehabilitation training. Companion Publication of the 25th International Conference on Multimodal Interaction, 96–100. https://doi.org/10.1145/3610661.3617159.

Innocenti, E.D.; Geronazzo, M.; Vescovi, D.; Nordahl, R.; Serafin, S.; Ludovico, L.A.; Avanzini, F. (2019). Mobile virtual reality for musical genre learning in primary education. Computers & Education, 139, 102–117. https://doi.org/10.1016/j.compedu.2019.04.010.

Turchet, L.; Hamilton, R.; C¸amci, A. (2021). Music in extended realities. IEEE Access, 9, 15810–15832. https://doi.org/10.1109/ACCESS.2021.3053450.

Yu, S.; Liu, Q.; Johnson-Glenberg, M.C.; Han, M.; Ma, J.; Ba, S.; Wu, L. (2023). Promoting musical instrument learning in virtual reality environment: Effects of embodiment and visual cues. Computers & Education, 198, 104764. https://doi.org/10.1016/j.compedu.2023.104764.

Huang, F.; Zhou, Y.; Yu, Y.; Wang, Z.; Du, S. (2011). Piano AR: A markerless augmented reality based piano teaching system. 2011 Third International Conference on Intelligent Human-Machine Systems and Cybernetics, 2, 47–52. https://doi.org/10.1109/IHMSC.2011.82.

Johnson, D.; Damian, D.; Tzanetakis, G. (2020). Evaluating the effectiveness of mixed reality music instrument learning with the theremin. Virtual Reality, 24, 303–317. https://doi.org/10.1007/s10055-019-00388-8.

Cui, K. (2023). Artificial intelligence and creativity: Piano teaching with augmented reality applications. Interactive Learning Environments, 31, 7017–7028. https://doi.org/10.1080/10494820.2022.2059520.

Hille, A.; Schupp, J. (2015). How learning a musical instrument affects the development of skills. Economics of Education Review, 44, 56–82. https://doi.org/10.1016/j.econedurev.2014.10.007.

Bontempi, P.; Canazza, S.; Carnovalini, F.; Rodà, A. (2023). Research in Computational Expressive Music Performance and Popular Music Production: A Potential Field of Application? Multimodal Technologies and Interaction, 7, 15. https://doi.org/10.3390/mti7020015.

Johnson-Glenberg, M.C. (2018). Immersive VR and education: Embodied design principles that include gesture and hand controls. Frontiers in Robotics and AI, 5, 1–19. https://doi.org/10.3389/frobt.2018.00081.

Kaufmann, H.; Schmalstieg, D.; Wagner, M. (2000). Construct3D: A virtual reality application for mathematics and geometry education. Education and Information Technologies, 5, 263–276. https://doi.org/10.1023/A:1012049406877.

Ogawa, N.; Narumi, T.; Hirose, M. (2019). Virtual hand realism affects object size perception in body-based scaling. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 519–528. https://doi.org/10.1109/VR.2019.8798040.

Soliman, M.; Pesyridis, A.; Dalaymani-Zad, D.; Gronfula, M.; Kourmpetis, M. (2021). The application of virtual reality in engineering education. Applied Sciences, 11, 2879. https://doi.org/10.3390/app11062879.

Read Full-Text
About this article

SUBMITTED: 13 March 2026
ACCEPTED: 08 April 2026
PUBLISHED: 15 April 2026
SUBMITTED to ACCEPTED: 27 days
DOI: https://doi.org/10.53623/apga.v5iSI.1120

Cite this article
Wang, Y. ., Ma, Y. ., Bu, Q. ., Zhang, Q. ., Ma, F. ., Zhang, X. ., & Sun, J. . (2026). Virtual Reality-based Game Development for Musical Instrument Training. Acta Pedagogia Asiana, 5(SI), 106−115. https://doi.org/10.53623/apga.v5iSI.1120
Citations
0
Share this article