New AI technology from the University of Maryland enhances violin skills

The University of Maryland is establishing a new institute focused on Artificial Intelligence (AI), despite the fact that numerous programs are already utilizing the technology. One such program is designed to assist individuals in learning how to play the violin. The technology, known as VAIolin, employs AI to assess a player’s posture and performance.

Anna Kelleher, a student pursuing a Master’s degree in Music Performance, shared her experience with the new AI technology. She mentioned that the software detected a flaw in her posture as she held her violin at an angle that was too flat. The AI recommended that she adjust her posture slightly, providing her with on-screen feedback on how to improve.

Snehesh Shrestha, a Ph.D. student in Computer Science and member of the team developing the technology, discussed the features of the software. He explained that it detects errors in posture and provides real-time feedback to help players correct their technique. Cornelia Fermüller, a Research Scientist and Co-Director of the Perception and Robotics Group, highlighted the use of machine learning and neural networks in creating the technology.

The development process involved the use of a green screen and motion capture sensors, but now the technology can be accessed using a computer’s built-in camera. Lindsey Mastis, a reporter covering Artificial Intelligence for 7News On Your Side, tested the technology herself and experienced immediate improvement in her sound by adjusting her posture.

In addition to posture correction, the technology includes a haptic wrist strap that mimics the sensation of a violin bow moving across the strings. This feature can assist students in maintaining tempo and practicing without a violin. The team behind the technology aims to make it available at an affordable price to enable more people to enhance their playing skills quickly and safely.