Simply’s Vision Pro app turns Apple’s XR headset into a piano teacher
The Israeli startup's app uses Vision Pro’s spatial scanning capabilities to identify the keys of a physical piano. It illuminates the keys to be played while displaying notes, instructions, and feedback above the piano.
Ever since Apple launched the Vision Pro nearly two years ago, the company's premium mixed reality (XR) headset has struggled to justify its $3,499 starting price (excluding tax) in the U.S. Early features, like simulating a giant screen for movies, failed to convince many. However, Simply’s new Vision Pro app, released on Sunday, provides a strong answer by using the device to teach piano playing.
"We wanted to go for the most powerful platform available and show what the future looks like today," said Eliran Douenias, who led the app’s development and heads innovation strategy at Simply, in an interview with Calcalist.
Simply, formerly known as JoyTunes, is known for its apps that teach instruments like piano and guitar. These apps guide users with visuals of the keys or strings to play, detect correct notes, and assist with reading music and beginner techniques. The Vision Pro app represents the company’s latest advancement in immersive learning.
The app uses Vision Pro’s spatial scanning capabilities to identify the keys of a physical piano. It illuminates the keys to be played while displaying notes, instructions, and feedback above the piano. Users can learn everything from key recognition to simple songs, such as Beethoven's "Ode to Joy," with guidance on whether notes are played correctly.
For those without a piano, the app offers a virtual keyboard projected onto a flat surface. Although the virtual experience lacks tactile feedback, it delivers a surprisingly high-quality learning experience.
"This is just the beginning," Douenias emphasized. "A lot more content will be added in the next month. What we’ve done now is a proof of concept—a glimpse of what the future looks like with Simply. Our infrastructure allows us to quickly add more songs and courses. Not many companies can develop dedicated apps for Vision Pro like we can."
Related articles:
The company is also considering future applications, such as virtual drum lessons or vocal training. “Imagine folding laundry while seeing lyrics, vocal range, and pitch accuracy displayed. The possibilities with this technology are endless,” said Douenias.
