I have seen in videos that it is possible to calibrate the keyboard through hand tracking, but the app asks me to do so using the controller's, and using them, the result is widely different from my keyboard. How can I calibrate using my hands?
A downloadable app for Android
Just calibrate your real piano, import your favourite songs and press play! Notes will fall directly onto your keys, so it's really easy to learn how to play any song pretty fast. Download .mid files from the internet, or import your midi music.
Install the APK and launch the game. Download your favourite songs. They have to be in the .mid format. Mp3's will not work. Navigate to \Android\data\com.PavelMarceluch.VRtuos\files\Midis\ and put all your .mid files there.
If you find a bug, have a suggestion or you just want to tell me something, hit me up right here on Itch, SideQuest, or join my Discord. We already have an awesome community that will help you with anything you need and I am there all the time.
For information about updates, join my Discord.
Log in with itch.io to leave a comment.
It isn't possible to calibrate with hands at the moment. You can always offset your piano in the settings. While calibrating, make sure you hold your controllers over the green keys and that you have selected the right size.
I'm still working on the calibration process, let me know if this helps.
just recently downloaded the app for the Quest 2. the hand tracking isn't so great on Quest 2, so I can understand there being some glitches. the Keyboard calibration was very off though, not sure if that's because im using an electronic keyboard vs. a grand piano...
one VERY important note: the option to playback MIDI songs and see the notes being played is very cool, but I personally really wanted to be able to bring in my own PDF sheet music so I could play while reading the music in VR. I almost assumed this would be a feature, given this is how people actually learn how to play piano. Practically speaking, it takes much much longer to learn songs playing from MIDI as opposed to reading the sheet music. Converting MIDI's into playable notes does nothing more than turn these beautiful piano pieces into complicated beat saber songs. Fun to play, easy on the ears, but not much depth, emotion, or actual learning is produced.
This is a long passionate way of saying, I love the idea, and it would be that much better if we could just bring our own PDF Sheets into VR and read them while playing!
Hi, thanks for your feedback. If you cant get the calibration right, you can always offset it in the settings.
Sheet music is something I thought about many times but still didn't figure out the way to implement it. Having just a PDF reader doesn't make sense, because it doesn't add any value to the VR aspect of it, you will have a better experience if you just print it out. Reading the PDF itself and trying to generate midi is practically impossible.
Generating sheet music from the midi files is probably possible, but it will never be even close to handmade sheets. Would it be even readable in VR and notes flying by?
This is a complex issue that I'm figuring out since the beginning. I would like to implement it at some point but I'm still not sure if VRtuos is even the right place for it. I love how you said that converting MIDI's into playable notes turns songs into beat saber maps. After all, if you can read sheet music, you probably don't need this app.
I'd love to hear more from you about this. If you want, you can contact me at firstname.lastname@example.org, or join our Discord server.
One of the great value props of your app for me, a pianist who can read sheet music, is simply being able to do so in a VR space, in any environment of my choosing. I recently began streaming myself playing piano on TikTok, and could imagine VR taking my piano content creation videos to the next level. For example, I'd like to bring my own avatar into VRtuos, and customize my scene in the app, then set up a VR camera and record myself in the VR space so that it's my 3D avatar playing the VRtuos piano in a beautiful VR scene (like they do with the beat saber mixed reality capture using LIV).
I've been playing piano for many years, but was never classically trained and can't play by ear, so reading sheet music is the only way I can learn new songs. Like I mentioned, it would just take weeks for me to try and memorize the beat saber map-esque set of MIDI notes whereas I can pick up almost any song via sheet music in 5-10 hours, and could speed this up with practice. If your goal is to educate people to play piano, I truly believe teaching them to read sheet music is the solution.
There are definitely creative ways to incorporate VR to enhance the sheet music "sight-reading" experience. One idea off the top of my head is while the piano is playing back the song, lighting up the notes as they're being played, not necessarily having the notes drop down from the sky (which makes sense and is natural for MIDI clips). but even just simply being able to produce pdf sheets that behave like paper and sit in front of me while i am inside VRtuos, would be more than enough for someone like me, because this is how i've done it in the real world for so many years. It just feels natural and I assume it'll be there, and then when I don't have the sheet music and can't bring it in, almost feels like I'm being restricted, or one of my real world freedoms has been taken away in VR (not to sound too dramatic, but i believe its important philosophy for any VR experience).
I'm writing this freehand so its a little disorganized. Love talking about VR, am learning how to develop VR experiences myself. Will definitely join your discord!
Is there a payment method other than PayPal? PayPal is closed in Turkey :/
No, there isn't. But Don't worry, the app is free. If you just want to support me, a good word does more than 9$ :) Thanks!
Amazing app worth supporting the developer. I hope that it continues to be updated and that there might be others in the community working on midi's to use to teach songs.