Hand Tracking via Virtual Desktop is Insane

[[EW] Mitsie]

Hand Tracking - I dont know if anybody has mentioned this before, but there are other games for Steam VR and Oculus store that utilise the Quest Hand Tracking features.

VRtuos is one that is a piece of musical software that allows hand tracking.

https://youtu.be/spx0l6mDTcI

https://uploadvr.com/best-oculus-quest-hand-tracking/

Upon looking further I noticed you can use Virtual Desktop which i use anyway to play Vinyl Reality. I started with the controllers and queued up a record on each deck, then put my controllers down so the Hand Tracking took over. You have to pinch your fingers together to emulate the trigger on the controller.

My mind was blown !!!!!

It just felt natural. Vinyl reality is a piece of software that is built to have Hand Tracking. DJing is hands on. Its all about touching the records and twiddling the nobs with your fingers. When i could do it with the Emulated hand tracking in Virtual Desktop it just felt amazing, how could i go back to using a controller now ??

So i turned to use the record box and started doggy paddling through the records, then i realised, the hand tracking emulation doesn't support moving the joystick, so basically I couldn't pick up another record.

I bet with a little bit of work, an option to turn on Oculus Quest hand tracking like in other games, it could turn this great piece of software into an absolute master piece.

I would add the doggy paddling through the record box, as if you were skipping through the records in real life. It would be absolutely awesome.

If anybody is using a Quest 2 with Virtual Desktop you can emulate Hand tracking to controller in the Input options. I'm forced to use the controller as i cant pick a record without them. and it breaks immersion having to take the headset off after every mix to grab the controllers.

Please add Hand Motion control

[TTycho]

Hi,

Thanks for your detailed post and feedback.

While I agree that hand tracking is the future, I think the current implementations are still too inaccurate and unpredictable to be used in an application like Vinyl Reality.

Even if it works fine 99.9% of the time, that remaining 0.1% can still ruin the whole experience when for example a finger is badly tracked and accidentally touches a record while it's playing.
There's also the issue of your hands and fingers only being tracked when in view of the cameras, which can make some interactions impossible, like for example holding a record while looking the other way at the record case.

Every controller scheme is a trade off between immersion and usability, and the current control scheme was designed to strike the right balance given the current limitations of most controllers.

I did a lot of experiments with per-finger tracking with the valve index controllers, but could never get a result that was accurate enough.

https://youtu.be/7j9yBsUfgCE

[[EW] Mitsie]

Thanks for the Feedback, I did notice that when using that I struggled to turn the headphones on as my hands were out of the reach of the camera. It does turn this piece of software into an absolute masterpiece. This is what VR is made for and I'm definitely looking forward to see the Hardware and software improvements as time progresses :)