Live2d and hand tracking

[KuraIthys]

I cannot test this, otherwise I would have tried it already (don't have the relevant hardware), but I'm curious about the new support for multiple cameras and tracking hands using intel realsense or leap motion.

Playing around in earlier versions showed me that hand movements are considerably more limited with Live2d avatars than with the 3d ones, so does that imply you cannot really use hand tracking and a Live2d avatar?
If you can, what does that mean for the avatar creation guidelines?

Basically, if you have the hardware to track hand (and tongue) movements, can you do that with a Live2d avatar (even if it requires creating them differently) or is that outright impossible?

[76561198257355317]

Hi,

Yes hands tracking is possible with Live2D avatars, with RealSense or Leap Motion Controller. The movements indeed are more limited but it also depends how the 2d model is created.
Here is an example of a Live2D avatar being used with Leap Motion Controller https://www.instagram.com/p/BGMVkhRHUVn/

As for documentation follow these guidelines http://steamcommunity.com/app/274920/discussions/8/485624149164823989/

[KuraIthys]

Ah, thank you. That's very helpful to know about. Helps a lot. (especially since I expect to be using my own character rig eventually, so I can plan for this in advance.)

[Sue]

Here's my attempt with my own model:
http://steamcommunity.com/sharedfiles/filedetails/?id=703468790

It's definitely limited, you can't track the fingers for instance. I haven't tried any application beyond waving the arm or raising it up and down.

[KuraIthys]

Hmm. Yes, I can see the limitations already, but that's better than I expected.
I have a question about the documentation though. - I've read much of it in the past, and as far as I can tell most of it seems to be the same documentation that was given out when the Live2d module was first introduced.
As far as I can tell, that doesn't include any references to how to set up the hands in a way that Facerig understands.

Clearly several people have done so anyway, so how did you figure out how to do it?
(or am I missing something incredibly obvious here?)