Animating Mouth to Audio Files without Live2d

[Xantherous]

Hi,

I have the graphics that I could use to traditionally animate a character (frame by frame). How can I use these to match up works to mouth as you would Live2D inputted character? (btw, I'm not much of a coder). Or is animation to voice only a Live2D feature?

[Razekiel]

I was wondering this as well. I would love to be able to lip sync characters to audio. I have noticed games with live2d, but I'm not too keen on how the mouths move. I would prefer proper phonetic animations.

[Kentou]

Hi, you can do that with 2D characters as well. In Database > Character Expressions, you can just setup animation frames for Talking. They will be bound to the voice file's volume to make sure the mouth-animation is only displayed if the voice actually speaks. You can also define the minimum voice-volume necessary to make the animation play to avoid that noise, etc. triggers the animation.

We are also happy to hear your feedback about this features so we can improve it in the future.

[Xantherous]

Thank you so much for explaining. I saw that feature but didn't understand it. I will try it out as soon as I'm able.

[Xantherous]

Because of the issue with Characters not showing with expressions (I understand that's being worked on in Beta), I'm not able to test if a character blinking works.

May I make a suggestion? With each graphic file to be used in the animation, it would be convienent to select all or select one and allow for animation time manipulation from picture to picture (similar features as the animation portion of VNM).

[Archeia]

Originally posted by LibertyBell:

Because of the issue with Characters not showing with expressions (I understand that's being worked on in Beta), I'm not able to test if a character blinking works.

What do you mean not showing with characters? For blinking and talking here's how you can do it:
https://www.youtube.com/watch?v=gaIYvKNRXYI

[Xantherous]

Thanks for sharing the video. Hmm...I've tried it to a "T" everything you've shown with my own files as well as the samples. It doesn't work. Maybe because I have a WebM background? I don't know. The most I can get is a quick flash of my character if I'm lucky. I put it the same variables you had. Tried increasing them. Tried saving and returning to the screen. Nothing.

[MassMan]

Originally posted by LibertyBell:

Thanks for sharing the video. Hmm...I've tried it to a "T" everything you've shown with my own files as well as the samples. It doesn't work. Maybe because I have a WebM background? I don't know. The most I can get is a quick flash of my character if I'm lucky. I put it the same variables you had. Tried increasing them. Tried saving and returning to the screen. Nothing.

Blinking definitely works fine if you follow the tutorial "Expression Importer" in the Help section. Having a WebM background has nothing to do with it, check out my sample project with a blinking character and video backdrop:
https://youtu.be/6QNawr709Qk

[Xantherous]

What would cause my character to flash in but not stay on screen? I tried the ms varibles suggested. Tried using the "Expression Importer" directions as suggested.

This even happens with a brand new file. The "sample" works, but not my blank projects. I'm also working at 1080p.

Previews of where to position the character show the character, but the character won't show in scene preview or the play tests.

The only other odd thing that I'm doing with project is saving it on a drive different from the drive that holds this engine. Don't know if that's what impacting it.