HOME | DD

Piri-tanyay In reply to amethyst3551 [2013-01-21 18:43:42 +0000 UTC]

Find the spot with the lip motion. If it's in a division of similar parts, open it up. the one you need should be the dot in white.

👍: 0 ⏩: 0

MrGumi In reply to xXRandomHetaliaFanXx [2012-06-15 21:54:57 +0000 UTC]

Adobe Audition would probably work - I used it when it was still Cool Edit Pro - I still use it for trimming audio and doing fades.

I never used it in multitrack mode but as long as you can produce a version of the wav file that has mostly Beeps (the timing track) and Boops (the syllable track it should work fine. I'd bet my last pair of underwear that it will work fine

Good luck and let me know if this works - does the tutorial make sense??

👍: 0 ⏩: 1

xXRandomHetaliaFanXx In reply to MrGumi [2012-06-17 20:11:30 +0000 UTC]

Thank you~! I use Adobe Audition for a lot of things and I really don't want to learn how to use another program!

I'll be sure to let you know. And it does make sense!

Oh, I remember reading somewhere that to lip sync it better (If the song is in Japanese... I don't know if it will work for English) you can use the different mouth things. Like, in "Wide Knowlege of the Late, Madness" Miku sings watashi a lot, so you could use the "a" mouth, "a" again, and then "i"... if that makes any sense

👍: 0 ⏩: 1

MrGumi In reply to xXRandomHetaliaFanXx [2012-06-20 07:41:17 +0000 UTC]

Yeah it does make sense - I suspect most people just go crazy trying to get the motion hapening in the right space - I don't worry too much about the different mouth shapes - I just fix the ones that look wrong!

Good luck on this!

👍: 0 ⏩: 1

xXRandomHetaliaFanXx In reply to MrGumi [2012-06-21 19:15:35 +0000 UTC]

Oh, yay~! I wasn't blabbering gibberish~! That happens a lot, acutally... I know what you mean, about going crazy. I don't know what happend to my microphone so I haven't been able to try this yet, but it would get annoying if there is one mouth movement and, like, 3 syllabes. XD Y'know, it seems that you could get away with just using the a mouth shape with singing, but talking... it would be annoying to watch Miku or someone talk to the camera and she looks like she's saying "ba ba ba" or something XD

Thank you~! LOL I'm working on a MMD video right now and if you want I can link you to it~~~

👍: 0 ⏩: 1

MrGumi In reply to xXRandomHetaliaFanXx [2012-06-22 08:51:23 +0000 UTC]

Actually I was surprised how well my brain accepted using the same mouth shape over and over. I figured I would do that and just fix the ones that looked stupid afterwards. I didn't need to do that - if I were doing something that focused on the models mouth I would.

It is kinda Clutch Cargo

One last thing - I use something that's like 75% open for the open event and the second event (the one at the end of the syllable) I use a 50% open mouth followed by the close. This creates changing mouth motion during the syllable and it looks better.

👍: 0 ⏩: 1

xXRandomHetaliaFanXx In reply to MrGumi [2012-06-23 04:07:05 +0000 UTC]

Yeah...

Wait, what's Clutch Cargo?

Ooh... *tries it* that looks a lot better~! I've been making random mouth motion today... I need to find something better to do with my time

👍: 0 ⏩: 1

MrGumi In reply to xXRandomHetaliaFanXx [2012-06-25 09:14:26 +0000 UTC]

A real old cheesy animation series that was known for taking shortcuts.

They would have backgrounds that repeated every 3 seconds, "BAP BAP BAP" lip movements like mine.

They would even write scripts with the characters facing away from the "camera" while having a dialogue so they didn't have to animate the face frames.

It was monumentally cheesy.

👍: 0 ⏩: 1

xXRandomHetaliaFanXx In reply to MrGumi [2012-06-25 18:06:48 +0000 UTC]

LOL Really? That's hilarous~! I kinda want to watch it now... if only to make fun of it. What was the plot like? (action, romance, etc.) Was it any good?

...........

I feel like I'm asking to many questions...

👍: 0 ⏩: 1

MrGumi In reply to xXRandomHetaliaFanXx [2012-07-05 20:10:59 +0000 UTC]

That's the only reason to watch Clutch Cargo

They were pioneers of some kinda weird "insert video of mouth movements" failed technology

the animation is so ghastly that you can't focus enough to follow the storyline - which is almost as bad as the animation.

Enjoy!

[link]

👍: 0 ⏩: 1

xXRandomHetaliaFanXx In reply to MrGumi [2012-07-05 20:46:55 +0000 UTC]

Pfft, that has to be the funniest thing I've ever seen!! It's so horrible!

Haha, the Annoying Orange uses that weird video thing too!

👍: 0 ⏩: 0

MrGumi In reply to zx2011 [2012-06-15 16:17:19 +0000 UTC]

I did a quick look at the Sonic Foundry feature set and I think it should work fine.

If you can import the original sound track and then record the "boop track" (for syncing lips) after the fact and then have a way of mixing the relative volumes of the two tracks to produce a new master that mostly only has the boop track output you have everything you need.

It really does work like a piece of cake.

I should note that you should pick an intermediate open mouth event (no square mouth stuff) and set it about 3/4 open. The close mouth event should be the same event set about 1/2 open (followed by the completely closed mouth a frame later)

This produces some movement of the mouth during a syllable that is held for a while which looks more realistic.

Hope this helps - it is really cool to have the lips work in sync all the way through the song without the brain numbing editing that happens when you just have to listen to the original audio track.

👍: 0 ⏩: 1

zx2011 In reply to MrGumi [2012-06-15 16:28:45 +0000 UTC]

Ahhh, I see. Thank you for your quick reply

I'm still learning on editing the .wav files like I said in my comment earlier. But I will do my best to learn. Thank you, this will help me a lot on editing a sound / music so it will sync well in the process.

Btw, this is my first video on syncing with the lips, it's not perfect though, I did what I could to sync it [link]

And I need your opinion on this video. If you think it's already good enough / far from perfect sync, please tell me, so I can do more on editing. Again, thank you

👍: 0 ⏩: 1

MrGumi In reply to zx2011 [2012-06-15 17:05:32 +0000 UTC]

I love the original Magnet on so many levels.

The dance motion you used is pretty good.

The lip sync could be vastly improved with my process - you should try it and see.

Once you get that working (and it really does only take an hour or so once you get the Boop track) you will probably want to update the camera file so it shows their faces (I suspect it doesn't show faces cuz the motion file isn't good there)

I actually have a pretty good process for building a camera track that I like - not perfect yet but I'm getting there. I think the camera track is the most straightforward and useful set of edits you can do - but that's another post.

Don't modify the wave to fit the lip movement - go the other way (cleanest is to delete all the lip movement and start over)

If you get the lip sync working well (and you have the tools to do it) I think you will really really like this vid) I think it's a great start! If you could send me a link to the Magnet motion data that would be cool - it's the best I've seen outside of the original which is mesmerizing!

Hope this helps!

👍: 0 ⏩: 1

zx2011 In reply to MrGumi [2012-06-15 17:27:49 +0000 UTC]

You mean the original magnet miku and luka at the live concert? If that's what you meant, then yes, I love that dance too ^^. It's original, and of course the original songs too ^^.

This magnet motion data I have already have a lip sync movement when I load it on my model. So, when I use the motion data and the wave files, at first, it wasn't sync at all. So I do a little edit on the wave file by cutting the silence. And when I play it, if it's already sync enough, I live it as that.

So you mean I have to delete the lip frame and re-do it from the start? And play .wav with frame? Hmm, that could be challenge a for me. Thank you. Oh, as for camera motion, I think I can make one, I'm still learning on how to do a camera motion, but I think I can get the hang of it. I also notice the camera motion in my video isn't showing the face of my model. That's because they are tall, so I didn't modified the camera motion T^T.

And as for the motion, I think I still have the link...
Here it is [link]
The link for the motion download and the password is in the description.

👍: 0 ⏩: 1

MrGumi In reply to zx2011 [2012-06-15 18:00:29 +0000 UTC]

Open up yer project and then save it in a new folder (my_song_working)

That way anything you do won't screw up yer existing work.

If the dance motion syncs well with the audio file you are using don't edit the audio any furthur. But use the same audio file as the base for the Original, Beep and Boop tracks - that way when you are done doing the lip edits and replace the song it will line up cuz they start in the same place.

Make the boop file and save it as mysong_boop.wave

when you load my_song_working load the boop file version. You don't have to set it to play wave with frame cuz all you need are the visual cues, but you do have to load it so you can see the boops.

Yes delete all the lip motion - just do it with one model first. In Magnet - since there are two models you will have to keep them straight.

Then just register the shut mouth/open mouth events at the beginning of every syllable and the halfopen mouth/closed mouth events at the end of each syllable. just copy the open mouth event and go down the song and paste it everywhere a syllable starts. Then copy the close file event and paste it everywhere the syllable ends - that whole process takes 15 minutes. And it works really well - almost no thinking at all!

Do about a minute of the song first and see where exactly to do the paste events (right on the frame or whatever) I do the open mouth events so the second movement (the open mouth) happens right at the begining of the waveform. If the boop doesn't line up precisely with the frame - choose the earlier frame so the mouth opens early - that looks better.

keep editing and saving mysong_working pmd until you like it before you save it as the final version.

On camera motion - (not that I'm an expert ) what works for me is to do the whole song with a series of pans that are medium range - keep the speed of motion relatively constant.
Doesn't really matter where - just try to find interesting angles that keep everything in sight. Keep the transition points kinda random and away from the beats.

Then I go over it looking for interesting close ups- I tend to zoom in where something interesting is happening and do these edits closer to the beats

This also gives you the option of not looking at models when they are booring.

While I'm still learning once you see this is how I do it - you can watch my vids on YouTube and see that approach is carried out.

Those edits aren't perfect but overall I like the results

And with Gumi - anytime there is nothing cool to show you can always show her from behind

Hope this helps

👍: 0 ⏩: 1

zx2011 In reply to MrGumi [2012-06-15 18:14:20 +0000 UTC]

Thank you , this will help me a lot for my study

"And with Gumi - anytime there is nothing cool to show you can always show her from behind" -> LOL , I kinda like you sentence there

👍: 0 ⏩: 1

MrGumi In reply to zx2011 [2012-06-15 22:42:03 +0000 UTC]

I know - Gumi-B is cool fer sure.

I got hooked watching Luka the first time in Just Be Friend in the Giving 39's show.

I said this is pretty cool - and was moderately mesmerized by Lukas left thigh.

Then they did this wiggle at 1:12 and again at 1:26 and I thought "OMG - they got this right!"

I just love the vision and creativity of the whole thing - it's the perfect union of music and technology and art.

👍: 0 ⏩: 0