HOME | DD
AddestorionVayanis — VMDSpectrum Tutorial
by
Published: 2011-12-08 18:57:51 +0000 UTC; Views: 29974; Favourites: 361; Downloads: 220
Redirect to original
Description
So i discovered that VMDSpectrum isnt really popular, so i'll try to re-introduce it to the english MMD community, since i already did it for MMDAgent addestorionvayanis.deviantart.… and ARToolkit_MMD addestorionvayanis.deviantart.…Introduction
-------------------------------------------------------
VMDSpectrum is a software which creates 'visualization' facial motion data based on .wav files. This can be used with pmd models made specifically to display the vmd motion data as some sort of media player visualization for use in MMD
---------------------------------------------------------
Download
---------------------------------------------------------
The download via niconicodouga is here (comes with a 15-band VMDSprectum .pmd model): www.nicovideo.jp/watch/sm59036…
If that doesnt work, try searching bowlroll: bowlroll.net/file/keyword/vmds… (link type updated on 15th january to correspond to the new way for bowlroll's search links)
---------------------------------------------------------
Start
----------------------------------------------------------
Models which do support these usually have facial bones which are usually named band1, band2, band3 and so on.
By my TRIAL AND ERROR, this is what i know of it:
Top left corner is the number of bands you want to create. Some models have less bands, so pick accordingly
Top right corner is the frame skip.
no frameskip means the motion updates every frame, giving the fastest response, but also reaches maximum motion commands sooner
Longer frameskip samples the motion at longer intervals, so you get a somewhat smoother transition of motion. I prefer skipping 2 frames.
Bottom left is the name of the band. Its generally (NAME) followed by (NUMBER) in case the model uses a different name, say... bar1,bar2,bar3....
you can just rename it at this menu so that it becomes bar1, bar2, bar3. Its default is 'band'
The warning box means you reached the maximum number of motions per model with that motion, and it will split it to multiple parts. Usually, picking large number of bands with very low frameskip will cause it to break up into more parts.
So, you'll need to use unique models for each of the motions.
Load the motion at the indicated starting frame. For the second motion, you insert it at the starting point (frame zero), but it wont begin until the 3000th frame (as shown above). Until the 3000th frame, you should hide that model, and show the model only at the 3000th frame, and hide the previous one so that it seems like a perfect transition.
Let the first model be on display until its motion runs out, then hide it, then display the next model so that you get the impression that it's a single seamless model.
Let it run, and be happy. lol
note:
the frequency band at the far end usually doesnt have much going on for it. If you still would like to make that end move, just select more bars than exists in the model (like... divide to 6 bars when the model only has about 4) so that all frequency bands get some attention.
----------------------------------------------------
To ModelMakers
----------------------------------------------------
It will also be possible for this to be used on things other than just bars or displays, so long as the model has an 'OTHER' facial expression which is named [something]1, [something]2, [something]3 and so on.
Which means... that if you somehow can program the visualizers on miku's skirt and arms to become facial expressions, it will be possible for the bars on miku's skirt to respond accordingly.
Or the visualizer on SeeU's costume
Or controlling parts of the model using facial expressions.
Or controlling strobe lights
Or controlling laser orientation and/or intensity and/or color
Possibilities are quite endless really.
----------------------------------------------------------
Usage
----------------------------------------------------------
the very first one i saw [ARToolkit_MMD Interstellar Flight] www.youtube.com/watch?v=W-gBRb… / www.nicovideo.jp/watch/sm10027…
the second one i saw www.nicovideo.jp/watch/sm59036…
videos made by me
ARToolkit_MMD secret garden - www.youtube.com/watch?v=yLaPU1…
SNSD Gee - www.youtube.com/watch?v=vFppK1…
UPDATE - 21/3/2013
Ula LAT's Rin Append's headphones actually have visualizers, which use 'sp' instead of 'band'. So if you save it as sp from 1-6, her headphones actually will give you visualizations.
----------------------------------------------------------
VMDSpectrum useful links
----------------------------------------------------------
RuchiiP
General sound bars tfmsetna.deviantart.com/art/So…
Electric Love Bars tfmsetna.deviantart.com/art/El…
Circular expanding - www.nicovideo.jp/watch/sm21167… [23nov2013]this one doesnt use vmdspectrum. it uses mouth facial motion data]
Related content
Comments: 219
btw also found out that it works with the PMX color sliders as well
this effect > www.youtube.com/watch?v=iH7SHc…
combined the facial with the color slider
👍: 0 ⏩: 1
it can work with anything really. So long as its a facial, it will work. If it is numbered properly, then it will work for multiple facials as well.
Some people have gone so far as to generate motion data out of this by using the core motion data. I prefer to use it in other ways
👍: 0 ⏩: 1
lol never seen that last bit if you have a link close by i would love to see it
👍: 0 ⏩: 0
i was planning on making single speakers with a facial for VMDspectrum for people to use on models
👍: 0 ⏩: 1
i never noticed ula lat rin append's speaker bars actually worked with vmdspectrum, among other things.
But odds are, speakers already exist, but i'm too lazy to search the internets for it. Unless you want to compile your own list or something.
👍: 0 ⏩: 1
meh to lazy for that kinda thing XD
👍: 0 ⏩: 0
This is very interesting! Thank you for this.
👍: 0 ⏩: 1
quite useful for adding eye candy to the background. Or else, it gets very very boring.
👍: 0 ⏩: 1
Yeah. I also love visualizations. I've always been facinated by them and wonder how they work.
👍: 0 ⏩: 1
probably just frequency analysis. Just sampling the amplitude of sound that occur at the different frequencies and then plot them out on a graphical form.
👍: 0 ⏩: 1
Hmm, interesting.
👍: 0 ⏩: 1
to me its no different than watching the windows media player visualizations. Not sure if you were from that era though.
👍: 0 ⏩: 1
Windows Media Player? Yeah, I love watching it. Other era... I don't know. XD
👍: 0 ⏩: 1
so, pretty much same tech i suppose.
have fun...
👍: 0 ⏩: 1
I will. Thank you!
👍: 0 ⏩: 0
Okay, I'm having a bit of an issue opening wav files, and I was wondering if you might be able to help. Every time I tried to import a song it gave me an error popup and then sent me back to the opening page. I checked around, and found out I had to change the bit rate to 16, so I did that, but for some reason it still gives me the error when I try and open the 16 bit file. Any suggestions?
👍: 0 ⏩: 1
the only other cause that i can think of is the wave format itself. My wave files are encoded as PCM uncompressed. I am unsure if using any other codec for the wave file will affect its output. Is there a way for you to check its codec? i want to eliminate this reason at least.
screenshot will help too. I can transcribe any japanese you see, so i can pinpoint the problem more accurately
👍: 0 ⏩: 1
Well, actually, like a after a few minutes after I posted my question, I started playing with it a bit myself and figures out the problem, turns out the file name was too long (the same problem shows up in PMD editor a lot, I feel sort of stupid for not thinking of it first) And Japanese isn't really an issue for me, I took two years of it in HS, and know of a couple online dictionaries that I use a lot lol But thanks for the help anyway, oh, and for the tutorial
👍: 0 ⏩: 1
hmmm. never encountered that before. Will run an update together with anything useful which pops up if your comment goes too far down below.
Japanese however is an issue for me. i'm kind of stuck transcribing stuff using microsoft IME. Been using that to decipher passwords which were embedded into niconicodouga videos to unlock models.
👍: 0 ⏩: 1
Yeah, I just changed "Cyber Thunder Cider" to "CTC" and it opened fine
Well, if you want a good online dictionary, here's a link to the one I use a lot: jisho.org/
👍: 0 ⏩: 1
i got old school dictionaries, but i usually need to know what the word sounds like before i can look it up.
ohwell. have fun with it.
👍: 0 ⏩: 0
This is cool, I'll put it to my favorite list for my study
👍: 0 ⏩: 1
When I try to open a .wav file, an error comes up and it goes back to the starting screen of the program >w<
Help?
👍: 0 ⏩: 1
lucky you, i just encountered this problem.
answer: bit depth.
It will malfunction at 24 bit depth, but works on 16)
(the wave file will still play on mikumikudance, so you wont suspect anything is wrong with the wave file itself)
solution: reencode the wav file to a bit depth of 16 (approx 1411 kbps)
then it should behave.
👍: 0 ⏩: 1
Thanks!
How do I do that? XD
👍: 0 ⏩: 1
for free, i use a conversion program named 'super' by a website named 'eRightSoft' (googling the two terms should get you the web)
but the downloading may be confusing. I leave that to you.
Its essentially a convertor program which claims to be able to convert anything thrown at it.
👍: 0 ⏩: 1
Thanks, but I found another one ([link] which works.
But thanks for helping with that.
(and for the tutorial)
👍: 0 ⏩: 1
Here are what some of the other controls do:
1/. Check box above the -30: When unchecked it allows you to change the decibel range to which the program reacts. By default this is -30dB to 10dB. The default values are average and should work in most instances. You only really need to change these if the music is especially loud or quiet. The net effect is that changing these values affects how sensitive the program reacts to a given wav file.
2/. The next check box when unchecked reverses the output value. The default reads from 0.0 - 1.0, when unchecked this becomes 1.0 - 0.0. This reverses the behaviour of the facials. Most bar models are built with the facials starting at 0.0 and is at it's full extent the value is 1.0. So this will be useful for bar models built in reverse (which arguably is easier to do).
3/. The next check box changes the type of curve the program uses. This is either a logarithmic curve (default/checked) or a non-logarithmic curve (unchecked = a straight line). The latter setting probably outputs a cruder rendition.
4/. Last checkbox (far right) - unknown
Sub-panel on the bottom right - these controls effects the way the program outputs the VMD file. Not absolutely sure exactly how these work, so probably best to leave them alone. What I think they do is to control how the program chops up data (frames) and apparently this also affects the number of output files for a given wav file. These also has an effect on the filename (see below).
Sample filenames (for the output from one wav file):
test_0_7497.vmd
test_7500_12645.vmd
This wav file resulted in two vmd files. The filename system works as follows:
[filename (this is what you input when you save)] + [start frame] + [end frame]
So this means that:
- the first file plays from frame 0-7497
- the second file continues from frame 7500-12645
This makes it easy to know when to turn on and turn off models. So ...
- model 1 is displayed from frame 0-7500
- model 2 is displayed from frame 7500-12645
Hope this helps.
👍: 0 ⏩: 2
cool.
was halfway translating it, but microsoft IME wasnt helping with the lower right corner. I can make out absolute frame and relative frame, but that was about it. Will append the tutorial if your comment gets too far down
👍: 0 ⏩: 1
I think I got item 2 backwards. The default is "unchecked". Life would be so much easier if just only the interface itself was labeled in English.
👍: 0 ⏩: 1
still... stuff like this tends to give me the same thrill as playing a Touhou game.
I have no idea what i'm doing, but i'm not stopping until i know what i do
👍: 0 ⏩: 1
True, I've learnt a lot since I picked up MMD.
👍: 0 ⏩: 1
as for me, i just picked up a kinect and started hooking it up to MMD. Now thinking about what else i can use it with.
I also had to learn metasequoia for some pretty basic stuff. But nothing makes you learn large amounts of stuff like a deadline can...
👍: 0 ⏩: 1
I love to hear anything you discover about the kinect system. I haven't looked into it all, especially since I do my MMD work on an old SONY VAIO laptop that still running Windows XP. It won't support any particle effects or even auto-luminous.
👍: 0 ⏩: 1
i currently forward my discoveries to this deviation:
[link]
seeing how a tutorial already exists, i just send my discoveries there. lol
👍: 0 ⏩: 1
Faved for future reference - seriously, you are THE BEST when it comes to technical information for MMD in the DA MMDC.
👍: 0 ⏩: 1
nah. there are others as well.
but i prefer a scientific documentation method when posting a tutorial.
👍: 0 ⏩: 0
I forgot to mention - all the VMD files should be loaded at frame 0 as of version 0.0.0.2
👍: 0 ⏩: 0
i finally found this program... i've been wondering and doing such a wasteful thing by doing it manually... playing with the bars and synch-ing it with the wav (manually)... that's super depressing...
anyway, thanks for this tutorial... it's really helpful...
👍: 0 ⏩: 1
Ula LAT rin's headphones also have bars. but they use the prefix sp instead of band.
i didnt know until just recently. lol
👍: 0 ⏩: 1
oh thanks for telling me... actually, a headphone spectrum feature isn't that useful to me since i'm just making a normal mmd videos... i'm just playing with camera and environment... UNLESS if i want to make a real mmd "PV" and planning to submit my vids to enter the contest...
well, i did thought about making an mmd PV since months ago but its really hard to make my own motion... moreover, i'm somehow lack of inspirations...
they said it was easy to make a PV since you don't have to focus on motions or dance, but still... i totally lack of inspirations... lol...
anyway, thanks... i'll try using ula lat rin on my next mmd vids... i have one song i haven't used for my mmd... hopefully, i can put its headphone spectrum feature to the fullest...
👍: 0 ⏩: 1
nahh. not really required.
But for PVs, you have the ability to just play with the camera.
The original PVs for Sadistic Love, Melancholic and Twinkle twinkle just had moving backgrounds, so it can very very easy, or you can make yourself suffer for slightly more awesome
👍: 0 ⏩: 1
well~... i perceived PV as AMV... and it doesn't emphasize the dance motion too much... (like the original PV of Melody Line) but as for making AMV itself, it requires inspirations, camera play, matching backgrounds/stages, and the most important thing in making video... timing... since i'm lack of inspirations, i only can play with the camera... lol...
👍: 0 ⏩: 1
even with the camera alone, its possible to do quite a lot.
my current works deal almost exclusively with the camera and some random modelling.
👍: 0 ⏩: 1
yeah... but for me, it doesn't enough if its just camera... just like i described above... a good PV should be contains that elements (according to my own standards)... its differ for everyone, so i couldn't force my opinion... after all, i'm just a newbie and still learning... ahahaha...
👍: 0 ⏩: 1
| Next =>