HOME | DD

Description
In the same vein as the Artoolkit_MMD tutorial [link] , the following is what I currently know about MMDAgent Voice Recognition software developed by the Nagoya Institute of Technology

Other tutorial links (VMDSpectrum [link] )

NOTICE - 5 September 2012
This tutorial may be out of date compared to MMDAgent 1.3 which was released last august. I am having issues changing all my commands to suit the newer version, so i am still using a backdated version. However, the sample.fst and .mdf files do have some pointers on what the slight alterations are.

MMDAgent
A speech recognition program developed by the Nagoya Institute of Technology using a variety of open source software, namely the OpenJTalk voice synthesizer, Julius voice recognition and MikuMikudance 3D rendering program.
Nico-nico douga - [link]

This is roughly what it would look like and what you could do with it: (this is after my edits)
[link]
summary of things you can do with it:
- have her respond to your vocal commands
- have all your motion datas and wave files on standby
- drag and drop models, even while halfway dancing
- can detect certain keyboard commands to replace vocal commands.

This is how i usually use MMDAgent to proofcheck models that i download from here.
[link]

-------------------------------------------------------------------------
Downloading
1. Go to [link]
2. Download the MMDAgent binary package for 32 bit windows
3. Download the Sample Script Binary Package
4. Unzip both files

Executing
1. The binary package for 32 bit windows has a .exe file named mmdagent.exe
2. The Sample Script Binary Package has a file named MMDAgent_Example.mdf
3. To run it, you need to drag the MMDAgent_Example.mdf and drop it onto the MMDAgent.exe icon. (you can’t run mmdagent.exe first, and then drag and drop the mmdagent_example.mdf onto it. Nothing happens)
4. A window should appear with a model named mei.
5. To make things run faster, you could just right click the .mdf file and set it to always open with mmdagent.exe. Doing so will enable you to just doubleclick the .mdf and it will load up in mmdagent.exe.

Usage
1. The default sample script responds to very limited words. This is a list of [command] – (response) - - {additional notes}
a. [konnichiwa] – (konnichiwa) -
b. [sayonara/bai bai] – (sayonara) -
c. [homupeji] – (MMDAgent no, hōmupēji o hyōji shimasu) - d. [Furusukurīn] – (Sukurīn no settei o, henkō shimashita) -
e. [toshokan] – (gives you directions to the library) -
f. [anata _ dare] – (self introduction of herself) - - {it doesn’t matter what you say in between anata and dare, but both words need to be said in the same sentence}
g. [Arigato] – (youre welcome, speak to me at any time) - - {notice a tone of voice shift between youre welcome and the second sentence. Demonstrates the different expressions available for use}
h. [kawaii/ kirei] – (Either says arigato or Hazukashiidesu using embarrassed tone) - - {demonstrates use of random numbers to vary responses}
2. Keyboard commands are available in the readme file included in the mmdagent32. Notable commands are:
a. lowercase d – toggles the full log. You will be able to see a transcript of what she thought you heard, and any actions she is undertaking.
b. Capital J – toggles the microphone input bar. The blue bar indicates current sound level, the white line indicates the sound detection treshhold and the orange line indicates speech detection. Use your control panel>>sound >>recording>>microphone to control the sensitivity of the microphone. If it is noisy, set it to lower values, but you’ll have to talk louder into the microphone. Adjust it until the ambient noise doesn’t cause the blue bar to exceed the white line.
c. lowercase l (elle, not eye) – toggles head looking at mouse. mei’s head will track your mouse.
d. capital F – toggles event/detection logs. These logs are to the right of mei (your right). You’ll have to rotate the view so you can see it.
e. Other commands are in the readme file.
3. if you drag and drop music files or mikumikudance .vmd files onto the mmdagent, it will play or run the motion. If the music file is in the same folder as a motion data (.vmd) file with the exact same name as the music file, both the motion data and music will play together.

Editing
1. The sample script has a file named mmdagent_example.fst.
2. By default it is not associated with a program, but you can open it in notepad.
3. You will be able to see its full programming, with instructions on how to program it, plus all events and actions which can be taken.
4. The codes are arranged neatly so that you will learn how to perform your own basic programming. Note that the symbol # means comment (whatever is written along that same line will not affect the code and is used just as a comment)
a. 0011-0020 – initial setup and loading of models
b. 0021-0030 – teaches you how to use timers and single loop motions
c. 0031-0040 – teaches you how to use simple voice recognition, speech synthesis and motion.
d. 0041-0050 – teaches you how to queue two or more speech sentences together using SYNTH_EVENT_STOP
e. 0051-0060 – teaches you how to use different voice types. They are; normal, angry, bashful, happy and sad (the folder names in MMDAGENT>>Voice)
f. 0061-0070 – teaches you how to use random numbers to varied responses. This is the basis of IF/THEN/ELSE type programming. The random number in question is the command line 23 (VALUE_SET|random|0|100)
g. 0071-0090 – Teaches you how to add, delete, load, add motion to and change motion of models.
h. 0091-0100 – similar to 0031-0040. No need to reexplain myself.
i. 0101-0110 – Teaches you how to run programs. Webpages will load in your default browser. Programs can be loaded if you provide the full path to it (C:folder1subfolder3whatever.exe). Note: there must be NO SPACEBARS in between the path or else it will not load. You could either:
i. delete any spacebars in the path {may cause programs to not work}
ii. change any spacebars to an underscore ( _ ) {may cause programs to not work}
iii. (recommended) create a shortcut to the program you want to run, and place it in a place where the path to the shortcut has no spacebars. The shortcut name must have no spacebars. Shortcuts have an ending file extension .lnk, so you will have to run it like this: C:folder1subfolder3whatever.exe.lnk
j. 0111-0120 – teaches you about issuing keyboard commands. For now, it can issue commands to mmdagent, but if you know whats a windows class type, you can use this program to issue keyboard commands to other programs as well. Mine is able to control my windows media player classic. Will post more info on this subtopic if response to this article is good.
5. You should be able to program a variety of commands

Other Notes:
1. .pmx files will not work
2. Some models which contain certain abnormal textures will also not work.
3. Whether or not mikumikueffect works or not has yet to be determined

WARNING
1. This girl is hot. Literally. Activating MMDAgent raises the temperature of my intel i5 core to 83 degrees celcius from its usual 60 celcius. The temperature drops almost immediately back to 60 degrees once I shut her off.
2. She’s also high maintenance. She also uses my GeForceGT420M graphics card to an average of 60 % of the GPU clock, making it hard to run any other graphics demanding program at the same time. The clock increases if you activate self shadow (lowercase x keyboard)
3. And she’s a gold digger. A fully charged battery on my laptop can last 90 minutes on average, but only 45 minutes if she’s constantly running (discharge rate of 2.5 Watthour on standard, 5.3 Watthour when she’s running)

I’ld write more, but I figure those who are interested in this will either figure it out eventually, or ask in the comments.

Currently, my programming of my MMDAgent can do the following:
1. Replaces NIT’s Mei with LAT Kagamine Rin Append when starting up
2. Has 20 .pmd models on standby, switchable either by voice command or keyboard key hit.
3. Can play and dance to 18 songs and dance motions on command
4. Loads most of my programs on command.
5. Loads most of my regular webpages on command
6. Loads ALL my regular webpages on a single command.
7. Can stop music and dance when halfway playing, either by voice command or keyboard hit
8. Can change models while dancing
9. Can load up videos and music playlists in media player class, and control Play/Pause, Next or Previous Track, Volume adjustment, and Quitting on command.
10. Can shut herself down on command
11. Can interrupt herself shutting down in case the shutdown command was given unintentionally.
12. And finally, she can counter most Japanese swearing words with more than just 1 or 2 responses.

Disclaimer:
as per the readme agreement in MMDAgent, the pictures used for this deviation is based on a personal edit of the MMDAgent and should not be confused with the base program which this tutorial is meant to clarify.

--------------------------------------------------------------------------------
Edit 3/10/2011
--------------------------------------------------------------------------------
I changed the file download to a .zip file containing my edited mmdagent_example.fst.
It is my personal edits to see my present code condition, and not the .fst file initially distributed with the sample_script zip file.
To use this file, just copy it over the .fst file in the sample_script folder and use as described above. You are advised to keep your own backup copy of your .fst file just in case.

you may use this for your own entertainment and such. No credits to me are required, although i would be very interested to hear about your own additions, discoveries and innovations that you may develop.

However, I will not be held responsible for any problems it may cause, nor am i obliged to ensure that it works. This is merely to be used as a suggestion on how to code. All other copyrights are in their respective copyright readme files.

[new version uploaded on 18/11/2011 highlighting Value_GET functions and how they are used]

------------------------------------------------------------------------
Update 8/10/2011
-------------------------------------------------------------------------
you can open up the .mdf file in notepad, and there are some initial settings which you can modify at will

notably, the parameter you want to probably reduce is the one named Bullet frames per second (Bullet fps)
The standard 120 frames per second puts a heavy toll on your graphics card. Reducing it down to 30 or so will significantly reduce this load. You're free to set it to any value which suits you.

--------------------------------------------------------
update 29/11/2012
---------------------------------------------------------

And because i have been testing way too many models as of late, a new deviation would just about sum up some of the working ones i've been testing. Therefore, some models from pretty serious modelmakers on deviantart are in order...

V3 From middle and clockwise,
~Xenosnake 's Cyber Lat Gear Miku [link] performing Interstellar Flight sm8568000 using a different stage model (credits still being sourced)
MSN-04 Char's Sazabi (sm8550675) performing Packaged (mylist25972080)
~JessHolysAngel 's Electric Love Miku [link] performing Electric Love sm14410247
Nanami's Kisaragi Chihaya (sm12140696) performing Little Match Girl (sm13952228)
~Hanaminasho 's Artistic Miku [link] showing the menu attaching itself to the center of the model regardless of how short it is (shadow problem self repaired)
LAT Heart Beats Miku (sm15355081), LAT Rin Append [link] and ~Mamama7028 schoolgirl project diva Miku showing multiple model functionality [warning: every extra model puts extra strain on your CPU and GPU]
~midnighthinata 's Daughter of Evil Rin [link] performing Romeo and Cinderella (with the event/action log activated)
*capriciously-calm 's Yellow LAT Miku [link] performing Yellow [link] with Bone detection activated
=Jjinomu 's Rolling Girl LAT Miku [link] performing Two Faced Lovers sm15356537 showing how some shiny effects still load in MMDagent, although not sure why some do not.
LAT Rin Append [link] displaying a little menu which i created from the Library menu model included in MMDAgent.

V2 Preview inside the zip file credits:
MSN-04 Char's Sazabi (sm8550675) performing Packaged (mylist25972080)
Lat Rin Append [link] performing Go My Way [link]
Nanami's Kisaragi Chihaya (sm12140696) performing Little Match Girl (sm13952228) [note: voice monitor turned off]
Saboten Sakura Miku [link] performing Disappearance of Hatsune Miku ([link] )
Kio Gothic Miku [link] performing Disappearance of Hatsune Miku [side logs activated (shift + f)]
~Xenosnake 's Cyber LAT Miku with Bits [link] showing the menu function i added (menu model edited from the library.pmd model in MMDAgent. [note: all event log turned off ]
LAT Heart Beats Miku (sm15355081), LAT Rin Append and ~Mamama7028 schoolgirl project diva Miku showing multiple model functionality [warning: every extra model puts extra strain on your CPU and GPU]

-----------------------------------------------------------------------------------------
update 13/11/2011
------------------------------------------------------------------------------------------
been browsing nico-nico douga
[link]
this guy apparently has also been tweaking MMDAgent, although in japanese.

However, his .fst file gave me one important piece of information: how VALUE_GET function works.

in non-programmerish how to use:
State1 State2 VALUE_GET|variablename
state 2 State3 VALUE_EVAL_GET|variablename|variablevalue3
state 2 State4 VALUE_EVAL_GET|variablename|variablevalue4
state 2 State5 VALUE_EVAL_GET|variablename|variablevalue5
state 2 State6 VALUE_EVAL_GET|variablename|variablevalue6
this replaces the extra long code i used to detect the value of the datas.

in iostream.h C++:
this is the switch x function.

Also, check out the readme file he included.
It has like, super loads of credits and references to models, stages and motion datas across nico-nico douga. Trying them out. lol

update 12/12/2011
.pmx files may not be able to be loaded directly, but convert the .pmx to .pmd files using PMDEditor and it will work okay. Generally.

-------------------------------------------------------------------------
List of tested models
-------------------------------------------------------------------------
Before we proceed, there are a list of problems i'ld like to abbreviate, explain and propose solutions to:

Ground Shadow problem (GS)
Description - There is a problem which causes ground and self shadows to not load
Cause - MA Ambient Line value set to less than 1 (no edge lines)
Solution - change the value of MA Ambient Line value to at least 1. This will load up the shadow properly in MMDAgent.
Solution Flaw - Sometimes however, this will reveal unsightly black blotches on the model, and currently i am thinking of how to solve this. If you are a modelmaker, your help would be much appreciated because i dont know crap about whats going on in PMDEditor. Worse to worse, turn as many MA bones as possible to 1. If a tested model is marked with GS, it will be followed by MA bones which should be skipped to avoid black blotches

Skirt Physics (SP)
Description - skirt or other parts have physics which cause it to move upwards.
Cause - The Physics (PH in PMDeditor) setting for the loc y coordinate is too high (about 7-10 is considered high)
Solution - change that value to a lower value (i set it to 3 so that its same as the Lat Miku White model)

Texture Not Loading (TNL)
Descriptions - Textures appear white in MMDagent, but work fine in MikuMikuDance/PMDEditor
Cause - Textures may be non-RGB colored (Indexed color)
Identifying cause - jpeg and BMP files cannot be index color and will always load. PNG and TGA files may be indexed color, so if you have to take a wild guess, start with the PNG and TGA files first.
Solution 1 (if you have a photo editing software) - Convert the texture image back to RGB from whatever it was.
Solution 2 (if you dont have a photo editing software) - Open the texture with Paint and save it as jpeg. Then use PMDEditor to make it use the jpeg file as the texture.

All YM_model type kaito, gakupo and hiyama kyoteru [link] - no problems

All Nakao mikus - works
All Yukiwane (ゆきはね) mikus [link] - works after PMX conversion

All Saboten Miku Models [link] - no problems

All LAT type miku, rin and tetos - (for LAT neru, see nico links below) [miku] [link] [teto] [link] [rin] [link] - the face MA does not have a line ambient value of 1. When you do set it to 1, black patches appear above. There is a way to fix it, which is:
Select only the face MA, select the vertices and mesh, then apply Edit>Outline>Average Apex with a very very small number, followed by Edit>Outline>Average. This however will reduce the maximum framerate that can be achieved by this model in MMDAgent.

Saboten Aoki Lapis - GS

Onto Deviantart modelmakers

~Mamama7028 [link]
Project Diva Miku [link] - no problems whatsoever
Project Diva Miku Chibi - [link] - no problems

~Xenosnake 's Cyber LAT Mikus [link] [link] [link] [link] - no problems whatsoever (may contain Kios, Nakaos, Pirons, CSs)

~SakuneUtau04 's Dancer Miku [link] - no problems whatsoever

=Kaida19th
SeeU version 3.0 - [link] - Seeu 3.0 and 3.0s will work fine. But the 2.5 version and Nio version - SP
Meltdown Rin take 2 - [link] - no problems
Saihate Miku - [link] - a part of her jacket is permanently pointed upwards. Solution: use the PMDViewer to select and delete the bones attached to her jacket, but dont seem to be a part of the IK bones. (using the bone menu wont work, you have to use your mouse to do this)

*capriciously-calm 's Yellow LAT Miku [link] - no problems

~daybreak123
Saihate Hatsune and Zatsune Miku [link] : GS - MA8
Rockish punkish miku - [link] - no problems
Rolling Girl (Diva Extend type) - [link] - no problems
Joker LAT Miku - [link] - GS - MA 4, 6, 12 and 15. You may also want to delete the mesh for MA18 (fangs). Then it loads up without problems

~kurumi13 's Neko Miku v2 [link] - GS - MA MA4,11,16,17,18,19, 23,27,28,29,30,31,32 (most of them are extra facial effects)
Notably, this is among the few models with special features which dont crash MMDAgent (the other being the xenosnake models). Even her tail's physics work. Figuring out why.

~JessHolysAngel 's Electric Love, Melody Line and Sweet Devil mikus [link] - no problems whatsoever

*RavenUzuki-Chan
Punk Miku, Rin, Teto [link] - Miku and Teto - no problems. Rin - GS - MA6, 12, 24 and 33. Additionally, rin has a glasses positioning problem.

~YamiSweet :
Kokoro Rin - [link] - no problems
Rock Luka Kio type - [link] - GS

~midnighthinata
Untouchable miku [link] - Advised to use the version without wing physics. For the model with the wing physics enabled, the wings just fall to oblivion, never to be seen again. The same applies to ARToolkit_MMD
Victorian style Miku, Neru, Teto [link] , [link] , [link] . - no problems
Eager Love Revenge Lat miku [link] , - no problems
sweet lolita LAT miku [link] - no problems
Daughter of Evil and World is Mine Rin [link] [link] - no problems

~Hanaminasho
Artistic Miku [link] - GS and TNL
Snow Miku [link] - crashes
Bride Animasa Miku [link] - no problems at all
Dreamy Theather type Luka [link] - GS

~TwilightAnimeLife 's Tonio model - [link] - crashes

=Jjinomu
Rolling Girl LAT Miku [link] - no problems in MMDAgent. Shininess effect doesnt load in ARToolkit_MMD
LAT Len [link] - no problems
Meltdown Rin - [link] - TNL
Little Red Riding Miku (limited time)- [link] - TNL

*SachiShirakawa
cantarella kaito and miku version 2 [link] - no noticable problems
Kon version 2 [link] - GS
Kimono Luka [link] - GS - change Line Ambient vakue to 1 for all except MA9, 12 and 13

~DG-H
DT Append Miku [link] - crashes. May be a non-standard bone problem. Loads normally in ARToolkit_MMD though.

~Haruhi-chan4ever 's Space Miku [link] - GS

~L3nkun 's SeeU version 1.5 - [link] - GS

*shadoouge
Sekiranun Graffiti Miku [link] - her chest appears brighter than every other part of the model for some reason. Fix: change all MA diffusions set at 0.8 to 1. Shirt also has a noticeable texture change. Fix: change the texture for MA5, 6 and 7 from 4,5 and 4.bmp to 6.bmp.
Snow LAT Miku [link] - no problems

=kogaan
Kagamine Len LAT type - [link] - no problems

=kogaan 's LAT Kagamine Len - [link] - no problems

*VocaloidAddict922
Sega Meltdown Rin - [link] - ground shadow problem requires complicated fix with some tradeoffs, but can work in MMDAgent. Awaiting creator's response.

~Bloodobsessed
Disappearance LAT Rin - [link] - GS - MA28, 29 and 45.
Disappearance Miku - [link] - no problems

~Alelokk
DT Disappearance Miku ~Hanaminasho collab - [link] - crashes MMDAgent, but will load in ARToolkit_MMD. ARToolkit_MMD reveals no ground shadow, so apply the fix below and it should have shadows even in ARToolkit. Source of crash still being assessed

~Ame-Yuki 's Formal Dress LAT Miku [link] - no problems. This model loads up the shininess effect in both MMDAgent and ARToolkit_MMD

=ZiiiChan 's Rolling Girl Miku [link] - change v_nor.png to RGB and delete 01.spa association to MA15, then everything loads fine.

~Kanahiko-chan 's Beach PD Len [link] - GS

~YellowDesuCake 's Conflict Miku [link] - no problems

~iiRichie 's Summer Miku [link] - GS. Delete all MAs which use t005.spa for it to work in ARToolkit_MMD

~SatariaMityo 's Monochrome sky LAT miku [link] - no problems

Kio Gothic Miku [link] (新キオ式ミクゴス衣装) - no problems

Masisi's Chihaya Kisaragi models - [link] - no problems

Obtained via Niconicodouga or Youtube

sm8550675 - Sazabi model - no problems
sm9965772 - Rockman zero model - no problems
sm13567741 - Piron Miku Maid models - no problems
Project Diva Snow miku - [link] - crashes
sm13824038 - 'Gosick' miku (password required) [officially discontinued. Dont bother asking me for it, i abide strictly by author's rules]
sm11360016 - petite miku - SP & (model with groove bones (Grv) causes it to crash)
sm15355081 - Heart Beats miku - no problems
sm14113395 - LAT type Neru - white, normal and black school uniforms no problem. White school uniform crashes
sm14475754 - Aoi Tori Kisaragi Chihaya - hair physics makes it defy gravity (video merely links to the download account, does not actually show the model in question)
TheAnimeLover40's Standard Rin - [link] - no problems
sm14913870 - Kyun Vampire Girl LAT Miku - PMX model - conversion to pmd required. Works normally once in PMD form.

-------------------------------------------------------------------------+++++
Current crazy ideas
-------------------------------------------------------------------------+++++
In theory, the following two projects are possible, though both of them will be extremely long because of the sheer number of keyboard detection and the inability of MMDAgent to do simple math:

Project Diva within MMDAgent - using timers and keyboard inputs, it will be possible to have a rhythm game inside MMDAgent, possibly using new models and motion data. However, detecting the time will be the single hardest part, and it gets longer and tougher depending on how many 'keys' you want to key in for a song. (World is Mine has 383 keys)

Raising Simulation - after going through some of the base ideas behind Idolmaster, it may be possible to program MMDAgent to randomly behave and evolve according to some code. The code would probably use 'emotion' variables, and its up to you to balance out these variables, decide what factors influence them, and work out scenarios on how she'ld respond to all of them. It would be a potentially endless code, even if you dont expect her to retain her personality across your usage of the program.

The ideas mentioned above are not easy one bit. It may be simple in concept, but the implementation will be brutal. If you do choose to pursue such projects, i either recommend you to program it in a simpler programming language like Warcraft Map Editor or C++. If it cant work there, dont even think about trying it with MMDAgent.
Since we now know how VALUE_GET works, it may be a lot simpler and faster compared to what i had to use before

-------------------------------------------------------------------------
References:
-------------------------------------------------------------------------
MMDAgent homepage - [link]

The wiki of MMDagent. Note that its in japanese. Google translate it if you have to: [link]

Google translate - [link]
VocaloidOtaku.net MMDAgent specific thread - [link]
Mikuchan.org MMDAgent specific thread - [link]
LAT Kagamine Rin Append Module - [link]

got a youtube video up for starters - [link]

Description
In the same vein as the Artoolkit_MMD tutorial [link] , the following is what I currently know about MMDAgent Voice Recognition software developed by the Nagoya Institute of Technology

Other tutorial links (VMDSpectrum [link] )

NOTICE - 5 September 2012
This tutorial may be out of date compared to MMDAgent 1.3 which was released last august. I am having issues changing all my commands to suit the newer version, so i am still using a backdated version. However, the sample.fst and .mdf files do have some pointers on what the slight alterations are.

MMDAgent
A speech recognition program developed by the Nagoya Institute of Technology using a variety of open source software, namely the OpenJTalk voice synthesizer, Julius voice recognition and MikuMikudance 3D rendering program.
Nico-nico douga - [link]

This is roughly what it would look like and what you could do with it: (this is after my edits)
[link]
summary of things you can do with it:
- have her respond to your vocal commands
- have all your motion datas and wave files on standby
- drag and drop models, even while halfway dancing
- can detect certain keyboard commands to replace vocal commands.

This is how i usually use MMDAgent to proofcheck models that i download from here.
[link]

-------------------------------------------------------------------------
Downloading
1. Go to [link]
2. Download the MMDAgent binary package for 32 bit windows
3. Download the Sample Script Binary Package
4. Unzip both files

Executing
1. The binary package for 32 bit windows has a .exe file named mmdagent.exe
2. The Sample Script Binary Package has a file named MMDAgent_Example.mdf
3. To run it, you need to drag the MMDAgent_Example.mdf and drop it onto the MMDAgent.exe icon. (you can’t run mmdagent.exe first, and then drag and drop the mmdagent_example.mdf onto it. Nothing happens)
4. A window should appear with a model named mei.
5. To make things run faster, you could just right click the .mdf file and set it to always open with mmdagent.exe. Doing so will enable you to just doubleclick the .mdf and it will load up in mmdagent.exe.

Usage
1. The default sample script responds to very limited words. This is a list of [command] – (response) - - {additional notes}
a. [konnichiwa] – (konnichiwa) -
b. [sayonara/bai bai] – (sayonara) -
c. [homupeji] – (MMDAgent no, hōmupēji o hyōji shimasu) - d. [Furusukurīn] – (Sukurīn no settei o, henkō shimashita) -
e. [toshokan] – (gives you directions to the library) -
f. [anata _ dare] – (self introduction of herself) - - {it doesn’t matter what you say in between anata and dare, but both words need to be said in the same sentence}
g. [Arigato] – (youre welcome, speak to me at any time) - - {notice a tone of voice shift between youre welcome and the second sentence. Demonstrates the different expressions available for use}
h. [kawaii/ kirei] – (Either says arigato or Hazukashiidesu using embarrassed tone) - - {demonstrates use of random numbers to vary responses}
2. Keyboard commands are available in the readme file included in the mmdagent32. Notable commands are:
a. lowercase d – toggles the full log. You will be able to see a transcript of what she thought you heard, and any actions she is undertaking.
b. Capital J – toggles the microphone input bar. The blue bar indicates current sound level, the white line indicates the sound detection treshhold and the orange line indicates speech detection. Use your control panel>>sound >>recording>>microphone to control the sensitivity of the microphone. If it is noisy, set it to lower values, but you’ll have to talk louder into the microphone. Adjust it until the ambient noise doesn’t cause the blue bar to exceed the white line.
c. lowercase l (elle, not eye) – toggles head looking at mouse. mei’s head will track your mouse.
d. capital F – toggles event/detection logs. These logs are to the right of mei (your right). You’ll have to rotate the view so you can see it.
e. Other commands are in the readme file.
3. if you drag and drop music files or mikumikudance .vmd files onto the mmdagent, it will play or run the motion. If the music file is in the same folder as a motion data (.vmd) file with the exact same name as the music file, both the motion data and music will play together.

Editing
1. The sample script has a file named mmdagent_example.fst.
2. By default it is not associated with a program, but you can open it in notepad.
3. You will be able to see its full programming, with instructions on how to program it, plus all events and actions which can be taken.
4. The codes are arranged neatly so that you will learn how to perform your own basic programming. Note that the symbol # means comment (whatever is written along that same line will not affect the code and is used just as a comment)
a. 0011-0020 – initial setup and loading of models
b. 0021-0030 – teaches you how to use timers and single loop motions
c. 0031-0040 – teaches you how to use simple voice recognition, speech synthesis and motion.
d. 0041-0050 – teaches you how to queue two or more speech sentences together using SYNTH_EVENT_STOP
e. 0051-0060 – teaches you how to use different voice types. They are; normal, angry, bashful, happy and sad (the folder names in MMDAGENT>>Voice)
f. 0061-0070 – teaches you how to use random numbers to varied responses. This is the basis of IF/THEN/ELSE type programming. The random number in question is the command line 23 (VALUE_SET|random|0|100)
g. 0071-0090 – Teaches you how to add, delete, load, add motion to and change motion of models.
h. 0091-0100 – similar to 0031-0040. No need to reexplain myself.
i. 0101-0110 – Teaches you how to run programs. Webpages will load in your default browser. Programs can be loaded if you provide the full path to it (C:folder1subfolder3whatever.exe). Note: there must be NO SPACEBARS in between the path or else it will not load. You could either:
i. delete any spacebars in the path {may cause programs to not work}
ii. change any spacebars to an underscore ( _ ) {may cause programs to not work}
iii. (recommended) create a shortcut to the program you want to run, and place it in a place where the path to the shortcut has no spacebars. The shortcut name must have no spacebars. Shortcuts have an ending file extension .lnk, so you will have to run it like this: C:folder1subfolder3whatever.exe.lnk
j. 0111-0120 – teaches you about issuing keyboard commands. For now, it can issue commands to mmdagent, but if you know whats a windows class type, you can use this program to issue keyboard commands to other programs as well. Mine is able to control my windows media player classic. Will post more info on this subtopic if response to this article is good.
5. You should be able to program a variety of commands

Other Notes:
1. .pmx files will not work
2. Some models which contain certain abnormal textures will also not work.
3. Whether or not mikumikueffect works or not has yet to be determined

WARNING
1. This girl is hot. Literally. Activating MMDAgent raises the temperature of my intel i5 core to 83 degrees celcius from its usual 60 celcius. The temperature drops almost immediately back to 60 degrees once I shut her off.
2. She’s also high maintenance. She also uses my GeForceGT420M graphics card to an average of 60 % of the GPU clock, making it hard to run any other graphics demanding program at the same time. The clock increases if you activate self shadow (lowercase x keyboard)
3. And she’s a gold digger. A fully charged battery on my laptop can last 90 minutes on average, but only 45 minutes if she’s constantly running (discharge rate of 2.5 Watthour on standard, 5.3 Watthour when she’s running)

I’ld write more, but I figure those who are interested in this will either figure it out eventually, or ask in the comments.

Currently, my programming of my MMDAgent can do the following:
1. Replaces NIT’s Mei with LAT Kagamine Rin Append when starting up
2. Has 20 .pmd models on standby, switchable either by voice command or keyboard key hit.
3. Can play and dance to 18 songs and dance motions on command
4. Loads most of my programs on command.
5. Loads most of my regular webpages on command
6. Loads ALL my regular webpages on a single command.
7. Can stop music and dance when halfway playing, either by voice command or keyboard hit
8. Can change models while dancing
9. Can load up videos and music playlists in media player class, and control Play/Pause, Next or Previous Track, Volume adjustment, and Quitting on command.
10. Can shut herself down on command
11. Can interrupt herself shutting down in case the shutdown command was given unintentionally.
12. And finally, she can counter most Japanese swearing words with more than just 1 or 2 responses.

Disclaimer:
as per the readme agreement in MMDAgent, the pictures used for this deviation is based on a personal edit of the MMDAgent and should not be confused with the base program which this tutorial is meant to clarify.

--------------------------------------------------------------------------------
Edit 3/10/2011
--------------------------------------------------------------------------------
I changed the file download to a .zip file containing my edited mmdagent_example.fst.
It is my personal edits to see my present code condition, and not the .fst file initially distributed with the sample_script zip file.
To use this file, just copy it over the .fst file in the sample_script folder and use as described above. You are advised to keep your own backup copy of your .fst file just in case.

you may use this for your own entertainment and such. No credits to me are required, although i would be very interested to hear about your own additions, discoveries and innovations that you may develop.

However, I will not be held responsible for any problems it may cause, nor am i obliged to ensure that it works. This is merely to be used as a suggestion on how to code. All other copyrights are in their respective copyright readme files.

[new version uploaded on 18/11/2011 highlighting Value_GET functions and how they are used]

------------------------------------------------------------------------
Update 8/10/2011
-------------------------------------------------------------------------
you can open up the .mdf file in notepad, and there are some initial settings which you can modify at will

notably, the parameter you want to probably reduce is the one named Bullet frames per second (Bullet fps)
The standard 120 frames per second puts a heavy toll on your graphics card. Reducing it down to 30 or so will significantly reduce this load. You're free to set it to any value which suits you.

--------------------------------------------------------
update 29/11/2012
---------------------------------------------------------

And because i have been testing way too many models as of late, a new deviation would just about sum up some of the working ones i've been testing. Therefore, some models from pretty serious modelmakers on deviantart are in order...

V3 From middle and clockwise,
~Xenosnake 's Cyber Lat Gear Miku [link] performing Interstellar Flight sm8568000 using a different stage model (credits still being sourced)
MSN-04 Char's Sazabi (sm8550675) performing Packaged (mylist25972080)
~JessHolysAngel 's Electric Love Miku [link] performing Electric Love sm14410247
Nanami's Kisaragi Chihaya (sm12140696) performing Little Match Girl (sm13952228)
~Hanaminasho 's Artistic Miku [link] showing the menu attaching itself to the center of the model regardless of how short it is (shadow problem self repaired)
LAT Heart Beats Miku (sm15355081), LAT Rin Append [link] and ~Mamama7028 schoolgirl project diva Miku showing multiple model functionality [warning: every extra model puts extra strain on your CPU and GPU]
~midnighthinata 's Daughter of Evil Rin [link] performing Romeo and Cinderella (with the event/action log activated)
*capriciously-calm 's Yellow LAT Miku [link] performing Yellow [link] with Bone detection activated
=Jjinomu 's Rolling Girl LAT Miku [link] performing Two Faced Lovers sm15356537 showing how some shiny effects still load in MMDagent, although not sure why some do not.
LAT Rin Append [link] displaying a little menu which i created from the Library menu model included in MMDAgent.

V2 Preview inside the zip file credits:
MSN-04 Char's Sazabi (sm8550675) performing Packaged (mylist25972080)
Lat Rin Append [link] performing Go My Way [link]
Nanami's Kisaragi Chihaya (sm12140696) performing Little Match Girl (sm13952228) [note: voice monitor turned off]
Saboten Sakura Miku [link] performing Disappearance of Hatsune Miku ([link] )
Kio Gothic Miku [link] performing Disappearance of Hatsune Miku [side logs activated (shift + f)]
~Xenosnake 's Cyber LAT Miku with Bits [link] showing the menu function i added (menu model edited from the library.pmd model in MMDAgent. [note: all event log turned off ]
LAT Heart Beats Miku (sm15355081), LAT Rin Append and ~Mamama7028 schoolgirl project diva Miku showing multiple model functionality [warning: every extra model puts extra strain on your CPU and GPU]

-----------------------------------------------------------------------------------------
update 13/11/2011
------------------------------------------------------------------------------------------
been browsing nico-nico douga
[link]
this guy apparently has also been tweaking MMDAgent, although in japanese.

However, his .fst file gave me one important piece of information: how VALUE_GET function works.

in non-programmerish how to use:
State1 State2 VALUE_GET|variablename
state 2 State3 VALUE_EVAL_GET|variablename|variablevalue3
state 2 State4 VALUE_EVAL_GET|variablename|variablevalue4
state 2 State5 VALUE_EVAL_GET|variablename|variablevalue5
state 2 State6 VALUE_EVAL_GET|variablename|variablevalue6
this replaces the extra long code i used to detect the value of the datas.

in iostream.h C++:
this is the switch x function.

Also, check out the readme file he included.
It has like, super loads of credits and references to models, stages and motion datas across nico-nico douga. Trying them out. lol

update 12/12/2011
.pmx files may not be able to be loaded directly, but convert the .pmx to .pmd files using PMDEditor and it will work okay. Generally.

-------------------------------------------------------------------------
List of tested models
-------------------------------------------------------------------------
Before we proceed, there are a list of problems i'ld like to abbreviate, explain and propose solutions to:

Ground Shadow problem (GS)
Description - There is a problem which causes ground and self shadows to not load
Cause - MA Ambient Line value set to less than 1 (no edge lines)
Solution - change the value of MA Ambient Line value to at least 1. This will load up the shadow properly in MMDAgent.
Solution Flaw - Sometimes however, this will reveal unsightly black blotches on the model, and currently i am thinking of how to solve this. If you are a modelmaker, your help would be much appreciated because i dont know crap about whats going on in PMDEditor. Worse to worse, turn as many MA bones as possible to 1. If a tested model is marked with GS, it will be followed by MA bones which should be skipped to avoid black blotches

Skirt Physics (SP)
Description - skirt or other parts have physics which cause it to move upwards.
Cause - The Physics (PH in PMDeditor) setting for the loc y coordinate is too high (about 7-10 is considered high)
Solution - change that value to a lower value (i set it to 3 so that its same as the Lat Miku White model)

Texture Not Loading (TNL)
Descriptions - Textures appear white in MMDagent, but work fine in MikuMikuDance/PMDEditor
Cause - Textures may be non-RGB colored (Indexed color)
Identifying cause - jpeg and BMP files cannot be index color and will always load. PNG and TGA files may be indexed color, so if you have to take a wild guess, start with the PNG and TGA files first.
Solution 1 (if you have a photo editing software) - Convert the texture image back to RGB from whatever it was.
Solution 2 (if you dont have a photo editing software) - Open the texture with Paint and save it as jpeg. Then use PMDEditor to make it use the jpeg file as the texture.

All YM_model type kaito, gakupo and hiyama kyoteru [link] - no problems

All Nakao mikus - works
All Yukiwane (ゆきはね) mikus [link] - works after PMX conversion

All Saboten Miku Models [link] - no problems

All LAT type miku, rin and tetos - (for LAT neru, see nico links below) [miku] [link] [teto] [link] [rin] [link] - the face MA does not have a line ambient value of 1. When you do set it to 1, black patches appear above. There is a way to fix it, which is:
Select only the face MA, select the vertices and mesh, then apply Edit>Outline>Average Apex with a very very small number, followed by Edit>Outline>Average. This however will reduce the maximum framerate that can be achieved by this model in MMDAgent.

Saboten Aoki Lapis - GS

Onto Deviantart modelmakers

~Mamama7028 [link]
Project Diva Miku [link] - no problems whatsoever
Project Diva Miku Chibi - [link] - no problems

~Xenosnake 's Cyber LAT Mikus [link] [link] [link] [link] - no problems whatsoever (may contain Kios, Nakaos, Pirons, CSs)

~SakuneUtau04 's Dancer Miku [link] - no problems whatsoever

=Kaida19th
SeeU version 3.0 - [link] - Seeu 3.0 and 3.0s will work fine. But the 2.5 version and Nio version - SP
Meltdown Rin take 2 - [link] - no problems
Saihate Miku - [link] - a part of her jacket is permanently pointed upwards. Solution: use the PMDViewer to select and delete the bones attached to her jacket, but dont seem to be a part of the IK bones. (using the bone menu wont work, you have to use your mouse to do this)

*capriciously-calm 's Yellow LAT Miku [link] - no problems

~daybreak123
Saihate Hatsune and Zatsune Miku [link] : GS - MA8
Rockish punkish miku - [link] - no problems
Rolling Girl (Diva Extend type) - [link] - no problems
Joker LAT Miku - [link] - GS - MA 4, 6, 12 and 15. You may also want to delete the mesh for MA18 (fangs). Then it loads up without problems

~kurumi13 's Neko Miku v2 [link] - GS - MA MA4,11,16,17,18,19, 23,27,28,29,30,31,32 (most of them are extra facial effects)
Notably, this is among the few models with special features which dont crash MMDAgent (the other being the xenosnake models). Even her tail's physics work. Figuring out why.

~JessHolysAngel 's Electric Love, Melody Line and Sweet Devil mikus [link] - no problems whatsoever

*RavenUzuki-Chan
Punk Miku, Rin, Teto [link] - Miku and Teto - no problems. Rin - GS - MA6, 12, 24 and 33. Additionally, rin has a glasses positioning problem.

~YamiSweet :
Kokoro Rin - [link] - no problems
Rock Luka Kio type - [link] - GS

~midnighthinata
Untouchable miku [link] - Advised to use the version without wing physics. For the model with the wing physics enabled, the wings just fall to oblivion, never to be seen again. The same applies to ARToolkit_MMD
Victorian style Miku, Neru, Teto [link] , [link] , [link] . - no problems
Eager Love Revenge Lat miku [link] , - no problems
sweet lolita LAT miku [link] - no problems
Daughter of Evil and World is Mine Rin [link] [link] - no problems

~Hanaminasho
Artistic Miku [link] - GS and TNL
Snow Miku [link] - crashes
Bride Animasa Miku [link] - no problems at all
Dreamy Theather type Luka [link] - GS

~TwilightAnimeLife 's Tonio model - [link] - crashes

=Jjinomu
Rolling Girl LAT Miku [link] - no problems in MMDAgent. Shininess effect doesnt load in ARToolkit_MMD
LAT Len [link] - no problems
Meltdown Rin - [link] - TNL
Little Red Riding Miku (limited time)- [link] - TNL

*SachiShirakawa
cantarella kaito and miku version 2 [link] - no noticable problems
Kon version 2 [link] - GS
Kimono Luka [link] - GS - change Line Ambient vakue to 1 for all except MA9, 12 and 13

~DG-H
DT Append Miku [link] - crashes. May be a non-standard bone problem. Loads normally in ARToolkit_MMD though.

~Haruhi-chan4ever 's Space Miku [link] - GS

~L3nkun 's SeeU version 1.5 - [link] - GS

*shadoouge
Sekiranun Graffiti Miku [link] - her chest appears brighter than every other part of the model for some reason. Fix: change all MA diffusions set at 0.8 to 1. Shirt also has a noticeable texture change. Fix: change the texture for MA5, 6 and 7 from 4,5 and 4.bmp to 6.bmp.
Snow LAT Miku [link] - no problems

=kogaan
Kagamine Len LAT type - [link] - no problems

=kogaan 's LAT Kagamine Len - [link] - no problems

*VocaloidAddict922
Sega Meltdown Rin - [link] - ground shadow problem requires complicated fix with some tradeoffs, but can work in MMDAgent. Awaiting creator's response.

~Bloodobsessed
Disappearance LAT Rin - [link] - GS - MA28, 29 and 45.
Disappearance Miku - [link] - no problems

~Alelokk
DT Disappearance Miku ~Hanaminasho collab - [link] - crashes MMDAgent, but will load in ARToolkit_MMD. ARToolkit_MMD reveals no ground shadow, so apply the fix below and it should have shadows even in ARToolkit. Source of crash still being assessed

~Ame-Yuki 's Formal Dress LAT Miku [link] - no problems. This model loads up the shininess effect in both MMDAgent and ARToolkit_MMD

=ZiiiChan 's Rolling Girl Miku [link] - change v_nor.png to RGB and delete 01.spa association to MA15, then everything loads fine.

~Kanahiko-chan 's Beach PD Len [link] - GS

~YellowDesuCake 's Conflict Miku [link] - no problems

~iiRichie 's Summer Miku [link] - GS. Delete all MAs which use t005.spa for it to work in ARToolkit_MMD

~SatariaMityo 's Monochrome sky LAT miku [link] - no problems

Kio Gothic Miku [link] (新キオ式ミクゴス衣装) - no problems

Masisi's Chihaya Kisaragi models - [link] - no problems

Obtained via Niconicodouga or Youtube

sm8550675 - Sazabi model - no problems
sm9965772 - Rockman zero model - no problems
sm13567741 - Piron Miku Maid models - no problems
Project Diva Snow miku - [link] - crashes
sm13824038 - 'Gosick' miku (password required) [officially discontinued. Dont bother asking me for it, i abide strictly by author's rules]
sm11360016 - petite miku - SP & (model with groove bones (Grv) causes it to crash)
sm15355081 - Heart Beats miku - no problems
sm14113395 - LAT type Neru - white, normal and black school uniforms no problem. White school uniform crashes
sm14475754 - Aoi Tori Kisaragi Chihaya - hair physics makes it defy gravity (video merely links to the download account, does not actually show the model in question)
TheAnimeLover40's Standard Rin - [link] - no problems
sm14913870 - Kyun Vampire Girl LAT Miku - PMX model - conversion to pmd required. Works normally once in PMD form.

-------------------------------------------------------------------------+++++
Current crazy ideas
-------------------------------------------------------------------------+++++
In theory, the following two projects are possible, though both of them will be extremely long because of the sheer number of keyboard detection and the inability of MMDAgent to do simple math:

Project Diva within MMDAgent - using timers and keyboard inputs, it will be possible to have a rhythm game inside MMDAgent, possibly using new models and motion data. However, detecting the time will be the single hardest part, and it gets longer and tougher depending on how many 'keys' you want to key in for a song. (World is Mine has 383 keys)

Raising Simulation - after going through some of the base ideas behind Idolmaster, it may be possible to program MMDAgent to randomly behave and evolve according to some code. The code would probably use 'emotion' variables, and its up to you to balance out these variables, decide what factors influence them, and work out scenarios on how she'ld respond to all of them. It would be a potentially endless code, even if you dont expect her to retain her personality across your usage of the program.

The ideas mentioned above are not easy one bit. It may be simple in concept, but the implementation will be brutal. If you do choose to pursue such projects, i either recommend you to program it in a simpler programming language like Warcraft Map Editor or C++. If it cant work there, dont even think about trying it with MMDAgent.
Since we now know how VALUE_GET works, it may be a lot simpler and faster compared to what i had to use before

-------------------------------------------------------------------------
References:
-------------------------------------------------------------------------
MMDAgent homepage - [link]

The wiki of MMDagent. Note that its in japanese. Google translate it if you have to: [link]

Google translate - [link]
VocaloidOtaku.net MMDAgent specific thread - [link]
Mikuchan.org MMDAgent specific thread - [link]
LAT Kagamine Rin Append Module - [link]

got a youtube video up for starters - [link]