HOME | DD

RuchiiP — Kinect to MMD tutorial UPDATED

Published: 2011-08-22 21:25:32 +0000 UTC; Views: 56519; Favourites: 338; Downloads: 505
Redirect to original
Description OBBBSS!! FOLLOW THIS LINK TO DOWNLOAD ALL THE PROGRAMS AND YOU WILL BE ABLE TO SKIP TO NUMBER 2. AND READ THE WHOOOLE THING BEFORE ASKING BE QUESTIONS. THERE IS TIPS AND Q&A AT THE END OF THE TEXT!
[link]
I believe that all vista users and higher need this one to make it work [link]


---------------------------
It will work on win xp sp3 32bit (vista/7)
There are different types of Kinect
You will be needing this one↓
Kinect LPF-00006 (Unit).
→Kinect Sensor with Kinect Adventures!←
~~~~~~~~~~~~~~~~~
These following are not good↓ You need to buy it separately from xbox 360, or buy needed components.
Xbox 360 4GB Console with Kinect.
Xbox 360 250GB Console with Kinect
(I'm not sure though, I've heard you can use the usb for wi-fi to connect)
~~~~~~~~~~~~~~~~~
These are the programs you will be needing↓
OPENNI-Win32-1.0.0.23.exe →
NITE-Win32-1.3.0.17.exe →
avin2-SensorKinect-b7cd39d.zip →
MMDv7.25 →
DxOpenNI (Ver.1.10) →
Microsoft Visual Studios 2008/2010
---------------------------

1. Create a folder and name it Kinect (this is not necessary; but will make it easier to find stuff), and download these programs into the folder.

a) OpenNI – Go to [link] hover over the tab “Downloads” and choose “OpenNI Modules” (I will not give a direct link as the page is changing now and then and might make the link invalid). Go to OpenNI Binaries – Latest Unstable and download the latest “OpenNI Unstable Build for Windows x86 (32-bit) Development Edition” and not the 64-bit, even if your system is 64-bit.

b) NITE – Go back to “OpenNI Modules” and choose OpenNI Compliant Middleware Binaries. Go to Latest Unstable and download the latest PrimeSense NITE Unstable Build for Windows x86 (32-bit)Development Edition and not the 64-bit.

c) SensorKinect – Go to [link] and push the button “Downloads” on the right.

d) Latest MMD and DxOpenNI – Go to [link] and download the latest MikuMikuDance (DirectX9 Ver.) and DxOpenNI.

e) Microsoft Visual Studios 2008/2010 UPDATED* (thanks to ) – You just need to download the Microsoft Visual C++ 2008 Redistributable Package (x86) from here ( [link] ) (since it's no longer included as a "Tool" in the OpenNI program files folder in the newest releases)
(or you could even download the 2010 re-distributable package here [link] ).


f) Unzip – Unzip all the files that are zipped in your map .

2. Connect your Kinect to the computer with the usb (the charger have to be in too every time you want to use it or it wont work).

3. Go to your Device manager and find your Kinect there (look for PrimeSense). Push the > and a “under folder” named Kinect Motor will come up. Right click it and uninstall all drivers except for the Generic USB Hub. Reconnect the kinect and then push update drivers. Here it will differ depending on what OS you have. But you should choose the option to find the driver hardware on your computer. Now look for the Kinect folder that we made. Go to avin2-SensorKinect-28738dc → Platform → Win32 → Driver and push ok. It should now install the driver.

4. Now install OpenNi as normal, no need to change any settings. Later choose avin2-SensorKinect-b7cd39d → avin2-SensorKinect-b7cd39d → Bin → SensorKinect-Win32-5.0­.0.exe and install it as normal too. Now also install NITE, you will be needing the key that you saved earlier.

5. Go to your program files and choose the folder OpenNI then go to Samples → Bin → Release and execute the file NiUserTracker.exe . You should now see your room from the Kinect camera. Stand in front of it and take the standard position (the picture). You should now see the bones and it should move as you move if you have done everything correctly.

6. Now open the folder DxOpenNI that we downloaded earlier. Copy the files DxOpenNI.dll and SamplesConfig.xml and paste it into MMD's Data folder.

7. Start the program MMD (mikumikudance) and choose your lovely guinea pig ( I prefer C'mell's Rin (#^_^#)/ or a Lat model). Go to the tab “Motion Capture” and click Kinect. Stand in front of the camera and take once again the standard position. It should now recognize you and move the bones as you move. To record go to the same tab and choose capture and it will save everything you do as motion data.


KNOWN PROBLEMS

Q. I can't fit my kinect to the computer

A. As I said before you need to buy the kinect separately with the adventure pack or you need to buy a usb cable that works with kinect separately.


Q. I'm using Windows 7, and I'm getting the dreaded "InitFromXmlFile Failed: The Environment variable could not be found!/Cannot Find Kinect sensor" errors, and the NiUserTracker.exe in the OpenNI>Samples>Bin>Release directory would not run either.

A. You have to right-click the .exe and hit "Run as administrator", (I.E. Right-click MikuMikuDance.exe>Run as administrator) and then it works flawlessly!!! No errors! =3 Only downside is that you have to tell it to run as administrator every single time. x.x Or to permanently fix the "InitFromXmlFile Failed: The Environment variable could not be found!/Cannot Find Kinect sensor" Errors, and bypass using the "Right-click>Run as administrator", use the tutorial found here; ([[link] Option Four) by right-clicking the .exe, go to properties, hit the compatibility tab, and under Privilege level, check the "Run this program as an administrator". (thanks to

Q. Is there the chance that a webcam could be used?

A. No it doesn't work. MMD can only take feeds from a kinect. For now.




TIPS from


The kinect sensor itself drains a lot of power. So its advisable to not use it next to anything which drains a lot of power. Mine just kept showing just the kinect motor only. But when i turned off my air conditioning socket (it shares the same power source) and fan (using another slot from my extension socket), then the kinect camera became active once more.

Certain programs which used kinect tend to also drag along with it, the drivers for kinect, rendering the mikumikudance version unusable. My version was using the Kinect SDK 1.7. If a program messes up the system, uninstall the Kinect SDK 1.7 Driver (it installs 4 things in one go, but if drivers mess up, you only need to uninstall the driver), then do a reinstall. Reinstallation will only reinstall what is missing.

For the record, this was my order
KinectSDK1.7 >> OpenNI 1.5.4 (your link. v2 does not work, so please keep your download pack available) >> SensorKinect (unstable ver, Bin>>SensorKinect093-Bin-Win32-v4.1.2.1.msi) >> DxOpenNI

Through the course of installing, i had encountered the following problems, but have since bypassed these problems:
failed to initialize kinect >> likely due to lack of power. Use dedicated power sockets attached to no other high-power devices like airconds, water boilers, fans, etc
unable to initiate node >> likely due to KinectSDK1 instead of KinectSDK1.7 or using OpenNI2 instead of OpenNI1.5.4
Related content
Comments: 856

Prrrromotion In reply to ??? [2013-08-01 07:36:27 +0000 UTC]

Okay, I've tried this on 2 PCs now and each time I got the same problem, which probably means I'm doing something wrong. When I try to use the Kinect in MMD, the error I get is "InitFromXmlFile failed: Can't create any node of the requested type!" followed by "Cannot find Kinect sensor". (same thing when I use admin rights, and the NIUserTracker.exe didn't work either) I think this may have to do with the fact that I skipped part 3 because my Device Manager doesn't have Kinect Motor, or Primesense or even any 'under folders'. Here's what it looks like:
vvcap.net/db/mMdyw62z2ulgtPVWc…
It was pretty much the same on both PCs I tried, and I also tried updating the drivers with the files you uploaded but that went nowhere. I've spent a lot of time with this, and I'm not in the least willing to give up so if you could get me out of this, I would be really thankful ^^
I'd like to thank you for this tutorial since it looks like you put a lot of effort into it, but I can't really do that yet

PS, the PCs I tried were a 64 bit Windows 7 and a 32 bit Windows 8 if that helps, don't know exact specs but both should easily be able to handle it

👍: 0 ⏩: 1

RuchiiP In reply to Prrrromotion [2013-08-01 11:08:27 +0000 UTC]

Yes it because you jumped step 3 its not working ^^ In win 7 its no through the normal way you do it. If you press start there should be something on the right named like printers and other stuff XD There you will find the kinect and do the same thing in the tutorial.

👍: 0 ⏩: 1

Prrrromotion In reply to RuchiiP [2013-08-02 06:45:05 +0000 UTC]

I tried that already, but it has the same results.
vvcap.net/db/I2yGspuIpzSw524w9…
My question is, how can I install the drivers when there is no such thing as 'Kinect Motor' anywhere? I also tried deleting everything but the Usb Hub, but even before I was done deleting this happened:
vvcap.net/db/nL0P6BO2uQV2BhSsk…
It always had those three errors, are they the reason? Even if there's still no Motor. I've never used the Kinect outside of Xbox, so I really don't know much about how to use it on PC, and thank you for trying to help ._.

👍: 0 ⏩: 1

RuchiiP In reply to Prrrromotion [2013-08-02 15:55:43 +0000 UTC]

Its the camera and device that you uninstall the drivers and then install the drivers in the pack.

👍: 0 ⏩: 1

Prrrromotion In reply to RuchiiP [2013-08-12 05:56:25 +0000 UTC]

Sorry for the late reply, interntet is godawful around here. But, I finally got it to work and I'm not even sure how, I just want to say thank you for the tutorial!

👍: 0 ⏩: 1

RuchiiP In reply to Prrrromotion [2013-08-12 18:55:55 +0000 UTC]

No worries and all the best of luck ^^

👍: 0 ⏩: 0

Stahlherz-Succubus In reply to ??? [2013-07-29 01:38:05 +0000 UTC]

I have to turn off my fan to do this?! But it's so hot here in Texas!


I'll still do it, though. This is a very nice tutorial!

👍: 0 ⏩: 1

RuchiiP In reply to Stahlherz-Succubus [2013-07-29 16:55:02 +0000 UTC]

Haha good luck, just dont burn up XD

👍: 0 ⏩: 1

Stahlherz-Succubus In reply to RuchiiP [2013-07-29 22:11:41 +0000 UTC]

It's working so far, but only the top half follows my movements. The legs just do whatever they want. How do I fix that?

👍: 0 ⏩: 1

RuchiiP In reply to Stahlherz-Succubus [2013-07-29 22:17:54 +0000 UTC]

the kinect needs to see your whole body in a well lit and large room. Also it likes to spazz XD Dont think it will look smooth and nice.

👍: 0 ⏩: 1

Stahlherz-Succubus In reply to RuchiiP [2013-07-29 22:31:10 +0000 UTC]

How large? And also, what versions of the things are you using? I have SDK 1.5 because in another tutorial that's the one the guy used.


And how can I get Kinect to recognize hand grips/finger movements? Can it do facials as well, and if so how do I get those to work?

👍: 0 ⏩: 1

RuchiiP In reply to Stahlherz-Succubus [2013-07-30 13:51:58 +0000 UTC]

Fingers no and facials no. Larger the better and the newer the version the better too But this tutorial is optimized for my DL pack.

👍: 0 ⏩: 2

Stahlherz-Succubus In reply to RuchiiP [2013-07-30 14:10:24 +0000 UTC]

My backyard is huge, that should do! But once again, it's hotter than Ludwig out there!

👍: 0 ⏩: 1

RuchiiP In reply to Stahlherz-Succubus [2013-07-30 14:24:19 +0000 UTC]

Yeah a huge heatwave have hit America and Europe XD

👍: 0 ⏩: 0

Stahlherz-Succubus In reply to RuchiiP [2013-07-30 14:08:49 +0000 UTC]

I think I'll get the newer version of NiTe which has finger recognition. And my backyard is huge, that should work.

👍: 0 ⏩: 1

RuchiiP In reply to Stahlherz-Succubus [2013-07-30 14:10:04 +0000 UTC]

Then good luck ^^ Just remember not to have the sun in your back

👍: 0 ⏩: 1

Stahlherz-Succubus In reply to RuchiiP [2013-07-30 14:24:02 +0000 UTC]

I'll try! Thanks for your help!

👍: 0 ⏩: 1

RuchiiP In reply to Stahlherz-Succubus [2013-07-30 14:34:48 +0000 UTC]

No worries^^

👍: 0 ⏩: 0

Domotatici In reply to ??? [2013-07-26 07:03:33 +0000 UTC]

finally now i can use my kinect for something related to animation

👍: 0 ⏩: 1

RuchiiP In reply to Domotatici [2013-07-26 15:13:30 +0000 UTC]

=w=b good luck

👍: 0 ⏩: 0

ShinigamiOfLightZero In reply to ??? [2013-07-12 17:42:42 +0000 UTC]

OMFG THIS IS AWESOME i needed a use for my kinect, i dont have it though........... i lent it to a friend a long time ago, guess i have a reason to buy a new one now though huh? XD

👍: 0 ⏩: 1

RuchiiP In reply to ShinigamiOfLightZero [2013-07-12 18:36:24 +0000 UTC]

yup yup ^^

👍: 0 ⏩: 0

bekboo83 [2013-07-03 04:58:50 +0000 UTC]

man i wish i had kinect

👍: 0 ⏩: 0

pixelated-memories In reply to ??? [2013-06-02 19:11:17 +0000 UTC]

its saying i need an openNI.dll and the software and stuff i checked my kinect folder and its there but idk why its not working

👍: 0 ⏩: 0

AddestorionVayanis In reply to ??? [2013-06-01 06:55:34 +0000 UTC]

update.

i got a hold of a new computer, and i went installing the usual. It seems that with windows 8 at least, the process has been reduced to this:

install KinectSDK_v1.7 >> copy the dxopenni.dll to the data folder of mikumikudance
and somehow it works. without needing nite or all the other stuff...

👍: 0 ⏩: 1

Emmma360 In reply to AddestorionVayanis [2013-08-05 11:43:40 +0000 UTC]

I am using Windows 8, and I tried doing what you suggested. But when it comes to using Kinect in MMD, I get "GetProcAddress: 193:51 is not a valid Win32 appliation" and "Cannot move OpenNI. OpenNI might be failed install". I'm so lost and none of this is working (but I've done this before on a Windows 7 computer and it worked).

👍: 0 ⏩: 1

AddestorionVayanis In reply to Emmma360 [2013-08-05 15:46:05 +0000 UTC]

according to google, there exists a possibility that a folder name problem can occur, whereby the search mechanism that locates the filename incorrectly locates a different folder instead support.microsoft.com/kb/81248…

my recommendation is to bring out mikumikudance onto a path without any spaces whatsoever (mine is on the very top of my D drive).

If that doesnt work, other regular suspects are:
- directX needs to be updated
- windows C++ redistributable.  currently my computer has 2005, 2008 and 2010 versions installed

you should however, tell me what your current system has.  I want to know what steps cause what problems, and which solutions work for which.

👍: 0 ⏩: 1

Emmma360 In reply to AddestorionVayanis [2013-08-05 18:41:11 +0000 UTC]

I think I found my problem. Whenever I try update the driver it says "The hash for the file is not present in the specified catalog file" sources say if you have a 64-bit computer, 32-bit drivers won't install. My laptop is Windows 8 64-bit.

👍: 0 ⏩: 1

AddestorionVayanis In reply to Emmma360 [2013-08-06 07:31:21 +0000 UTC]

its strange because mine is also a windows 8 64bit.

However, i immediately disabled windows automatic update the moment i got the laptop though.  Not sure if an update messed things up.

it is my personal belief that a windows update causes more problems than it solves.  lol

👍: 0 ⏩: 1

Emmma360 In reply to AddestorionVayanis [2013-08-06 10:37:01 +0000 UTC]

Yeah. It's when I try update the drivers (step 3) that it doesn't work.

I googled it and people say you can't install 32-bit drivers on a 64-bit system.

I even tried the latest version of Kinect SDK and even that didn't help.

What is the exact process you used to get Kinect working with MMD?

👍: 0 ⏩: 1

AddestorionVayanis In reply to Emmma360 [2013-08-06 10:59:13 +0000 UTC]

literally it was just as i put it.  I just installed the kinect SDK drivers as is.  Then i put the kinect .dll files from the vpvp page into the data folder of mikumikudance.  I would imagine you probably have all the administrator privileges on your computer, so i dont think what you did is any different from what i did.

however, there is a way to install 32 bit drivers on a 64 bit system by placing the driver into the syswow64 folder instead of system32.  Also, what programs are running as you run mikumikudance?  sometimes another program running which uses kinect can mess up the kinect of mikumikudance.

👍: 0 ⏩: 0

Grey-Wolf1 In reply to ??? [2013-05-21 04:51:09 +0000 UTC]

Can you control more then one character if you have more then one person available?
Like one person to control the main character and someone else to control a by standard.

👍: 0 ⏩: 1

RuchiiP In reply to Grey-Wolf1 [2013-05-21 12:04:50 +0000 UTC]

No only one at a time.

👍: 0 ⏩: 1

Grey-Wolf1 In reply to RuchiiP [2013-05-21 13:24:14 +0000 UTC]

Thanks. What about animal models? Has anyone ever tried? I've only seen Len,rin, miku, no one has tried like wolf models? Or 4 legged models in general?

👍: 0 ⏩: 1

RuchiiP In reply to Grey-Wolf1 [2013-05-21 13:59:34 +0000 UTC]

well it should work. But since it would force you to walk on fours it might freak the kinect out. And it might not be able to record all the limbs and the model can be spazzing out XD

👍: 0 ⏩: 1

Grey-Wolf1 In reply to RuchiiP [2013-05-21 21:05:52 +0000 UTC]

Hmmm....it sounds challenging and yet fun somehow! I must try this. Thank you so much

👍: 0 ⏩: 1

RuchiiP In reply to Grey-Wolf1 [2013-05-21 21:20:57 +0000 UTC]

Haha good luck and no worries!

👍: 0 ⏩: 1

Grey-Wolf1 In reply to RuchiiP [2013-05-22 16:28:07 +0000 UTC]

Hakuna Matata! Thanks you so much

👍: 0 ⏩: 0

JerisEnigma In reply to ??? [2013-05-12 23:17:32 +0000 UTC]

Okay, 2 questions...

Where exactly are we supposed to see Kinect Motor (to uninstall all but the Generic USB hub)?
In the Device Manager I have no PrimeSense anything, but Kinect for Windows has it's own tab with Audio Array, Camera, Device and Security Control. No Motor anywhere. I checked Device's drivers, but there isn't a Generic USB one in there.

Second, where is this key we were supposed to save? You mention that we're supposed to enter a key to install NITE I think, but never say where we got it from... Though everything appears to have installed fin without it.

👍: 0 ⏩: 1

RuchiiP In reply to JerisEnigma [2013-05-13 09:34:32 +0000 UTC]

The key is not needed in the newer version that I have in the downloadable kit I think. And Also if you have trouble installing it there is a youtube video that explains everything.

👍: 0 ⏩: 0

AddestorionVayanis In reply to ??? [2013-05-05 14:12:22 +0000 UTC]

got my hands on one of these. So i would like to add some 'perhaps useful' info if i ever get myself into trouble again:

The kinect sensor itself drains a lot of power. So its advisable to not use it next to anything which drains a lot of power. Mine just kept showing just the kinect motor only. But when i turned off my air conditioning socket (it shares the same power source) and fan (using another slot from my extension socket), then the kinect camera became active once more.

Certain programs which used kinect tend to also drag along with it, the drivers for kinect, rendering the mikumikudance version unusable. My version was using the Kinect SDK 1.7. If a program messes up the system, uninstall the Kinect SDK 1.7 Driver (it installs 4 things in one go, but if drivers mess up, you only need to uninstall the driver), then do a reinstall. Reinstallation will only reinstall what is missing.

For the record, this was my order
KinectSDK1.7 >> OpenNI 1.5.4 (your link. v2 does not work, so please keep your download pack available) >> SensorKinect (unstable ver, Bin>>SensorKinect093-Bin-Win32-v4.1.2.1.msi) >> DxOpenNI

Through the course of installing, i had encountered the following problems, but have since bypassed these problems:
failed to initialize kinect >> likely due to lack of power. Use dedicated power sockets attached to no other high-power devices like airconds, water boilers, fans, etc
unable to initiate node >> likely due to KinectSDK1 instead of KinectSDK1.7 or using OpenNI2 instead of OpenNI1.5.4

👍: 0 ⏩: 1

RuchiiP In reply to AddestorionVayanis [2013-05-05 14:26:10 +0000 UTC]

thank you ^^ I've added the extra info.

👍: 0 ⏩: 1

AddestorionVayanis In reply to RuchiiP [2013-05-05 15:03:57 +0000 UTC]

sure lol. if i find out more nonsense regarding this, i'll just add it here.

It seems that a fair number of people on this tutorial has been having similar problems

👍: 0 ⏩: 1

RuchiiP In reply to AddestorionVayanis [2013-05-05 15:14:04 +0000 UTC]

Indeed ^^

👍: 0 ⏩: 0

YumiRosa In reply to ??? [2013-04-28 02:54:58 +0000 UTC]

Hi!I followed the steps and all but when I clicked on kinect in mmd it said something about the kinect can't be found and some other random error.. 8/

👍: 0 ⏩: 1

RuchiiP In reply to YumiRosa [2013-04-28 13:29:14 +0000 UTC]

Is the kinect connected to a socket?

👍: 0 ⏩: 1

YumiRosa In reply to RuchiiP [2013-04-28 15:22:45 +0000 UTC]

Yes ^^

👍: 0 ⏩: 1

RuchiiP In reply to YumiRosa [2013-04-28 15:42:55 +0000 UTC]

did you install the drivers on the kinect?

👍: 0 ⏩: 1

YumiRosa In reply to RuchiiP [2013-04-28 15:49:39 +0000 UTC]

Yeah

👍: 0 ⏩: 1

RuchiiP In reply to YumiRosa [2013-04-28 15:59:00 +0000 UTC]

Is the lamp on the kinect shining?

👍: 0 ⏩: 1


<= Prev | | Next =>