Augmented Reality Tutorial No. 9: Augmented Reality using Kinect (Augmenting Skull and Iron Man Helmet)

Augmented Reality using Kinect

In this Augmented Reality using Kinect tutorial position and orientation of the head is tracked. According to position and orientation information 3D skull model, 3D iron man helmet, etc. can be added on top of human head.

Processing programming language was used in this project.

Processing is a flexible software sketchbook and a language for learning how to code within the context of the visual arts. Since 2001, Processing has promoted software literacy within the visual arts and visual literacy within technology. There are tens of thousands of students, artists, designers, researchers, and hobbyists who use Processing for learning and prototyping.

  • » Free to download and open source
  • » Interactive programs with 2D, 3D or PDF output
  • » OpenGL integration for accelerated 2D and 3D
  • » For GNU/Linux, Mac OS X, and Windows
  • » Over 100 libraries extend the core software
  • » Well documented, with many books available

Download # Download and Install Processing programming language (If it is not already installed).

Download # Kinect drivers for Windows OS (*.exe file).

Download # Augmented Reality Kinect (*.rar file – there is a file you need to start).

Download #  SimpleOpenNI 1.96 library  (*.rar file).

(can be also installed from the Processing programming language as shown in the video).

Download # OBJLoader library  (*.rar file).

Note: last library be also installed from the Processing programming language as shown in the video.

 

Tags: , , , ,

31 Responses

  1. Hello! Student studying physical computing here. To run by “dropping in,” are there any constraints for dimensions/scale or file size for the OBJ model?

    • If your *.OBJ model size is huge, most likely, the model itself is really complex and has lots of vertices/polygons. I don’t know the exact constraints on this matter, it also depends on your computer specifications. You should sort this thing by experimenting with the models you have (if it’s really complex).

  2. may i know, where does the 3d object skull and iron man come from… can we call another object to be augment on top of the head?

    • How to create or how to use already created models?
      You can create models using 3Ds Max, Maya, Blender, SolidWorks and lots of other 3D modelling tools.
      How to use it? you should put the model in data folder and change some Processing code (you will find out if you watch closely).

  3. Help me please! I’ve already tried some files for processing on the kinect, like this one: https://github.com/shiffman/OpenKinect-for-Processing/blob/master/OpenKinect-Processing/examples/Kinect_v1/RGBDepthTest/RGBDepthTest.pde using the model 1414 and they worked perfectly. But for this project i have installed the libraries and run the processing file and it just opens and freezes in the gray window, without showing any real time images. It doesn’t seem to show any errors. What do you think it is?

  4. context.enableUser(); when playing this sketch at this line this error showing “The function”context.enableUser();” expects parameter like”context.enableUser(int);” ”
    Please help me to retrive