KinectCoreVision: now with finger tranking

Still needs some work. Specially on making an auto configuration of the hull convexity definition for tracking the finger tips. If the hand is far away haves problems to “see” the fingers as distorsion.

As well We need contributors that compiles it for Linux and Windows.


18 thoughts on “KinectCoreVision: now with finger tranking

  1. Greetings Patricio,

    Good day! We are pleased to inform you that your recent contribution to the Kinect Community, Kinect Finger Tracking, has been featured in our website, under the the title, Finger Tracking for Kinect – KinectCoreVision. We are very thankful for your generosity in sharing your knowledge and findings to the growing Kinect Community. We at prioritize above all else, the recognition due to the author or developer of the program featured. We will never fail to mention the names of the people behind the latest Kinect Hacks we feature in our website. We also do our best to give justice to your work by writing the most captivating and descriptive articles based on the information you have given us. With this said, we will never fail to direct our growing number of readers and contributors to your own website. After all, we believe it is you, the developer, who can best explain the thought process behind your masterpiece.

    We are always open to your contributions to the community. There is a huge influx of content from different Kinect Hackers all over the world but continue sending your latest Kinect exploits to us! Rest assured, we will always feature your project/program to the community. We at will also alert you as soon as your article is live in our website. If you have any Kinect Hacks, video links or codes to share to the community, remember, and the Kinect the community is raving to see what you have to give.

    You can suggest us your hack by visiting

    Follow us on our Facebook Fan Page and our Twitter Account to get the latest information about your and other’s Kinect contributions.

    Again, we would like to thank you and wish you the best in further capitalizing on the Kinect’s potential.

    Regards, Team

  2. This is fantastic.

    I’ve been looking for a finger tracking library for Java to use with my Kintect project. I’m going have to brush off my JNI skills.

    Thanks for posting this.

  3. hola patricio,
    I’ve successfully compiled you code on Ubuntu Linux 10.04 for 64 bit using last OF from github.
    It seems to work well, great stuff!
    I couldn’t compile for linux32 because opencv bin libraries in ofxOpenCv have not been correctly compiled for linux yet and I didn’t want to mess with it myself.
    I can provide you with my binary if you want to share it.
    best, francesco

  4. Works good… but still fingers get lost every second and replace by new finger. You can see how IDs are increasing on a single finger. So the implementation is really hard to make it work with any TUIO app like PyMT examples.

    Even calibration its extremely difficult to perform.

    Do have any suggestions on how to make this work ?

  5. Hello,

    I’m looking for a tools like this for an artwork with disable poeple…It seems perfectly for my purpose, so thank for the software!!
    I have just a little problem, i use linux. So, i’m looking for some information of who to make it work on linux (32 or 64 bits).
    I’m new in this world so i don’t know how to compile the xcode projet on codeblocks and if it is necesary to change somethink..
    I read the post from francesco and he say it’s possible, so, if somebody have this binaries for linux, an URL or some indications, i will apreciate.
    Jimisens from Mexico.

      • Hola Patricio!
        Gracias por tu rapida respuesta y aun mejor si podemos platicar en español!! Trabajo con ubuntu 10.04 (32 bits)… pero si es necesario utilizar la 64 bits, me adaptaré…sinembargo, si KinectCoreVision pudiese compilarse en la 32 bits, para mi seria lo mejor ya que varios de los programas que utilizo para el dispositivo solo funcionan en la 32..
        Mi objectivo es detectar los dedos de la mano en 3D y lei en un comentario de tu sitio que se puede lograr modificando un poco tu programa, lo crees posible?
        El trabajo es para un grupo de jovenes sordos y ciegos. Ellos deberan mover las manos en un espacio determinado frente a ellos. Cada dedo actuara como si fuese una sfera en un mundo virtual 3D (x, y , z) y cuando las sferas o dedos (vituales) entren en contacto con otra forma ( sferas o cubos del mundo virtual), la silla en donde estaran sentados empezara a vibrar ritmicamente. Utlizo Pure-Data para comunicar con un programa llamado dimple : que me permite detectar colisiones entre los objectos virtuales.

        Una vez mas gracias por tu atencion, y si pudieses dirigirme un poco para lograr esto te lo agradeceria.

        Yo hago mi maestria sobre la discapacidad y las praticas artisticas y tecnologicas asi que si en una de esas tenemos la ocasion de discutir, para mi seria un placer!!


  6. Hi! We’re a group of portuguese Multimedia students, currently we are working on a project envolving the use of the kinetic camera. We’ve been following your work (specially the Kinectic Core Vision) for a long time now and let us say many thanks before anything, you’ve been a great help!

    At the beginning we had some troubles with making the connection with Processing by TUIO, we followed your advises though, and we compilled the source code from the scratch and it’s working fine now.
    The problem now is (and it’s been a real headache) that we haven’t been capable of making the connection with Flash demos. We already tried everything we could remember (checked the Ports in the Flash website, tried different demos, we checked every single setting on the Kinectic Core and still nothing ).

    We would like to know if you have any idea of what it could be our problem. Thanks a lot in advance and keep up the good work!

  7. Hi Patricio,

    Thanks for this great tool. The tracking works really great.

    However, I was wondering if you had disabled sending TUIO messages for blob tracking mode? In finger tracking mode, I can receive OSC messages just fine, but when I switch to blob tracking mode, I’m not getting anything….

    Can you by any chance post the earlier version, where the blob tracking is sending TUIO, or could you let me know what I need to change in the code to get this working? (I’m still a newbie to C++).

    Thanks a lot!

  8. Just a quick note: this update for finger tracking has broken the standard blob tracking method. If I uncheck “track fingers” and check “track blobs”, all traffic over Tuio UDP stops. As cool as individual finger tracking is, the general blob tracking was more consistent. It also seems like the background subtraction option can’t be turned off, and all the settings saving buttons aren’t hooked up to anything? Really looking forward to updates on this very interesting and potentially useful project!

  9. Hi,

    I’m using your app with Processing and my question is how would I read the XML ouput of the app in Processing / Java ?!?!

    Thanks !

  10. Hola Gonzalo!

    Lo primero, agradecerte que compartas este software y felicitarte por él. Creo que es muy útil.

    Estoy testeándo la version 1.0 de KinectCoreVision en un Mac OSX 10.6 y funciona bien la detección de blobs (detecto cuerpos), pero no envía paquetes TUIO-UDP. El checkbox esta marcado (el correspondiente a la tecla T), y en el cuadradito donde se muestra información indica que sí está enviando paquetes UDP a la IP local:, por el puerto 3333. Pero al poner un detector (un ejemplo de processing, que ya he comprobado que va bien por el puerto 3333) no se recibe paquete alguno. Al poner KinectCoreVision en modo minimizado no indica que envíe dato alguno sino que aparece un círculo rojo que parece indicar que no hay comunicación.

    He intentado solicionarlo con el XML, poniendo el campo a 1, pero tampoco así funciona.

    Te agradecería si me comentas qué puede pasar.

    UN saludo y gracias!


  11. Hi Patricio!

    Thank you very much for your contribution and awsome work! This is the tool I was looking for and works great!

    I made and app in AS3 + Tuio + KinectCoreVision for Windows and it’s perfect! I’ll post soon some info about it.

    But the OSX version binarie is not running under Lion. Do I need some specific configuration for it?

    Best Regards!

  12. Great work and thank you for sharing.
    Could you advise me on the steps needed to implement Kinect Core Vision and Processing with MSA Fluid Library?

    Thanks for your help!

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>