At one point in time, consumer interactions of Faceshift studio were in development for use with Skype, however it appears that project has since been shelved.Īpple continues to enhance its portfolio of facial recognition technologies with the company’s acquisition of Faceshift one of the first being the Sweden-based company, Polar Rose, in early 2010. The technology, in part, has been most notably used to map human-like gestures onto the faces of certain characters, for example, as part of the new “Star Wars” film.įaceshift’s main claim to fame is a product known as “Faceshift Studio,” a software protocol that incorporates the firm’s facial recognition software with support for Maya and Unity - a consortium of software-based, real-time imaging and file sharing tools. Effectively capable of real-time processing, the firm’s platform utilizes 3D sensors and cameras to subvert the need for traditional motion capture protocols. …which was informative, but I was hoping that maybe there had been some developments back then in terms of the kind of affordable markerless face mocap mentioned above.Prior to being acquired by Apple, Faceshift had developed a rather powerful facial recognition software that was the backbone of advanced motion capture technology. The most relevant thread I could find about this so far was this: However, before ruling out the device and trying something else, I was wondering if anyone else has gotten decent results with the original kinect for this purpose, and if so, what software/workflow did you use (I would have also tried Faceshift but it doesn’t look like that software is available anymore)? I am hoping for something less than $500 that ideally doesn’t require too much cleanup (since I don’t know much about animation, which was part of the motivation for using mocap in the first place), but I guess that’s probably unrealistic. It doesn’t seem accurate enough to capture small changes in mouth movement, and I have a feeling that this is because the first gen kinect itself doesn’t really have the precision to do that.

I’ve been trying to use an xbox 360 kinect sensor and Brekel Pro Face for getting facial motion capture animation files, specifically for basic lip syncing, but haven’t had much success.

Xbox 360 kinect faceshift