This facial recognition system tracks how you’re enjoying a movie. As moviemaking becomes as much a science as an art, the moviemakers need ever- better ways to gauge audience reactions. Download Rock The Kasbah (2015) Online. Did they enjoy it? At minute 4. 2? A system from Caltech and Disney Research uses a facial expression tracking neural network to learn and predict how members of the audience react, perhaps setting the stage for a new generation of Nielsen ratings. The research project, just presented at IEEE’s Computer Vision and Pattern Recognition conference in Hawaii, demonstrates a new method by which facial expressions in a theater can be reliably and relatively simply tracked in real time. It uses what’s called a factorized variational autoencoder — the math of it I am not even going to try to explain, but it’s better than existing methods at capturing the essence of complex things like faces in motion.
The team collected a large set of face data by recording audiences of hundreds watching movies (Disney ones, naturally). An infrared hi- def camera captures everyone’s motions and faces, and the resulting data — 1. Once it had finished training, the team set the system on watching audience footage in real time and attempting to predict the expression a given face would make at various points.
They found that it took about 1. Of course, this is just one application of a technology like this — it could be applied in other situations like monitoring crowds, or elsewhere interpreting complex visual data in real time.“Understanding human behavior is fundamental to developing AI systems that exhibit greater behavioral and social intelligence,” said Caltech’s Yisong Yue in a news release. After all, people don’t always explicitly say that they are unhappy or have some problem.”Featured Image: Caltech / Disney Research.
InformationWeek.com: News, analysis and research for business technology professionals, plus peer-to-peer knowledge sharing. Engage with our community. Latest breaking news articles, photos, video, blogs, reviews, analysis, opinion and reader comment from New Zealand and around the World - NZ Herald. PCMag Editors' Choice. PowerDVD is the ultimate video playing software, with support for new technologies like 4K Blu-ray and 360-degree VR.
- In this Friday, July 28, 2017, photo, people walk past the 105-story pyramid shaped Ryugyong Hotel in Pyongyang, North Korea. Walls set up to keep people out of a.
- Events schedule, information for exhibitors and visitors.
- Did they enjoy it? How much exactly?
- Search the world's information, including webpages, images, videos and more. Google has many special features to help you find exactly what you're looking for.