A demonstration of software that attempts to develop a vocabulary of natural interactions between a user and virtual characters on-screen. The software analyzes live video data from a camera to determine a user's actions.
In this example, a group of characters move around randomly until a user approaches. When a user gets close to the screen, they stop and turn in attention. When a user moves quickly, they get scared and jump faster. Finally, when a person jumps, they all jump in response.