= Menu

Looking Coordinated: Bidirectional Gaze Mechanisms for Collaborative Interaction with Virtual Characters

Proceedings of CHI 2017 — 2017
Download the publication : chi17-andrist-CAMERA.pdf [5.9Mo]  
Successful collaboration relies on the coordination and alignment of communicative cues. In this paper, we present mechanisms of bidirectional gaze---the coordinated production and detection of gaze cues---by which a virtual character can coordinate its gaze cues with those of its human user. We implement these mechanisms in a hybrid stochastic/heuristic model synthesized from data collected in human-human interactions. In three lab studies wherein a virtual character instructs participants in a sandwich-making task, we demonstrate how bidirectional gaze can lead to positive outcomes in error rate, completion time, and the agent's ability to produce quick, effective nonverbal references. The first study involved an on-screen agent and the participant wearing eye-tracking glasses. The second study demonstrates that these positive outcomes can be achieved using head-pose estimation in place of full eye tracking. The third study demonstrates that these effects also transfer into virtual-reality interactions.

Images and movies

 

BibTex references

@InProceedings{AGM17,
  author       = "Andrist, Sean and Gleicher, Michael and Mutlu, Bilge",
  title        = "Looking Coordinated: Bidirectional Gaze Mechanisms for Collaborative Interaction with Virtual Characters",
  booktitle    = "Proceedings of CHI 2017",
  year         = "2017",
  ee           = "http://dl.acm.org/citation.cfm?id=3026033",
  doi          = "10.1145/3025453.3026033",
  url          = "http://graphics.cs.wisc.edu/Papers/2017/AGM17"
}
 

Other publications in the database