High-presence, low-bandwidth, apparent 3D video-conferencing with a single camera

Timothy R. Brick, Jeffrey R. Spies, Barry John Theobald, Iain Matthews, Steven M. Boker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Small digital video cameras have become increasingly common, appearing on portable consumer devices such as cellular phones. The widespread use of video-conferencing, however, is limited in part by the lack of bandwidth available on such devices. Also, videoconferencing can produce feelings of discomfort in conversants due to a lack of co-presence. Current techniques to increase co-presence are not practical in the consumer market due to the costly and elaborate equipment required (such as stereoscopic displays and multicamera arrays). To address these issues, this paper describes a real-time, full frame-rate video-conferencing system that provides simulated threedimensionality via motion parallax in order to achieve a higher level of co-presence. The system uses a deformable 3D face model to track and re-synthesize each user's face using only a single monocular camera, so that only the (few tens of) parameters of the model need be transferred for each frame. This both provides motiontracking for the simulated 3D experience and reduces the bandwidth requirements of the video-conference to the order of a few hundred bytes per frame. Bandwidth and processor usage for the algorithms are reported. Possible implications and applications of this technology are alsodiscussed.

Original languageEnglish (US)
Title of host publication2009 10th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2009
Pages308-311
Number of pages4
DOIs
StatePublished - 2009
Event2009 10th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2009 - London, United Kingdom
Duration: May 6 2009May 8 2009

Publication series

Name2009 10th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2009

Other

Other2009 10th International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2009
Country/TerritoryUnited Kingdom
CityLondon
Period5/6/095/8/09

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'High-presence, low-bandwidth, apparent 3D video-conferencing with a single camera'. Together they form a unique fingerprint.

Cite this