|
| |
Presence |
 |
Teleportal Systems |
| |
1998-2001
|
| |
Mobile
InfoSpaces |
| |
Teleportal
Systems |
| |
Technology,
Body, and the Extended Mind |
| |
Culture,
Media & Mind |
| |
Creative
Computing |
| |
Experiential
E-commerce |
| |
Scientific
Visualization |
| |
|
FUNDING
National Science Foundation
National Institutes of Health
Stricom
MSU Foundation
Ameritech Endowment
CURRENT STUDIES
Vision based algorithms to construct the frontal view
with the two side views captured by the cameras through
the mirrors
Techniques for camera calibration to achieve depth
information of the face in real-time
Obtain dynamic warping of the face and achieve views
from different viewpoints.
Study on optics issues of the mirrors and lenses of
the cameras for optimal design.
Perform some subjective tests for evaluating the
performance of the system.
PROJECT TEAM
Faculty: Frank Biocca, George Stockman
Research
Associates: Jannick Rolland (U. Central Florida), Charles Owen
(MSU)
Project Coordinator: Chandan Reddy
Graduate Students:
Chandan Reddy, Geraud Plantegenest,
Interns: Kevin Wayling Lim
| | |
|
3D Face Capture System
PROJECT GOALS
• To capture the human face without obstructing the field of
view in mobile and Tele-collaborative environments.
• To achieve high quality facial expressions immaterial of the
pose and position of the head.
• To obtain a quality 3D head/face model which can be viewed from
arbitrary points.
DESCRIPTION
This research aims
to produce continuous video of the human face while communicating to a remote team. Two small
mirrors are placed at the side of the face, viewed by two cameras
placed near the ears. Using some vision based techniques, the
videos obtained from these two cameras are morphed and blended
together to produce a single standard video signal of the frontal
view.
The project also investigates view morphing so that the virtual video can be viewed from different viewpoints. Another way of approaching this problem is to construct a quality 3D face model that would enable arbitrary views of the user's face/head after texture mapping. This can be achieved by constructing a high quality textured 3D model of the
human face.
Finally, this project explores the different ways of evaluating the efficiency and performance of such
a system. This system can be potentially used in Teleconferencing, Collaborative work, Mobile Environments, Telemedicine, Distance Learning etc.
2002 - 2003
Frank Biocca, Jannick Rolland, Charles Owen, George Stockman,
Weimin Mou, Chad Harms, Arthur Tang, Geraud Plantagenest, Chandan
Reddy, Hong Hua, "Mobile Infospaces and Teleportals: Design and
Measurement approaches to Social and Information Awareness in
Augmented Reality Systems." (Invited Paper), Proceedings
of 10th International Conference on Human-Computer Interaction,
Crete, Greece, June 22-27, 2003.
Chandan K. Reddy " Augmented Reality based Face-to-Face
Communication System", Master's Thesis, May 2003. (in
preparation).
Biocca, F. & Rolland, J. (pending). Teleportal Face-to-Face
system: Teleconferencing and telework augmented reality system,
Patent Application: 6550-00048; MSU 99-029, Dec. 22, 2000. United
States: Michigan State University & University of Central
Florida.
Hong Hua, Chunyu Gao, Leonard Brown, Narendra Ahuja, and Jannick
P. Rolland, "A Testbed for Precise Registration, Natural Occlusion
and Interaction in an Augmented Environment Using a Head-Mounted
Projective Display (HMPD)," in IEEE VR 2002 Proceedings, 81-89
Orlando, FL, March 22-28, 2002.
Hua, H., Gao, C., Brown, L., Biocca, F., & Rolland, J. P.
(2002). Design of an ultra-light head-mounted projective display
(HMPD) and its Applications in Augmented Collaborative Environments.
Proceedings of SPIE, Vol.4660.
Yonggang Ha, Hong Hua, R. Martins, and J. P. Rolland, "Design of
a wearable wide-angle projection color display," to appear in
Proceedings of International Optical Design Conference 2002 (IODC),
June 3rd-5th, 2002, Tucson, AZ.
J. P. Rolland, Hong Hua, and F. Biocca, "Head-mounted projective
displays for creating remote collaborative environments," to appear
in SPIE Aerosense 2002, Vol. 4711, April 1-5th, Orlando, FL.
|
