Thesis supervisor: Cecília Sikné Lányi
Location of studies (in Hungarian): University of Pannonia, Faculty of Information Technology, Department of Electrical Engineering and Information Systems Abbreviation of location of studies: PE
Description of the research topic:
Emotions and expressions by virtual agents are two important issues for future human-machine interfaces. In fact, recent development in the psychology of emotions and the progression in graphic computing techniques allow us today to animate virtual personages realistically and enable them to express themselves.
Facial animation is one of the most important parts in the field of virtual agents.
Facial animation transfer aims to animate a target face (virtual) from data extracted from a source face (virtual or real, a real image or video).
The main goal of the research is to improve the process of creating facial animations, making it more realistic, and then using these animations in real-time applications.
To achieve this goal the research plan is divided into four stages:
1. Studying and understanding different existent methods of real time facial animation transfers;
2. Creating target models (faces and virtual objects) and automatically detect characteristic points of the source face.
3. Designing and implementing a real time facial animation transfer tool based on radial-based functions
4. Validating the whole system.
The output of the research is to develop algorithms to help IT engineers develop better and faster, real time face animations with emotions. One potential target group could be people with stroke. Avatars with emotions could help their rehabilitation.
Preliminary results can be found in the following publications:
Lei Zhang, Yang Wang, Sen Wang, Dimitris Samaras, Image-Driven Re-targeting and Relighting of Facial Expressions In Computer Graphics International, pp. 11-18, (2005).
Benkő A., Sik Lányi C., Stark J.: Interacting via a Virtual Language Therapy Room, Computer-Based Intervention and Diagnostic Procedures - Applications for Language-Impaired Persons Workshop, 7-8 July 2008, Vienna, Austria, pp. 19-2
Benkő A., Sik Lányi C.: Ambient Intelligence in Multimedia and Virtual Reality Environments for the rehabilitation, Multimedia Techniques For Device and Ambient Intelligence by Damiani E. and Jeong J (Eds.) Springer-Verlag, 2009, pp. 165-178.
Kai Li, Qionghai Dai, Ruiping Wang Yebin Liu, A Data-Driven Approach for Facial Expression Retargeting in Video, IEEE Transactions on Multimedia 16(2):299-310 (2014)
Number of students who can be accepted: 1
Deadline for application: 2017-10-30
2024. IV. 17. ODT ülés Az ODT következő ülésére 2024. június 14-én, pénteken 10.00 órakor kerül sor a Semmelweis Egyetem Szenátusi termében (Bp. Üllői út 26. I. emelet).
Login
