João Maciel: Final Project

FlagVersão Portuguesa


Title Robot Sketch Synthesis (document in Portuguese)(.dvi version)( short paper)

Coordinators

Subject

I'm develloping a system that synthetises human face images, based on natural language descriptions and, possibly, on an interaction scheme between the machine and the user. Systems like this are already used by Police laboratories, but they present sketches built by arranging standard pieces of face images (eyes, noses, ...), resulting images with unreal look. This project has also the porpose of studying the mathematic fundamentals of the approach used, wich can be applyed to many other problems. This approach consists on considering the images as points in a multidimensional space (dimension equals the number of pixels). Using a face base with high number of examples, one can sample the subspace of human face images. The research efford has been applied to find efficient face subspace representations, wich allows us to interpolate between different examples, inside the face subspace (morphing), using a minimum possible number of parameters: morphing

I'm also trying to identify the structure of this subspace and relate it with the holistic properties of the images (expression and other parameters used in high level descriptions). This approach can be generalized to other applications – automatic security systems, based on face recognition; image coding breakthroughs with application in teleconferencing and image databases; computer graphics, animation and virtual reality – and other research areas – classification in general; associative memories; statistics and exploratory multidimensional data analysis. The greatest difficulties come mainly from the subjectivness of the descriptions and difficulty on visualising felt by the user, resulting on descriptions poor on information that can lead to a good reconstruction; this forces the interactive step. Furthermore it is necessary to deal with the complex and related effects of variations in pose, illumination, expression, background ... The hope is the fact that these effects seem not to affect the human ability to recognize faces; this suggests that it might be some approach or coding scheme that reduces the problem to triviality!!



Back to the Homepage


This page is still under construction and is maintained by Ana Saianda

Last update: June 1997