Curriculum Vitae

 

Home
Projects
Publications
Curriculum Vitae
Videos
Softwares

Louis-Philippe Morency

University of Southern California

Institute for Creative Technologies

13274 Fiji Way

Marina del Rey,CA 90292 USA

Phone: (310) 448-5323

 

morency@ict.usc.edu

http://people.ict.usc.edu/~morency/

Education

 

Ph.D. in Computer Science

Massachusetts Institute of Technology

Thesis title: Context-based Visual Feedback Recognition

 

October 2006

Cambridge, MA

 

 

S.M. in Computer Science

Massachusetts Institute of Technology

 

June 2002

Cambridge, MA

 

B.A. in Computer Engineering

Laval University

June 2000

Quebec city, Canada

Research Interests

Computer vision: visual gesture recognition, motion tracking, facial expression.
Human-computer interaction: robot interactions, intelligent virtual agents.
Machine learning: multimodal integration, semi-supervised learning.

Research Experience

 

Research Scientist        

University of Southern California, Institute for Creative Technologies

Research topics: multimodal perception, interactions with virtual agents, nonverbal behaviors generation, context-based recognition.

 

2007-present

Marina del Rey, CA

 

 

Postdoctoral Associate        

Massachusetts Institute of Technology

Research topics: visual feedback recognition, embodied conversational agents, multi-modal integration.

 

2006-2007

Cambridge, MA

 

 

Research Assistant

Massachusetts Institute of Technology

Research topics: context-based visual gesture recognition, human-computer interaction, head pose estimation, 3D view registration.

 

2000-2006

Cambridge, MA

 

 

Research Intern

Honda Research Institute USA

Research topic: robot localization algorithm for indoor environment using stereo camera

 

Summer 2002

Mountain View, CA

 

 

Research Assistant

Computer vision and systems laboratory, Laval University

Research topic: three-dimensional object recognition and pose estimation.

1998-1999

Quebec city, Canada

 

Teaching Experience

 

Teaching Assistant

Massachusetts Institute of Technology

Computer vision and applications: Prepared problem sets, offered office hours and gave short tutorials.

 

Spring 2003

Cambridge, MA

 

 

Teaching Assistant

Laval University

Algorithms for Engineers I: Data structures, algorithms and oriented object programming.

C++ programming for Unix: Assisted 100 students with problem sets and class projects.

 

1998-1999

Quebec city, Canada

 

 

Instructor

Bois-de-Boulogne College

Taught an introductory computer science and web design course to 25 students. Responsible for designing curriculum, daily lectures, and final project.

 

Summer 1998

Montreal, Canada

 

 

Science Tutor

Sainte-Foy College

Provided individual tutoring to students in physics and mathematics.

1995-1996

Quebec city, Canada

 

Awards and honors

AI's 10 to Watch, IEEE Intelligent Systems, 2008

Best paper award, International Conference on Multimodal Interfaces, 2008

Best paper award, IEEE International Conference on Automatic Face and Gesture Recognition, 2008

Best paper award, International Conference on Intelligent Virtual Agents, 2008

Best paper award, International Conference on Multimodal Interfaces, 2006

Best paper award, International Conference on Multimodal Interfaces, 2005

Best tutor award, Sainte-Foy College, 1996

Honor Roll, Laval University, 1996-1997

Publications

Book chapter

L.-P. Morency, C. Sidner, and T. Darrell, Visual Feedback Recognition for Embodied Agent: The role of contextual information, Engineering Approaches to Conversational Informatics, Toyoaki Nishida, Editor. John Wiley & Sons, to be published in 2007

Journal papers

  1. J. Hendler, P. Cimiano, D. Dolgov, A. Levin, P. Mika, B. Milch, L.-P. Morency, B. Motik, J. Neville, E. B. Sudderth, and L. von Ahn, AI's 10 to Watch. Intelligent Systems, IEEE press, May/June 2008 

  2. L.-P. Morency, C. Sidner, C. Lee, and T. Darrell, Head Gestures for Perceptual Interfaces: The Role of Context in Improving Recognition. Artificial Intelligence. Elsevier, accepted for publication, 2006

  3. A. Quattoni, S. Wang, L.-P. Morency, M. Collins, and T. Darrell, Hidden-state Conditional Random Fields, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), accepted for publication, 2006

  4. A. Rahimi, L.-P. Morency, and T. Darrell, Reducing Drift in Differential Tracking, Computer Vision and Image Understanding (CVIU), accepted for publication, 2006

  5. C. M. Christoudias, L.-P. Morency, and T. Darrell, Non-parametric and Light-field Deformable Models, Computer Vision and Image Understanding (CVIU), 104(1):16-35, October 2006

Refereed conference papers

  1. L.-P. Morency, I. de Kok and J. Gratch,  Context-based Recognition during Human Interactions: Automatic Feature Selection and Encoding Dictionary, 10th International Conference on Multimodal Interfaces (ICMI 2008), October 2008 **Best paper award**

  2. L.-P. Morency, J. Whitehill and Javier Movellan,  Generalized Adaptive View-based Appearance Model: Integrated Framework for Monocular Head Pose Estimation, 8th International Conference on Automatic Face and Gesture Recognition (FG 2008), September 2008 **Best paper award**

  3. L.-P. Morency, I. de Kok and J. Gratch,  Predicting Listener Backchannels: A Probabilistic Multimodal Approach, Conference on Intelligent Virutal Agents (IVA 2008), September 2008 **Best paper award** 

  4.  X. Sun, L.-P. Morency, D. Okanohara, Y Tsuruoka and Jun’ichi Tsujii,  Modeling Latent-Dynamic in Shallow Parsing: A Latent Conditional Model with Improved Inference, The 22nd International Conference on Computational Linguistics (COLING 2008), August 2008 

  5. L.-P. Morency, A. Quattoni and T. Darrell,  Latent-Dynamic Discriminative Models for Continuous Gesture Recognition, Proceedings IEEE Conference on Computer Vision and Pattern Recognition, June 2007 

  6. L.-P. Morency and T. Darrell, Conditional Sequence Model for Context-based Recognition of Gaze Aversion, 4th Joint Workshop on Machine Learning and Multimodal Interaction, June 2007  

  7. J. Gratch, N. Wang, A. Okhmatovskaia, F. Lamothe, M. Morales and L.-P. Morency,  Can virtual humans be more engaging than real ones?, 12th International Conference on Human-Computer Interaction, Beijing, China 2007

  8. L.-P. Morency, C. M. Christoudias, and T. Darrell, Recognizing Gaze Aversion Gestures in Embodied Conversational Discourse, International Conference on Multimodal Interactions (ICMI’06), Banff, Canada, November 2006

  9. C. M. Christoudias, K. Saenko, L.-P. Morency, and T. Darrell, Co-Adaptation of Audio-Visual Speech and Gesture Classifiers, International Conference on Multimodal Interactions (ICMI’06), Banff, Canada, November 2006 **Best paper award**

  10. J. Gratch, A. Okhmatovskaia, F. Lamothe, S. Marsella, M. Morales, R. J. van der Werf, and L.-P. Morency, Virtual Report, 6th International Conference on Intelligent Virtual Agents (IVA’06) Marina del Rey, CA, August 2006

  11. L.-P. Morency, C. Sidner, C. Lee, and T. Darrell, The Role of Context in Head Gesture Recognition, The Twenty-First National Conference on Artificial Intelligence, Nectar track (AAAI’06), Boston, MA, July 2006

  12. S. Wang, A. Quattoni, L.-P. Morency, D. Demirdjian, and T. Darrell, Hidden Conditional Random Fields for Gesture Recognition, Conference on Computer Vision and Pattern Recognition (CVPR’06), New York City, NY, June 2006

  13. C. Sidner, C. Lee, L.-P. Morency, and C. Forlines, The Effect of Head-Nod Recognition in Human-Robot Conversation, Annual Conference on Human-Robot Interaction (HRI’06) Salt Lake City, Utah, USA, March 2006

  14. L.-P. Morency, and T. Darrell, Head Gesture Recognition in Intelligent Interfaces: The Role of Context in Improving Recognition, International Conference on Intelligent User Interfaces (IUI'06), Sydney, Australia, 2006

  15. L.-P. Morency, C. Sidner, C. Lee, and T. Darrell, Contextual Recognition of Head Gestures, International Conference on Multimodal Interactions (ICMI'05), pp.18-24, Italy, October 2005 **Best paper award**

  16. L.-P. Morency, C. Sidner, and T. Darrell, Towards Context-Based Visual Feedback Recognition for Embodied Agents, Symposium on Conversational Informatics for Supporting Social Intelligence and Interaction (AISB'05), pp.69-72, Hatfield, UK, April 2005

  17. L.-P. Morency, and T. Darrell, From Conversational Tooltips to Grounded Discourse: Head Pose Tracking in Interactive Dialog Systems, International Conference on Multimodal Interfaces (ICMI’04), pp. 32-37, 2004

  18. C. M. Christoudias, L.-P. Morency, and T. Darrell, Light Field Appearance Manifolds, European Conference on Computer Vision (ECCV’04), vol. 4, pp.481-493, Pragues, Czech Republic, May 2004

  19. C. Lee, N. Lesh, C. Sidner, L.-P. Morency, A. Kapoor, and T. Darrell, Nodding in Conversations with a Robot, CHI extended abstracts (CHI’04), pp. 785-786, Vienna, Austria, 2004

  20. M. Siracusa, L.-P. Morency, K. Wilson, J. Fisher, and T. Darrell, A Multi-Modal Approach for determining  Speaker Location and Focus, International Conference on Multimodal Interactions (ICMI’03), pp. 77-80, 2003

  21. L.-P. Morency, A. Rahimi, and T. Darrell, Adaptive View-based Appearance Model, Computer Vision and Pattern Recognition (CVPR’03), vol. 1, pp. 803-810, Wisconsin, June 2003

  22. L.-P. Morency, P. Sundberg, and T. Darrell, Pose Estimation using 3D View-Based Eigenspaces, ICCV workshop on Analysis and Modeling of Face and Gesture, pp. 45-52, Nice, France, October 2003

  23. L.-P. Morency and R. Gupta, Robust Real-time Egomotion from Stereo Images, International Conference on Image Processing (ICIP’03), vol. 3, pp. 719-722, Barcelona, Spain, September 2003

  24. L.-P. Morency and T. Darrell, Stereo Tracking using ICP and Normal Flow Constraint, International Conference on Pattern Recognition (ICPR 2002), vol. 3, pp. 367-372, Quebec city, Canada, August 2002

  25. L.-P. Morency, A. Rahimi, N. Checka, and T. Darrell, Fast Stereo-based Head Tracking for Interactive Environment, International Conference on Automatic Face and Gesture Recognition (FG 2002), pp. 375-380, 2002

  26. T. Darrell, K. Tollmar, F. Bentley, N. Checka, L.-P. Morency, A. Rahimi, and A. Oh, Fast-responsive Interfaces: from Direct Manipulation to Perceptive Presence, International Conference of Ubiquitous Computing (Ubicom’02) pp. 135-151, 2002

  27. A. Oh, H. Fox, M. Van Kleek, A. Adler, K. Gajos, L.-P. Morency, and T. Darrell, Evaluating Look-to-Talk: A Gaze-Aware Interface in a Collaborative Environment, CHI extended abstracts (CHI’02), pp. 650-651, 2002

  28. A. Rahimi, L.-P. Morency, and T. Darrell, Bounded error parametric motion tracking, International Conference on Computer Vision (ICCV’01), vol. 1, pp. 315-322, Vancouver, Canada, July 2001

Theses

  1. L.-P. Morency, Context-based Visual Feedback Recognition, PhD thesis, CSAIL Technical report MIT-CSAIL-TR-2006-075, October 2006

  2. L.-P. Morency, Stereo-Based Head Pose Tracking Using Iterative Closest Point and Normal Flow Constraint, Master thesis, AI Technical report 2003-006, June 2002

Invited talks

Workshop on Facial and Bodily Expressions for Control and Adaptation of Games (ECAG'08), September 2008

Panelist at the Special session on Multi-sensor HCI for Smart Environments at the Conference on Automatic Face and Gesture Recognition, September 2008

Tokyo University, Tsujii Lab, September 2008

Massachusetts Institute for Creative Technologies, Vision seminar,  May 2008

University of Chicago, McNeil Lab, December 2007

Nothwertern University, ArticulLab, December 2007

University of California, San Diego, Machine perception Laboratory, November 2007

Mitsubishi Electronic Research Laboratories, April 2006

Boston University, Image and Video Computing Group, March 2006

Service

Area chair and program committee for International Conference of Multimodal Interaction (ICMI) 2008

Program committee for International Conference of Multimodal Interaction (ICMI) 2009

Program committee for International Conference on Intelligent User Interfaces (IUI) 2009

Program committee for AAAI 2009 Spring Symposium on Human Behavior Modeling

Reviewer for IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), IEEE Transaction on Multimedia (MM), IEEE Transactions on Robotics (TRO), International Journal Pattern Recognition and Artificial Intelligence (IPRAI)

References

Trevor Darrell, Adjunct Associate Professor, University of California, Berkeley, trevor@eecs.berkeley.edu

Candace Sidner, Principal Research Engineer, BAE Systems AIT, Burlington MA, candy.sidner@alumni.mit.edu

Jonathan Gratch, Research Associate Professor, University of Southern California, gratch@ict.usc.edu

Matthew Turk, Professor, University of California, Santa Barbara, mturk@cs.ucsb.edu

Anton Nijholt, Full Professor of Computer Science, University of Twente, Netherland, anijholt@cs.utwente.nl

Michael Collins, Assistant Professor, Massachusetts Institute of Technology, mcollins@csail.mit.edu

 

This page was last updated on 11/04/08.