Home Schedule Assignments Special Topics Readings Resources Project Ideas Policies

Special Topic: Dialogue with Different User populations

Sometimes not everyone will behave the same in interacting with a dialogue system: what works well for some populations may not work well with others. This topic explores some of the different types of users (Children vs Adults, Older vs Younger adults, Novices vs Experts) and the differences in behavior. Also of interest is how to adapt to the appropriate user type.

Required Readings (for all students)

  1. Liza Hassel and Eli Hagen Adaptation of an Automotive Dialogue System to Users’ Expertise Proceedings of SIGDIAL 2005.
  2. Chao Zhang, Xuechen Liu, Katherine Ziska, Soobin Jeon, Chi-Lin Yu, and Ying Xu. 2024. Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 274, 1–23. https://doi.org/10.1145/3613904.3642647

Required Readings(for presenter(s) and rapporteur(s))
  1. Bell, Linda and Gustafson, Joakim Child and adult speaker adaptation during error resolution in a publicly available spoken dialogue system, In EUROSPEECH-2003, pp. 613-616.
  2. Raux, Antoine, and Maxine Eskenazi. Non-native users in the let's go!! spoken dialogue system: dealing with linguistic mismatch. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics: HLT-NAACL 2004. 2004.
  3. Georgila K., Wolters M.K., and Moore J.D Learning Dialogue Strategies from Older and Younger Simulated Users Proceedings of SIGDIAL 2010: the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 103–106, The University of Tokyo, September 24-25, 2010.
  4. Gale Lucas, David Traum, Ron Artstein, Jonathan Gratch, Jill Boberg, Alesia Gainer, Emmanuel Johnson, Anton Leuski and Mikio Nakano Culture, Errors, and Rapport-building Dialogue in Social Agents In IVA 2018.
  5. Setareh Nasihati Gilani, David Traum, Arcangelo Merla, Eugenia Hee, Zoey Walker, Barbara Manini, Grady Gallagher, Laura-Ann Petitto, Multimodal Dialogue Management for Multiparty Interaction with Infants In proceedings of the 2018 on International Conference on Multimodal Interaction (ICMI 2018). Best Paper Award.
  6. Tokunaga, S., Tamura, K., & Otake-Matsuura, M. (2021). A dialogue-based system with photo and storytelling for older adults: toward daily cognitive training. Frontiers in Robotics and AI, 8, 644964.

Other Readings
  1. Kristiina Jokinen and Kari Kanto User Expertise Modeling and Adaptivity in a Speech-Based E-Mail System Proceedings of ACL 2004.
  2. Tim Bickmore, Justine Cassell Social Dialogue with Embodied Conversational Agents In J. van Kuppevelt, L. Dybkjaer, and N. Bernsen (eds.), Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems. pp. 23-54. New York: Kluwer Academic. 2005
  3. Theofanis Kannetis and Alexandros Potamianos Towards Adapting Fantasy, Curiosity and Challenge in Multimodal Dialogue Systems for Preschoolers ICMI 2009.
  4. Amanda Stent, Ann Syrdal, Taniya Mishra On the Intelligibility of Fast Synthesized Speech for Individuals with Early-Onset Blindness ASSETS’11, October 24–26, 2011, Dundee, Scotland, UK. Copyright 2011
  5. Jokinen, K., Hiovain, K., Laxström, N., Rauhala, I., Wilcock, G. (2017). DigiSami and Digital Natives: Interaction Technology for the North Sami Language. In: Jokinen, K., Wilcock, G. (eds) Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427. Springer, Singapore. https://doi-org.libproxy1.usc.edu/10.1007/978-981-10-2585-3_1
  6. Oyelami Olufemi Moses (2019), Spoken Dialogue System: Its Applications in the Developing Countries and a Technology for Bridging the Digital Divide and Augmenting Scarce Services in Those Countries.. Asian Journal of Research in Computer Science, 4(2): 1-11.
  7. Divya Tadimeti, Kallirroi Georgila and David Traum Evaluation of Off-the-shelf Speech Recognizers on Different Accents in a Dialogue Domain In Proceedings of the 13th Conference on Langauge Resources and Evaluation (LREC 2022), pp. 6001--6008, 2022.