NASSLLI 2022 @ USC
Course on
Multiparty and Multi-floor dialogue structure
Coordinates:
Monday June 20th - Friday June 24th, 2022. THH 116, 10:35AM-11:55AM
+ Zoom
Abstract
Dialogue Structure models how individual contributions in a dialogue (such as autonomous communications and actions of dialogue participants) relate to each other and compose larger units such as conversations or segments, or serve to manage common resources, such as the conversation floor, initiative, and establishing common ground. Most computational and empirical corpus studies of dialogue have focused on the two-party (dyadic) situation.
In this course we will examine aspects of dialogue structure that either emerge only in conversational contexts with more participants, or for which the nature of structuring is qualitatively or quantitatively different with more participants. "Multiparty dialogue" involves more than two participants - so there are more than a single speaker and addressee who swap roles with every turn, and not every non-speaker listener is an addressee. Sometimes one can model aspects of multiparty interactions as a set of dyadic conversations among each pair of relevant participants, but one must still explain how these individual conversations relate to each other. On the other hand, some dialogue phenomena are not easily modelled in this way, and some emergent structural phenomena exist that are not regularly seen in dyadic conversation. Multi-floor dialogue has some elements of multiple conversations (different sets of participants, distinct floor resources), but also some elements of multiparty conversation (more than two participants, at least some topics and goals in common and some information flowing to all, across floors). We will examine taxonomic and computational approaches to modelling several kinds of multi-floor dialogues, including small group conversations, multi-floor teams, chatrooms and message boards and how they relate to and differ from dyadic conversation, attending to issues such as turn-taking, initiative, grounding, dialogue relations, intentional structure, and conversational thread disentanglement.
Each lecture will be accompanied by an annotation exercise using an
annotation scheme covered in class (and in reference material), that can
function as "homework" and discussed at the beginning of the next class.
Pre-Requisites
No formal pre-requisites, but some
familiarity with dialogue and pragmatics will be helpful.
Slides
Optional Homework Assignments
Approximate Syllabus (Lecture Notes available after each class)
- Lecture 1.0: Introduction to Discourse Structure
Overview of course. Types of Linguistic Structure. Approaches to
discourse (monolog) structure beyond the sentence. Approaches to
evaluating structure annotations.
- Lecture 2.0:Dialogue Structure
Intro to Dialogue, relation to discourse structure, Intro to Dialogue
Systems: Types of systems, example systems. Dialogue Structure:
High-level, Hierarchical structures and low-level structures. Speech
Acts and Dialogue Acts. Media Considerations, Turn-taking, Adjacency
Pairs/IR Units, Initiative.
- Lecture 2.7:
Grounding and Multiparty Dialogue
Continuation of dyadic dialogue: Grounding. Examples of multiparty
dialogue and dialogue systems Conversational Mediators.
- Lecture 3.3: Multiparty Dialogue Structure and Intro to Multi-floor Dialogue
Scaling up from two to
several participants, Participant Roles, Speaker and Addressee recognition,
conversational thread disentanglement. Relationships
between conversations.
Multicommunicating.
- Lecture 4.1 Multifloor dialogue structure
Translations across floors. Transactions and Relations. Botlanguage
Project. Use of context.
Bibliography
Main Sources for Lectures
Lecture 1.0
- Bunt, Harry, and Rashmi Prasad. ISO DR-Core (ISO 24617-8): Core concepts for the annotation of discourse relations. Proceedings 12th Joint ACL-ISO Workshop on Interoperable Semantic Annotation (ISA-12). 2016
- Barbara J. Grosz, Candace L. Sidner.Attention,
Intentions, and the
Structure of Discourse.
Computational
Linguistics, volume 12, number 3, July-September 1986, pp.
175-204.
- Hovy, Eduard. In Defense of Syntax: Informational, Intentional, and Rhetorical Structures in Discourse
In Proceedings ACL SIG Workshop on Intentionality and Structure in
Discourse Relations, pages 132--135, June 1993.
- Eduard H Hovy and Elisabeth Maier. 1997. Parsimonious or
profligate: How many and which discourse structure relations.
Discourse Processes.
- Mann, William C. & Sandra A. Thompson. 1988. Rhetorical
Structure Theory: Toward a functional theory of text
organization. Text 8(3). 243-281.
- Rebecca J. Passonneau and Diane J. Litman. 1997. Discourse Segmentation by Human and Automated Means. Computational Linguistics, 23(1):103–139.
Lecture 2.0
-
Harry Bunt, Jan Alexandersson, Jae-Woong Choe, Alex Chengyu
Fang, Koiti Hasida, Volha Petukhova, Andrei Popescu-Belis, Claudia
Soria, and David Traum, ISO 24617-2: A semantically-based standard
for dialogue annotation In proceedings of
the International
Conference on Language Resources and Evaluation (LREC),
Istanbul, Turkey, May 2012.
- Carletta, J. C., Isard, A., Isard, S., Kowtko, J., Doherty-Sneddon,
G., & Anderson, A. (1997). The
Reliability of a Dialogue Structure Coding Scheme. Computational
Linguistics, 23(1), 13-31.
- Elnaz Nouri, David Traum
Initiative Taking in Negotiation, In Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2014
- Massimo Poesio and David R. Traum, Representing Conversation
Acts in a Unified Semantic/Pragmatic Framework, in working notes
of AAAI Fall Symposium on Communicative Action in Humans and
Machines, November, 1997.
Lecture 2.7
- J. Allwood, Nivre, J. and Ahlsén, E. On
the Semantics and Pragmatics of Linguistic Feedback in Journal
of Semantics, 1992
- Clark, H. H., & Schaefer, E. F. (1989).Contributing
to discourse. Cognitive Science , 13, 259-294.
- Fernández, R., & Ginzburg, J. (2002, July). Non-sentential utterances in dialogue: A: Corpus-based study. In Proceedings of the third SIGdial workshop on discourse and dialogue (pp. 15-26).
- Christine Nakatani and David Traum, Coding discourse structure
in dialogue (version 1.0). Technical Report UMIACS-TR-99-03,
University of Maryland.
- David
R. Traum Computational
Models of Grounding in Collaborative Systems,
in
working notes of AAAI Fall Symposium on Psychological Models of
Communication, p. 124-131, November, 1999.
- David R. Traum, Christine H.
Nakatani
Two-level Approach to Coding Dialogue for Discourse Structure:
Activities of the 1998 DRI Working Group on Higher-level
Structures in proceedings of the ACL'99
Workshop Towards Standards and Tools for Discourse Tagging, pp
101--108; June 1999.
Lecture 3.3
- Rieks op den Akker and
David
Traum, A
comparison of addressee detection methods for multiparty
conversations, in proceedings of Diaholmia 2009: the 13th
workshop on the semantics and pragmatics of dialogue. Stockholm, Sweden, June
2009.
- Asher, N., Hunter, J., Morey, M., Benamara, F., & Afantenos,
S. (2016, May).
structure and dialogue acts in multiparty dialogue: the STAC
corpus. In 10th International Conference on Language Resources
and Evaluation (LREC 2016) (pp. 2721-2727).
- Jonathan Ginzburg and Raquel Fernandez. 2005. Scaling up from Dialogue
to Multilogue: Some Principles and Benchmarks. In Proceedings of
the 43rd Annual Meeting of the Association for Computational
Linguistics (ACL2005), pages 231-238, Ann Arbor,
Michigan. Association for Computational Linguistics.
- Novick, D., Walton, L., and Ward, K. (1996). Contribution graphs in multiparty conversations, Proceedings of the International Symposium on Spoken Dialogue (ISSD-96), Philadelphia, PA, October, 1996, 53-56.
- David Traum, Issues in multi-party dialogues, in Advances in
Agent Communication Ed. F. Dignum, Springer-Verlag LNAI 2922
pp. 201-211, 2004.
- Bilyana Martinovski, David
Traum, Susan Robinson, and Saurabh Garg Functions and Patterns of
Speaker and Addressee Identifications in Distributed Complex
Organizational Tasks Over Radio, in Proceedings of Diabruck (7th
Workshop on the Semantics and Pragmatics of Dialogue), pp. 193-194, September 2003.
- Reinsch Jr, N. Lamar, Jeanine Warisse Turner, And Catherine
H. Tinsley. Multicommunicating: A Practice Whose Time Has Come?. Academy of Management Review 33.2 (2008): 391-403.
Lecture 4.1
- Bonial, C., Abrams, M., Baker, A. L., Hudson, T., Lukin, S. M.,
Traum, D., & Voss, C. R. (2021, September). Context Is Key: Annotating Situated Dialogue Relations in Multi-floor Dialogue. In Proceedings of the 25th Workshop on the Semantics and Pragmatics of Dialogue.
- Bonial, C., Hudson, T., Lukin, S. M., Baker, A. L., Hudson, T.,
Traum, D., (2022, August). DRAFT: Making Sense of Stop To be presented in In the ESSLLI 2022
workshop on ANNOTATION, RECOGNITION AND EVALUATION OF ACTIONS (AREA II)
- David Traum, Cassidy Henry, Stephanie Lukin, Ron Artstein,
Felix Gervits, Kimberly Pollard, Claire Bonial, Su Lei, Clare Voss,
Matthew Marge, Cory Hayes and Susan Hill Dialogue Structure
Annotation for Multi-Floor Interaction in
Proceedings of the LREC
2018 conference.
Other references and related work
- Mark Buckley and Magdalena Wolska. A Grounding Approach to Modelling Tutorial Dialogue Structures. In Jonathan Ginzburg, Pat Healey and Yo Sato, editors, Proceedings of LONDIAL 2008, the 12th Workshop on the Semantics and Pragmatics of Dialogue, pages 15-22, London, UK, 2008.
- Harry Bunt, Volha
Petukhova, David Traum, and Jan Alexandersson, Dialogue Act Annotation with the ISO 24617-2
Standard Chapter 6 in
Multimodal Interaction with W3C Standards:
Toward Natural User Interfaces to Everything Ed. Deborah Dahl,
pp. 109--135, 2017.
- Carletta, J., Anderson, A. H., & Garrod, S. (2002). Seeing eye to eye: an account of grounding and understanding in work groups. Cognitive Studies: Bulletin of the Japanese Cognitive Science Society, 9(1), 1-20, March. Invited paper for the special issue entitled "Towards Sciences of Linguistic Communication".
- Clark, H. H. (1996). Using language. Cambridge: Cambridge University Press.
Nils Dahlbaek, Arne Jonsson A coding manual
for the
Linkoping dialogue model (1998)
- Micha Elsner, Eugene Charniak, Disentangling Chat. Computational Linguistics 2010 36 (3): 389-409.
- Kamp, Hans, and Uwe Reyle. From discourse to logic: Introduction to modeltheoretic semantics of natural language, formal logic and discourse representation theory. Vol. 42. Springer Science & Business Media, 2013.
- Lascarides, Alex, and Nicholas Asher. Segmented discourse representation theory: Dynamic semantics with discourse structure. Computing meaning. Springer, Dordrecht, 2008. 87-124.
APA
- I Mushin, L Stirling, J Fletcher, R Wales Discourse structure, grounding, and prosody in task-oriented dialogue Discourse Processes 35 (1), 1-31
- Novick, D., and Ward, K., (1993). Mutual beliefs of multiple conversants: A computational model of collaboration in air traffic control, Proc. of AAAI'93, Washington, DC, July, 1993, 196-201.
- David G. Novick, Iván Gris: Grounding and Turn-Taking
in Multimodal Multiparty Conversation. HCI (4) 2013: 97-106
- Livia Polanyi,
A
formal model of the structure of discourse Journal of
Pragmatics, Volume 12, Issues 5-6, 1988, Pages 601-638.
- Antonio Roque and
David Traum, Degrees of Grounding Based on Evidence of Understanding
In proceedings of
The 9th SIGdial Workshop on
Discourse and Dialogue (SIGdial 2008), June, 2008.
- David R. Traum Rhetorical Relations, Action and Intentionality in Conversation
In Proceedings ACL SIG Workshop on Intentionality and Structure
in Discourse Relations, pages 132--135, June 1993.
- David Traum and Peter Heeman. Utterance Units and Grounding in Spoken Dialogue. Proceedings ICSLP, October, 1996.
- Naomi Yamashita, Rieko Inaba, Hideaki Kuzuoka, Toru Ishida: Difficulties in establishing common ground in multiparty groups using machine translation. CHI 2009: 679-688