cgu coding for verbmobil

This file contains pointers to a set of text files with data of coding this dialogue according to the cgu coding instructions in this document: Discourse Structure Coding Manual

Statistics on this coding excercise

Number of Coders

Number of Utterances

Average ratio of coders per unit

0.30

Agreement

	Begin	Middle	End
PA	0.79	0.78	0.89
PE	0.57	0.51	0.58
Kappa	0.52	0.56	0.74

Data Files

verbmobil.pretty
Original dialogue transcript
talley.verbmobil.cgu
a list of all CGUs identified by any coders. Each line shows the ratio of coders who included this unit in their codings, the tokens comprising the unit, and the coders who included it.
codings.verbmobil.cgu
Transcript augmented with a list, for each utterance, of identified CGUs containing that utterance, as well as information about what ratio of total coders included that unit, and who they are and what they labeled it with.
These three files have the same format as above, except they only show units that begin, don't begin or end, or end with that utterance:
bcodings.verbmobil.cgu mcodings.verbmobil.cgu ecodings.verbmobil.cgu
ctalley.verbmobil.cgu
a transcript with the number of coders who included that as a beginning, middle, and end of a CGU, also includes agreement information and Kappa for all coders

coding files from individual coders.The ones on the right also show the ratio of coders who selected that CGU, and who they were.

	Original	Comparative	Average CGU agreement
chn	verbmobil.cgu.chn	compare.verbmobil.cgu.chn	0.55
diane	verbmobil.cgu.diane	compare.verbmobil.cgu.diane	0.47
heeman	verbmobil.cgu.heeman	compare.verbmobil.cgu.heeman	0.38
jencc	verbmobil.cgu.jencc	compare.verbmobil.cgu.jencc	0.59
julia	verbmobil.cgu.julia	compare.verbmobil.cgu.julia	0.28
owen	verbmobil.cgu.owen	compare.verbmobil.cgu.owen	0.44
traum	verbmobil.cgu.traum	compare.verbmobil.cgu.traum	0.54
venditti	verbmobil.cgu.venditti	compare.verbmobil.cgu.venditti	0.45
ward	verbmobil.cgu.ward	compare.verbmobil.cgu.ward	0.51

All files except verbmobil.pretty, and verbmobil.cgu.coder generated by automatically by a script written by David Traum. (Thanks to Mark Core for the Kappa computation code)