Paper Title Number 3
Published in Journal 1, 2015
This paper is about the number 3. The number 4 is left for future work.
Recommended citation: Your Name, You. (2015). "Paper Title Number 3." Journal 1. 1(3).
Download Paper | Download Slides
Publications
You can also find my articles on my Google Scholar profile.
Journal Articles
Paper Title Number 2
Published in Journal 1, 2010
This paper is about the number 2. The number 3 is left for future work.
Recommended citation: Your Name, You. (2010). "Paper Title Number 2." Journal 1. 1(2).
Download Paper | Download Slides
Paper Title Number 1
Published in Journal 1, 2009
This paper is about the number 1. The number 2 is left for future work.
Recommended citation: Your Name, You. (2009). "Paper Title Number 1." Journal 1. 1(1).
Download Paper | Download Slides | Download Bibtex
Conference Papers
Disentangling annotator skill from verifier strictness in cross-verified dialogue annotation
Published in Special Interest Group on Discourse and Dialogue 27, 2026
Some dialogue corpus projects use a verify-after-annotation workflow: a second team member reviews a submitted file and records corrections. The resulting correction count mixes two signals, annotator accuracy and verifier strictness. We separate these signals for RASwDA, an audio-anchored re-alignment of 1,045 Switchboard file sides (105,005 corrections across 977 change logs) produced by five team members in 2024-2025. Verification is crossed: each of three identified annotators was checked by four different verifiers, with overlap in both directions. A cross-classified mixed-effects model on per-file corrections-per-interval assigns 10.8% of the variance to annotator identity, while the verifier random effect collapses to zero (singular fit, stable across seven leave-one-out and response-choice refits). Thus, for this boundary-realignment task, we find no detectable verifier identity effect once annotator identity, batch, and file length are controlled. Boundary placement, not label selection, accounts for 58.5% of corrections corpus-wide. This helps explain why verifier-specific strictness has little room to appear: timestamp adjustments are anchored in the audio, while DA-label changes account for only 3.0% of corrections. We release the action-typed change logs so other projects can run the same annotator-verifier decomposition on their own verification data.
Recommended citation: Zihao, T., J. Prado, I. LaManna, R. Puterbaugh, M. Datta, & J. Hirschberg. (2026). "Disentangling annotator skill from verifier strictness in cross-verified dialogue annotation." Special Interest Group on Discourse and Dialogue 27, 414--422.
Download Paper
Completing and validating the Re-aligned Switchboard Dialog Act Corpus
Published in Linguistic Annotation Workshop 20, 2026
Although widely used in dialog act prediction and generation, the Switchboard Dialog Act (SwDA) corpus has performed poorly in models incorporating prosodic information because of misalignment between speech and text data. In this paper, we report our completion of the work begun in Chen et al. (2024) in addressing these misalignment issues with an improved SwDA corpus called RASwDA (Re-Aligned Switchboard Dialog Act Corpus). Now fully re-aligned and validated, RASwDA finally meets standards of accuracy allowing for classification models trained on it to exceed classification benchmarks set by models trained on other Switchboard subcorpora.
Recommended citation: Chen, R., Z. Tao, J. Prado, I. LaManna, R. Puterbaugh, M. Datta, & J. Hirschberg. (2026). "Completing and validating the Re-aligned Switchboard Dialog Act Corpus." Proceedings of the Linguistic Annotation Workshop 20, 173--177. https://doi.org/10.18653/v1/2026.law-main.13.
Download Paper