Semlab Publications

This page lists all Semlab publications. For lists related to individual projects, see the projects page.

2008 / to appear

Leveraging Minimal User Input to Improve Targeted Extraction of Action Items.
Matthew Frampton, Raquel Fernández, Patrick Ehlen, Anish Adukuzhiyil and Stanley Peters.
In Proceedings of the 12th SEMDIAL Workshop on the Semantics and Pragmatics of Dialogue (LONDIAL'08), London, UK.

A Probabilistic Model of Meetings that Combines Words and Discourse Features.
Mike Dowman, Virginia Savova, Tom Griffiths, Konrad Koerding, Josh Tenenbaum and Matthew Purver.
To appear in Transactions on Audio, Speech and Language Processing, special issue on New Approaches to Statistical Speech and Text Processing, IEEE, 2008.

Modelling and Detecting Decisions in Multi-Party Dialogue.
Raquel Fernández, Matthew Frampton, Patrick Ehlen, Matthew Purver and Stanley Peters.
In Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, Columbus, OH, June 2008.

Meeting Adjourned: Off-line Learning Interfaces for Automatic Meeting Understanding.
Patrick Ehlen, Matthew Purver, John Niekrasz, Stanley Peters and Kari Lee.
Proceedings of the International Conference on Intelligent User Interfaces, Canary Islands, Spain, January 2008.

Meeting Structure Annotation: Annotations Collected with a General Purpose Toolkit.
Alexander Gruenstein, John Niekrasz and Matthew Purver.
To appear in L. Dybkjaer and W. Minker, editors, Recent Trends in Discourse and Dialogue (Text, Speech and Language Technology series vol. 39), Springer-Verlag, 2008.

2007

Modeling Speech Disfluency to Predict Conceptual Misalignment in Speech Survey Interfaces.
Patrick Ehlen, Michael F. Schober and Frederick G. Conrad.
Discourse Processes 44(3), pages 245-265, December 2007.

Cellular-Only Substitution in the U.S. as Lifestyle Adoption: Implications for Telephone Survey Coverage.
John Ehlen and Patrick Ehlen.
Public Opinion Quarterly 71(5), pages 717-733, December 2007.

Challenges in Interpreting Spoken Military Commands and Tutoring Session Responses.
Elizabeth Bratt, Karl Schultz, and Stanley Peters.
Proceedings of Grammar Engineering across Frameworks 2007, in the series Studies in Computational Linguistics ONLINE, CSLI Publications, 2007.

Context and Well-formedness: the Dynamics of Ellipsis.
Ronnie Cann, Ruth Kempson and Matthew Purver.
Research on Language and Computation 5(3), pages 333-358, September 2007.

Detecting and Summarizing Action Items in Multi-Party Dialogue.
Matthew Purver, John Dowding, John Niekrasz, Patrick Ehlen, Sharareh Noorbaloochi and Stanley Peters.
In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, Antwerp, Belgium, September 2007.

Resolving "You" in Multi-Party Dialog.
Surabhi Gupta, John Niekrasz, Matthew Purver and Dan Jurafsky.
In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, Antwerp, Belgium, September 2007.

CHAT To Your Destination.
Fuliang Weng, Baoshi Yan, Zhe Feng, Florin Ratiu, Madhuri Raya, Brian Lathrop, Annie Lien, Rohit Mishra, Sebastian Varges, Feng Lin, Matthew Purver, Yao Meng, Harry Bratt, Tobias Scheideck, Zhaoxia Zhang, Badri Raghunathan and Stanley Peters.
In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, Antwerp, Belgium, September 2007.

Generation of Repeated References to Discourse Entities.
Anja Belz and Sebastian Varges.
In Proceedings of the 11th European Workshop on Natural Language Generation, Schloss Dagstuhl, Germany, June 2007.

Multimodal Meeting Capture and Understanding with the CALO Meeting Assistant..
John Niekrasz, Patrick Ehlen, and the DARPA CALO Meeting Assistant Project Team.
Demo at the 4th Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI), Brno, Czech Republic, June 2007.

Automatic Annotation of Dialogue Structure from Simple User Interaction.
Matthew Purver, John Niekrasz and Patrick Ehlen.
In the 4th Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI), Brno, Czech Republic, June 2007.

Disambiguating Between Generic and Referential "You" in Dialog.
Surabhi Gupta, Matthew Purver and Daniel Jurafsky.
In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics (ACL), Prague, Czech Republic, June 2007.

The Multimodal Presentation Dashboard.
Michael Johnston, Patrick Ehlen, David Gibbon, and Zhu Liu.
In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT) 'Bridging the Gap' workshop, Rochester, NY, April 2007.

The CALO Meeting Assistant.
Lynn Voss, Patrick Ehlen and the DARPA CALO Meeting Assistant Project Team.
Demo, in Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT), Rochester, NY, April 2007.

A Conversational In-Car Dialog System.
Baoshi Yan, Fuliang Weng, Zhe Feng, Florin Ratiu, Madhuri Raya, Yao Meng, Sebastian Varges, Matthew Purver, Feng Lin, Annie Lien, Tobias Scheideck, Badri Raghunathan, Rohit Mishra, Brian Lathrop, Harry Bratt and Stanley Peters.
Demo, in Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT), Rochester, NY, April 2007.

A Meeting Browser That Learns.
Patrick Ehlen, Matthew Purver and John Niekrasz.
In Interaction Challenges for Intelligent Assistants: Papers from the 2007 AAAI Spring Symposium, Stanford, CA, March 2007.

2006

The at&t Multimodal Presentation Dashboard.
Michael Johnston, Patrick Ehlen, David Gibbon, and Zhu Liu.
Demo, at the IEEE/ACL 2006 Workshop on Spoken Language Technology (SLT), Palm Beach, Aruba, December 2006.

CLARIE: Handling Clarification Requests in a Dialogue System.
Matthew Purver.
Research on Language and Computation 4(2-3), pages 259-288, October 2006.

Grammars as Parsers: Meeting the Dialogue Challenge.
Matthew Purver, Ronnie Cann and Ruth Kempson.
Research on Language and Computation 4(2-3), pages 289-326, October 2006.

CHAT: A Conversational Helper for Automotive Tasks.
Fuliang Weng, Sebastian Varges, Badri Raghunathan, Florin Ratiu, Heather Pon-Barry, Brian Lathrop, Qi Zhang, Tobias Scheideck, Harry Bratt, Kui Xu, Matthew Purver, Rohit Mishra, Madhuri Raya, Stanley Peters, Yao Meng, Lawrence Cavedon and Liz Shriberg.
In Proceedings of the 9th International Conference on Spoken Language Processing (Interspeech/ICSLP), pages 1061-1064, Pittsburgh, PA, September 2006.

Robust Interpretation in Dialogue by Combining Confidence Scores with Contextual Features.
Matthew Purver, Florin Ratiu and Lawrence Cavedon.
In Proceedings of the 9th International Conference on Spoken Language Processing (Interspeech/ICSLP), pages 1-4, Pittsburgh, PA, September 2006.

Evaluation of Content Presentation Strategies for an In-car Spoken Dialogue System.
Heather Pon-Barry, Fuliang Weng and Sebastian Varges.
In Proceedings of the 9th International Conference on Spoken Language Processing (Interspeech/ICSLP), pages 1930-1933, Pittsburgh, PA, September 2006.

Browsing Meetings: Automatic Understanding, Presentation and Feedback for Multi-Party Conversations.
Patrick Ehlen, Stéphane Laidebeure, John Niekrasz, Matthew Purver, John Dowding and Stanley Peters.
Demo, in Proceedings of the 10th Workshop on the Semantics and Pragmatics of Dialogue (brandial'06), pages 173-174, Potsdam, Germany, September 2006.

Robust Language Analysis and Generation for Spoken Dialogue Systems.
Sebastian Varges and Matthew Purver.
In the ECAI 2006 workshop on Development and Evaluation of Robust Spoken Dialogue Systems for Real Applications, Riva del Garda, Italy, August 2006.

Unsupervised Topic Modelling for Multi-Party Spoken Discourse.
Matthew Purver, Konrad Körding, Tom Griffiths and Josh Tenenbaum.
In Proceedings of COLING/ACL 2006, pages 17-24, Sydney, Australia, July 2006.

Automatically Detecting Action Items in Audio Meeting Recordings.
William Morgan, Pi-Chuan Chang, Surabhi Gupta and Jason M. Brenier.
In Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, pages 96-103, Sydney, Australia, July 2006.

Interactive Question Answering and Constraint Relaxation in Spoken Dialogue Systems.
Sebastian Varges, Fuliang Weng and Heather Pon-Barry.
In Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue, Sydney, Australia, July 2006.

Overgeneration and Ranking for Spoken Dialogue Systems.
Sebastian Varges.
In Proceedings of the International Natural Language Generation Conference (INLG), Sydney, Australia, July 2006.

Shallow Discourse Structure for Action Item Detection.
Matthew Purver, Patrick Ehlen and John Niekrasz.
In the HLT-NAACL workshop Analyzing Conversations in Text and Speech (ACTS), New York, NY, June 2006.

Detecting Action Items in Multi-Party Meetings: Annotation and Initial Experiments.
Matthew Purver, Patrick Ehlen and John Niekrasz.
In Machine Learning for Multimodal Interaction: Third International Workshop, MLMI 2006, Bethesda, MD, May 1-4, 2006, Revised Selected Papers. Lecture Notes in Computer Science, Vol. 4299, pp. 200-211. Renals, S.; Bengio, S.; Fiscus, J. (Eds.). Springer-Verlag. (2006)
© Springer-Verlag, publisher's website version here.

Combining Lexical Resources in a Robust Broad-Coverage Semantic Parser.
John Dowding and Matthew Purver.
In the 7th Annual Stanford Semantics Fest, Stanford CA, USA.

NOMOS: A Semantic Web Software Framework for Annotation of Multimodal Corpora.
John Niekrasz and Alexander Gruenstein.
In the Proceedings of the 5th Conference on Language Resources and Evaluation (LREC 2006), Genoa, Italy (2006).

A Multimodal Discourse Ontology for Meeting Understanding.
John Niekrasz and Matthew Purver.
In Machine Learning for Multimodal Interaction: Second International Workshop, MLMI 2005, Edinburgh, UK, July 11-13, 2005, Revised Selected Papers. Lecture Notes in Computer Science, Vol. 3869, pp. 162-173. Renals, Steve; Bengio, Samy (Eds.). Springer-Verlag. (2006)
© Springer-Verlag, publisher's website version here.

Responding to Student Uncertainty in Spoken Tutorial Dialogue Systems.
Heather Pon-Barry, Karl Schultz, Elizabeth Owen Bratt, Brady Clark, and Stanley Peters.
In International Journal of Artificial Intelligence in Education (IJAIED) Volume 16, 171-194. Special Issue "Best of ITS 2004" (editors James Lester, Rosa Maria Vicari and Fabio Paraguaçu). (2006)

2005

Empirical Foundations for Intelligent Coaching Systems.
Elizabeth Owen Bratt, Karl Schultz, Stanley Peters, Tina Chen, and Heather Pon-Barry.
In Proceedings of the Interservice/Industry Training, Simulation & Education Conference. November 28-December 1, 2005, Orlando FL, USA.

Contextualizing Reflective Dialogue in a Spoken Conversational Tutor.
Heather Pon-Barry, Brady Clark, Karl Schultz, Elizabeth Owen Bratt, Stanley Peters, and David Haley.
Journal of Educational Technology & Society, Vol. 8, Issue 4. pp. 42-51.

Combining Confidence Scores with Contextual Features for Robust Multi-Device Dialogue.
Lawrence Cavedon, Matthew Purver and Florin Ratiu.
In The 3rd ALTA Australasian Language Technology Workshop, Sydney, Australia.

Meeting structure annotation: Data and tools.
Alexander Gruenstein, John Niekrasz, and Matthew Purver.
In The 6th SIGdial Workshop on Discourse and Dialogue, Lisbon, Portugal.

Training a maximum entropy model for surface realization.
H. Cheng, F. Weng, N. Hantaweepant, L. Cavedon, S. Peters.
In Proceedings of the 9th International Conference on Spoken Language Processing (INTERSPEECH), Lisbon, Portugal.

Practical Plug-and-Play Dialogue Management.
Danilo Mirkovic and Lawrence Cavedon.
In Proceedings of the 6th Meeting of the Pacific Association for Computational Linguistics (PACLING), Tokyo, Japan.

Enabling spoken dialogue interaction about team activities.
Laura Hiatt and Lawrence Cavedon.
In 1st International Workshop on Multi-Agent Robotic Systems, Barcelona, Spain.

Collaborative and argumentative models of meeting discussions.
Vincenzo Pallotta, John Niekrasz, and Matthew Purver.
In Proceedings of the 5th Workshop on Computational Models of Natural Argument, Edinburgh, Scotland.

Ontology-based multi-party meeting understanding.
Matthew Purver, John Niekrasz and Stanley Peters.
In Proceedings of the CHI 05 Workshop on The Virtuality Continuum Revisited (Multi-party Interaction), Portland OR, USA.

Developing a Conversational In-Car Dialog System.
Lawrence Cavedon, Fuliang Weng, Rohit Mishra, Harry Bratt, Badri Raghunathan, Hua Cheng, Hauke Schmidt, Danilo Mirkovic, Ben Bei, Heather Pon-Barry, Tobias Scheideck, Brian Lathrop, Joyce Chen, Stanley Peters, Liz Shriberg, Carsten Bergmann.
In the 12th International Congress on Intelligent Transportation Systems, San Francisco CA, USA.

A Wizard of Oz framework for collecting spoken human-computer dialogs: An experiment procedure for the design and testing of natural language in-vehicle technology systems.
Brian Lathrop, Hua Cheng, Fuliang Weng, Rohit Mishra, Joyce Chen, Harry Bratt, Lawrence Cavedon, Carsten Bergmann, Tess Hand-Bender, Heather Pon-Barry, Benjamin Bei, Madhuri Raya, Liz Shriberg.
In the 12th International Congress on Intelligent Transportation Systems, San Francisco CA, USA.

Ontology-based discourse understanding for a persistent meeting assistant.
John Niekrasz, Matthew Purver, John Dowding and Stanley Peters.
In Proceedings of the 2005 AAAI Spring Symposium on Persistent Assistants, Stanford CA, USA.
© American Association of Artificial Intelligence

Towards spoken dialogue with multi-robot teams.
Laura Hiatt and Lawrence Cavedon.
In Proceedings of the 2005 AAAI Spring Symposium on Dialogical Robots, Stanford CA, USA. © American Association of Artificial Intelligence

2004

A Wizard-of-Oz framework for collecting spoken human-computer dialogs.
Hua Cheng, Harry Bratt, Rohit Mishra, Elizabeth Shriberg, Sandra Upson, Joyce Chen, Fuliang Weng, Stanley Peters, Lawrence Cavedon, John Niekrasz.
In Proceedings of the 8th International Conference on Spoken Language Processing (Interspeech - ICSLP '04), Jeju Island, Korea.

A conversational dialogue system for cognitively overloaded users.
F. Weng, L. Cavedon, B. Raghunathan, D. Mirkovic, H. Cheng, H. Schmidt, H. Bratt, R. Mishra, S. Peters, L. Zhao, S. Upson, E. Shriberg, C. Bergmann.
In Proceedings of the 8th International Conference on Spoken Language Processing (Interspeech - ICSLP '04), Jeju Island, Korea.

A multimodal learning interface for sketch, speak and point creation of a schedule chart.
Ed Kaiser, David Demirdjian, Alexander Gruenstein, Xiaoguang Li, John Niekrasz, Matt Wesson, and Sanjeev Kumar.
In Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI '04), State College PA, USA.

Multi-human dialogue understanding for assisting artifact-producing meetings.
John Niekrasz, Alexander Gruenstein, and Lawrence Cavedon.
In Proceedings of the 20th International Conference on Computational Linguistics (COLING '04), Geneva, Switzerland.

Managing uncertainty in dialogue information state for real time understanding of multi-human meeting dialogues.
Alexander Gruenstein, Lawrence Cavedon, John Niekrasz, Dominic Widdows, and Stanley Peters.
In Proceedings of the 8th Workshop on Formal Semantics and Pragmatics of Dialogue (SemDial - Catalog '04), Barcelona, Spain.

Multithreaded context for robust conversational interfaces: context-sensitive speech recognition and interpretation of corrective fragments.
Oliver Lemon and Alexander Gruenstein.
In ACM Transactions on Computer-Human Interaction, 11(3):241-267.

Using an activity model to address issues in task-oriented dialogue interaction over extended periods.
Alexander Gruenstein and Lawrence Cavedon.
In Proceedings of AAAI Spring Symposium on Interaction Between Humans and Autonomous Systems over Extended Periods.

Intelligent Systems for Training Damage Control Assistants.
Stanley Peters, Elizabeth Owen Bratt, Brady Clark, Heather Pon-Barry, Karl Schultz.
In Proceedings of I/ITSEC 2004, Orlando FL, USA.

Spoken Dialogue for Simulation Control and Conversational Tutoring
Elizabeth Owen Bratt, Karl Schultz and Brady Clark.
In Demonstration Papers at HLT-NAACL 2004.

Evaluating the Effectiveness of SCoT: a Spoken Conversational Tutor.
Heather Pon-Barry, Brady Clark, Elizabeth Owen Bratt, Karl Schultz, and Stanley Peters.
In Proceedings of ITS 2004 Workshop on Dialogue-based Intelligent Tutoring Systems: State of the Art and New Research Directions. Maceio, Brazil. 23-32.

Advantages of Spoken Language in Dialogue-based Tutoring Systems.
Heather Pon-Barry, Brady Clark, Karl Schultz, Elizabeth Owen Bratt, and Stanley Peters.
In Proceedings of ITS 2004, 7th International Conference on Intelligent Tutoring Systems. Maceio, Brazil. Lecture Notes in Computer Science 3220 Springer 2004, ISBN 3-540-22948-5. pp 390-400.

Contextualizing Learning in a Reflective Conversational Tutor.
Heather Pon-Barry, Brady Clark, Karl Schultz, Elizabeth Owen Bratt, and Stanley Peters.
In Proceedings of the 4th IEEE International Conference on Advanced Learning Technologies. Joensuu, Finland.

Speaking while monitoring addressees for understanding.
Herbert H. Clark and Meredyth A. Krych.
Journal of Memory and Language, 50(1), 62-81.

Navigating joint projects in telephone conversations.
Adrian Bangerter, Herbert H. Clark, and Anna R. Katz.
Discourse Processes, 37, 1-23.

2003

An information state approach in a multi-modal dialogue system for human-robot conversation.
Oliver Lemon, Anne Bracy, Alexander Gruenstein, and Stanley Peters.
In Hans Reiser, Peter Kunlein, and Henk Zeevat, editors, Perspectives on Dialogue in the new Millennium, volume 114 of Pragmatics and Beyond, pages 229-242. John Benjamins.

Managing dialogue interaction: a multi-layered approach.
Oliver Lemon, Lawrence Cavedon and Barbara Kelly.
In The 4th SIGdial Workshop on Discourse and Dialogue

A Scalable, Reusable Spoken Conversational Tutor: SCoT.
Karl Schultz, Elizabeth Owen Bratt, Brady Clark, Stanley Peters, Heather Pon-Barry, and Pucktada Treeratpituk.
In AIED 2003 Supplementary Proceedings, University of Sydney. 367-377.

Intelligent Tutoring for Non-Deterministic and Dynamic Domains.
Zack Thomsen-Gray, Karl Schultz, Brady Clark, Elizabeth Owen Bratt, and Stanley Peters.
In Ulrich Hoppe, Felisa Verdejo, and Judy Kay, eds. Artificial Intelligence in Education. Amsterdam: IOS Press. 506-508.

The Gerona Knowledge Ontology and Its Support for Spoken Dialogue Tutoring of Crisis Decision Making Skills.
David M. Fried, David C. Wilkins, Eugene Grois, Stanley Peters, Karl Schultz, and Brady Clark.
In Proceedings of the 3rd Workshop on Knowledge and Reasoning in Practical Dialogue Systems, 79-89.

SCoT: A Model of Conversational and Tutorial Intelligence.
Brady Clark, Elizabeth Owen Bratt, Stanley Peters, Karl Schultz and Martha Evens.
In Proceedings of the 25th Annual Meeting of the Cognitive Science Society.

2002

Conversational Interfaces: a Domain-Independent Architecture for Task-Oriented Dialogues.
Alexander Gruenstein.
Master's thesis, Stanford University.

A General Purpose Architecture for Intelligent Tutoring Systems.
Brady Clark, Elizabeth Owen Bratt, Oliver Lemon, Stanley Peters, Heather Pon-Barry, Zack Thomsen-Gray, and Pucktada Treeratpituk.
In Proceedings of the International CLASS Workshop on Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems. Copenhagen, Denmark. Also in J. van Kuppevelt, L. Dubkjaer, and N.O. Bernsen (eds.) Advances in Natural Multimodal Dialogue Systems. Springer. 2005.

Model-Based Reasoning for Tutorial Dialogue in Shipboard Damage Control.
Elizabeth Owen Bratt, Brady Clark, Zack Thomsen-Gray, Stanley Peters, Pucktada Treeratpituk, Heather Pon-Barry, Karl Schultz, David C. Wilkins, and David Fried.
In Model Based Systems and Qualitative Reasoning for Intelligent Tutoring Systems, International workshop at ITS 2002, San Sebastian, Spain. 63-69.

2001

A Multimodal Intelligent Tutoring System for Shipboard Damage Control.
Brady Clark, John Fry, Matt Ginzton, Stanley Peters, Heather Pon-Barry, and Zack Thomsen-Gray.
In Proceedings of the International Workshop on Information Presentation and Multimodal Dialogue (IPNMD-2001), Verona, Italy. 121-125.

Automated Tutoring Dialogues for Training in Shipboard Damage Control.
John Fry, Matt Ginzton, Stanley Peters, Brady Clark and Heather Pon-Barry.
In Proceedings of the 2001 SIGdial Workshop, Aalborg, Denmark. 68-71.

The WITAS Multi-Modal Dialogue System I
Oliver Lemon, Anne Bracy, Alexander Gruenstein, and Stanley Peters, In proceedings EuroSpeech 2001.