| Research Area | System Architecture Subsystem | # in Jim's diagram | Researchers | Aut. 05 Deliverables | Win. 06 Deliverables | Spr. 06 Deliverables |
|---|---|---|---|---|---|---|
| Robust Semantic Interpretation | Natural Language Subsystem | #17 and #18 | John D. Matt P. | - LF annotation dataset - Initial version of Word/VerbNet-based parser | - CLib/LF mapping infrastructure - Fragment combination for determining event/entity/role - Action-item LF extraction | - Integration with OGI multimodal integrator - Initial dynamic new-word integration |
| Robust Discourse Processing | Discourse Subsystem | #23 | Matt P. John N. | - Infrastructure for ICSI dialogue act detection and utterance segmentation algorithms | - Floor and adressee detection, incorporating vision input - Initial version of discourse-resolved LFs, feeding back to ASR | - Q/A and dialogue act detection |
| Action-item/Decision Detection | Meeting Understanding Subsystem | #23 and #24 | Matt P. John N. | - Action-item annotation dataset - Argumentation schema design | - Argumentation annotation dataset | - Task/deadline/assignee identification - User-interactive LITW |
| Topic Segmentation and ID | Meeting Understanding Subsystem | #21 and #24 | Stephane L. Matt P. | - Integrate Tenenbaum algorithm - Topic annotation dataset | - Segmentation algorithm | - Identification algorithm - User-interactive LITW |
| Meeting Presentation and Visualization | User Interface Subsystem | #26 and #24 | John N. Patrick E. | - NOMOS-based meeting browsing | - Integration w/ CALO Desktop | - UI feedback to topic and action-item algorithms |
| Ontology and Reasoning | Knowledge and Reasoning Subsystem | #28 | John N. | - Documentation and transfer of OPI/MOKB to SRI | - Dialogue act and argumentation ontology design | - Ontology design implemented |
Aut. = CALO 2.3 code drop = 1 Dec 05
Win. = CALO 2.4 code drop = 1 Mar 06
Spr. = CALO 3.0 code drop = 1 Jun 06
| Component | Inputs | Outputs | On/off-line | Initial version | OS | Software Requirements |
|---|---|---|---|---|---|---|
| Communicative Act Segmenter and Identifier | Gemini parser output Floor/addressee output Prosodic features | Dialogue acts Chosen ASR Hypotheses Utterance segments | on? | CALO 3.0 | ||
| NL Parser and Interpreter | ASR hypotheses/lattices OOV Words | CLib LFs | on? | CALO 2.3 | any | SICStus Prolog; Berkeley DB; 1Gb RAM |
| Discourse Interpretation | Multimodal CLib-LFs Meeting Knowledge Gemini parser output Floor/addressee output Dialogue act output | Dialogue acts Chosen ASR Hypotheses Utterance segments | on? | CALO 3.0 | ||
| Topic Segmenter and Identifier | ASR hypotheses/lattices Agenda, Prep Pack Archived email and chat text | Topic segments Topic word vectors | off | CALO 2.4 | any | Fast CPU; gcc, Java 5.0 |
| Action-Item and Decision-Point Identifier | ASR hypotheses/lattices Project status, ongoing tasks Gemini parser output | Action items | on? | CALO 2.4 | any | Java 5.0 |
| Meeting Browser and User Interface | Everything | Updated/evaluated action items and decisions | on, but off for learning elements | CALO 3.0 | CALO Desktop |
| Deliverable | Initial version |
|---|---|
| Topic annotations of CALO Y2 recordings | Aut. |
| Action-item annotations of CALO Y2 recordings | Aut. |
| Argumentation/Decision-making annotations of CALO Y2 recordings | Win. |
| Software | Description | Potential use in CALO |
|---|---|---|
| NOMOS | Annotation and visualization software for OPI-based annotations (e.g. MOKB) | Can be used as meeting browser, and for annotation purposes |