r3 - 16 Nov 2005 - 23:02:27 - JohnNiekraszYou are here:  Calo Web > IetQuestionsYearTwo?  > IetQuestionsAnalysisY2

CSLI Analysis of IET Questions

Goals for Question Analysis

The following goals need to be reached on the meeting-relevant IET questions:

  • Which knowledge is required to answer the question?
  • What sort of reasoning over that knowledge is required?
  • Which components explicitly provide this required knowledge?
  • Does the question require presentation to the system prior to processing?
  • Are we actually attempting to answer the question in year 2 test?
  • What is the likelihood of answering the question and demonstrating learning?
  • What are the currently unresolved ontology / MOKB issues preventing us from asking/answering the question?
  • What ontological components are used to formally address the question?

Question Analysis

This attachment currently presents our latest version of IET questions analysis.

Question Evaluation

Good Questions

No. Sect. Question Analysis Diagram and MOKB query
40 Attendance Recording List all of the participants in meeting or conference. We interpret this to ask who actually attended the meeting, not who was scheduled to attend. The latter question would have to be addressed to the "prep pack" agenda, not the recording of meeting events in MOKB. Meetings are Events which have a time interval of occurrence. The meeting-participant field of Meeting is interpreted as "intended participant", and is therefore ignored. There are currently two methods of determining attendace: by registration in MR, or by detection via AV awareness. Either of these are valid. The diagram shows both. If using Register, you simply need to detect existence of the relation. For AV awareness, you need to see if the Place is the same for them and times overlap between the Meeting and BeingInRoom event. DIAGRAM
119 Dynamically Present Documents Which meeting artifact was in focus at time during meeting. meeting artifact: Document, meeting: Meeting. We will know when a Document appears to the participants on the whiteboard or in slides; this is modelled by the Display action. In simple cases this question can be answered by querying for the agent of a Display action at the required time. In more complex cases, where more than one document is displayed at a time, or a document has been displayed for a long period of time but the dialogue has since moved on to a new topic, we need to distinguish which document is "in focus": this must come from discourse interpretation, and will be available via membership of the salience-list of Communicate actions. Currently, we do not emply this technique in the system, and the former intepretation should be used. DIAGRAM
159 Generate Copies How many people are participating in meeting? This looks like a Task Setup question, prior to the meeting. If it's intended as a post-meeting question, see 40.  
173 Identify Interactions Who answered the question asked by person during meeting at time? This question assumes that there is a question being asked at time. The answer comes directly from discourse interpretation, by querying for an Answer event (a subtype of Communicate) whose antecedent is a Request event (another subtype of Communicate) at the required time. DIAGRAM
207 Maintain Project Plan What is the start date for project? This answer must come from the Project ontology, although this information will be filled in by MMD components, e.g. Charter.  
208 Maintain Project Plan Which tasks must be completed before project is completed? see 207  
222 Note Departures Who was present at meeting while item was discussed. This combines discourse and PA histories. First, we query to find the Discourses relating to the specified Issue (or item), and its start and end times. Then, we query the agents of BeingInTheRoom events over this timespan. Note that this requires the item in the question to be specified in the same format as Issues, i.e. as Questions. DIAGRAM
233 Participant Tracking Who spoke ordinal after the commencement of discussion of topic at meeting? topic: an Issue. Query for TopicDiscussion events whose topic attribute is the required Issue. Then query for its Communicate events, and find the ordinal event on the basis of their start times. This time-based ordering is not a capability provided directly by MOKB but must be done by some other means (unless we decide to fill the next-event attribute of Communicate events to create an explicit ordering).  
234 Participant Tracking To which object did person point during discussion of topic at meeting. person: Person, topic: TopicDiscussion.topic (an Issue), meeting: Meeting. Query TopicDiscussion events from the Discourses of Meeting to find those with attribute topic. Then search for all of the objects of Point events which occurred during those TopicDiscussions.  
253 Record Action Items List the action items generated at the meeting and persons responsible for each. action item: Task and Issue. We consider an action item to be a Task which was proposed by some Communicate event. We find the set of Communicate events which are also Proposals whose Information is a Task. We can narrow these down to agreed action items by considering only those Proposal events which are antecedents to Agree or Accept events. The Task attributes will contain information about the reponsible parties (presumably they have agents), though this is not modelled in this ontology. Note that these will not necessarily be the same people who Agreed.  
254 Record Action Items What are the prerequisites required for action item and who is responsible for each? See 253 for listing action items and responsible people. Prerequisites must come from the Project ontology?  
302 Track Contributions Based on observed behavior at meeting taking place, determine who was the primary discussant for each of the meeting items. meeting item: an Issue. Query for TopicDiscussion events whose topic attribute is the required Issue. Then query for its Communicate events, and find the most common value of their agent attributes. Again, this last analysis must be performed by some means outside MOKB.  
303 Track Discussion Threads Which of the following set of topics were discussed at meeting. Query Meeting for Meeting.discourses. Query Discourse for Discourse.subevent which are TopicDiscussion. Query each for TopicDiscussion.topic and compare with list. There needs to be an external mechanism to go through each element in the list.  
304 Track Discussion Threads Order the set of topics in terms of time spent in discussion during meeting. Get all TopicDiscussion from Meeting as above. Get length by comparing start and end time of the Event. Order. This requires external reasoning mechanisms.  
309 Track Meeting Artifacts To which of the following presentation slide and assertion did person point during? (assuming this should read e.g. during meeting, or perhaps time-period) Query for all point gestures in the Meeting or Discourse, or based on their start/end times, depending on what is intended here. To find the gestures: query for Convey events where the agent is the required Person and the Message is in the Language of Gesture. If that Message contains a Point (which is both a LinguisticUnit and DeicticGesture), we can reference the object of the unit and match it to the presentation slide.  

More Problematic Questions

No. Sect. Question Analysis External Requirement
4 Action Item Follow Up An action item from meeting was recorded but the name of the person responsible for action item is missing. Determine, for each of the meeting attendees person, the probability that the action item was assigned to him or her. We can query directly for action item assignees: find the agent of the specified Task (action item), where that Task is the object of a Proposal Communicate event, possibly also the antecedent of a subsequent Agree Communicate event. At the moment, we won't be able to assign probabilities other than returning 0 or 1 depending on whether the specified Person matches the agent. Full probabilistic model in MOKB
153 Gather Information What is the project status, from the set on schedule, behind schedule, completed, of task?   Project ontology
154 Gather Information What is the project status, from the set on schedule, behind schedule, completed, of each task on which task depends?   Project ontology
201 Locate Information Given an action item from meeting, generate a ranked list of discussions from previous meetings that are relevant to the action item. We can query for Discussions from previous Meetings whose topic attribute is an Issue which is answered by Task (the action item). Inferring answerhood won't be part of MOKB's capabilities, though, so must be done externally. To begin with we will only have simple notions of answerhood, so will only spot issues which match the action item proposition directly, and will not be able to rank the results Full probabilistic model; detailed notions of relevance and answerhood
209 Maintain Project Plan Which tasks will be affected if task is delayed/completed early?   Project ontology
223 Note Emotional Disposition Of these people, who disagreed with one or more of the assertions in document? We can directly answer the related question of who disagreed with an assertion in the meeting: query for Disagree Communicate events whose antecedent is a Communicate event with object being the required assertion. Relating this to a document's assertions is a separate problem. Document-assertion associations
224 Note Emotional Disposition Which action from the list create, erase, append etc did person perform on meeting-artifact? Provided that Create, Erase etc are Actions which are detected and asserted by the relevant agents (Charter etc), these can be queried directly by looking for those with the required Person as agent and Artifact as object.  
226 Note Emotional Disposition Is it true/false that at meeting, person had a favorable impression of person? We can query for Agree and Disagree events with the required agent and object. Then we can get the beginnings of an answer by counting the relative numbers of these. A model of emotional disposition!
301 Track Contributions Based on observed behaviour, list all the people who participated in discussions about document. We can query directly for participants in a discussion about an issue: agents of Communicate events within a Discussion with topic being the required Issue. Relating document to issue is another problem - unless the issue explicitly concerns the document, rather than just being one of the issues that the document concerns / is relevant to. In that case, we can restrict the query by requiring that the Document play one of the roles in the Issue.  
305 Track Discussion Threads List, at an appropriate granularity level, the events that occurred between event and event. We can query for start and end times of the Events directly, and can then query for all Events with start/end times between these. Determining which to report will be the tricky bit: a reasonable start might be to report all Communicate events which play a role in argumentative structure (i.e. proposals, agreements, disagreements). Better notion of appropriate granularity
306 Track Discussion Threads For each of the following tasks mentioned during meeting (topic, topic, etc.), indicate whether it is an identified subtask of project.   Project ontology
307 Track Discussion Threads For each of the following tasks mentioned during meeting (topic, topic, etc.), indicate whether it is an anticipated objective relevant to project that is as yet unassigned.   Project ontology
308 Track Discussion Threads For each of the following tasks mentioned during meeting (topic, topic, etc.), indicate whether it is relevant to project.   Project ontology
310 Track Meeting Artifacts Order the following documents in order of the time that they were discussed during meeting. Provided that the Documents are explicitly mentioned, we can find them directly: find all Communicate events whose object contains a Document in one of its roles. Then query the start times of these Communicate events. Ordering by time must be done externally to MOKB. If documents are not explicitly mentioned, we need some relation of documents to issues. Document-topic associations
312 Track Meeting Artifacts Which of the following artifact types were subject to task at meeting? If I understand this correctly, we can query for all Actions of the type corresponding to the task where the Artifact plays the object role.  
313 Track Meeting Artifacts What act on information resource did person perform on artifact at time? Query for Actions whose agent is the required Person, whose object is the required Artifact, and whose start and end times are suitable.  
314 Track Meeting Artifacts Does observation made at meeting increase, decrease, leave unchanged the completion date for task? We take an observation to be a Communicate event: in this query its object must include the required Task in one of its roles. Project ontology
318 Update Project Plan How have the deadlines for task changed during the last year?   Project ontology
319 Update Project Plan Which subtasks have been dropped from task since it began?   Project ontology
320 Update Project Plan Which subtasks have been added to task since it began?   Project ontology
321 Update Project Plan List all tasks that person is working on that were discussed during meeting? We can find the tasks that were discussed (see 314) - project ontology must relate people to tasks. Project ontology
322 Update Project Plan List all tasks that are dependent on tasks on which person is working whose schedule was changed during meeting   Project ontology

Really Hard Questions

No. Sect. Question Analysis External Requirement
117 Dynamically Present Documents Should document ever have been posted during meeting? We can query directly for issues discussed: Issues which fill the topic attribute of the Discussions in the relevant Meeting. If someone else can relate these issues to documents, we could combine the results to say whether the document is relevant to an issue which was discussed. Document-topic associations
118 Dynamically Present Documents At what time during meeting would it have bee most appropriate/useful to distribute document? Again, given the Issue to which the document is relevant, we can query for Discussions which have that Issue as their topic attribute, and find their start and end times. This could possibly be made more precise if a Communicate event can be found which contains the Issue as part of its object (i.e. one which proposes, queries or agrees the issue). Document-topic associations
Topic attachments
I Attachment Action Size Date Who Comment
xlsxls iet-questions-td.xls manage 904.0 K 04 Mar 2005 - 21:07 JohnNiekrasz  
Calo.IetQuestionsAnalysisY2 moved from Calo.IetQuestionsAnalysis on 16 Nov 2005 - 23:28 by JohnNiekrasz - put it back
 

Semlab Home      
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Semlab? Send feedback