Summary of Speech Is Not Enough: Interpreting Nonverbal Indicators Of Common Knowledge and Engagement, by Derek Palmer et al.
Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement
by Derek Palmer, Yifan Zhu, Kenneth Lai, Hannah VanderHoeven, Mariah Bradford, Ibrahim Khebour, Carlos Mabrey, Jack Fitzgerald, Nikhil Krishnaswamy, Martha Palmer, James Pustejovsky
First submitted to arxiv on: 8 Dec 2024
Categories
- Main: Computation and Language (cs.CL)
- Secondary: Artificial Intelligence (cs.AI)
GrooveSquid.com Paper Summaries
GrooveSquid.com’s goal is to make artificial intelligence research accessible by summarizing AI papers in simpler terms. Each summary below covers the same AI paper, written at different levels of difficulty. The medium difficulty and low difficulty versions are original summaries written by GrooveSquid.com, while the high difficulty version is the paper’s original abstract. Feel free to learn from the version that suits you best!
| Summary difficulty | Written by | Summary |
|---|---|---|
| High | Paper authors | High Difficulty Summary Read the original abstract here |
| Medium | GrooveSquid.com (original content) | Medium Difficulty Summary This paper aims to develop an Artificial Intelligence (AI) partner that supports group problem-solving and social dynamics. The AI partner will utilize multimodal analytics to identify non-verbal interactions between group members, combining this with verbal participation to create a holistic understanding of collaboration and engagement. In the present demo, the authors illustrate their capabilities in detecting and tracking nonverbal behavior in student task-oriented interactions in the classroom, highlighting its implications for tracking common ground and engagement. |
| Low | GrooveSquid.com (original content) | Low Difficulty Summary The researchers are trying to build an AI that helps groups work together better. They want this AI to understand not just what people say, but also how they act when they’re working together. This is important because non-verbal cues can tell us a lot about how well a group is doing and if everyone is engaged in the task. The authors have made some progress on this project by showing that their AI can detect and track these nonverbal behaviors in students working together in class. |
Keywords
» Artificial intelligence » Tracking
