Summary of Interacted Object Grounding in Spatio-temporal Human-object Interactions, by Xiaoyang Liu et al.
Interacted Object Grounding in Spatio-Temporal Human-Object Interactions
by Xiaoyang Liu, Boran Wen, Xinpeng Liu, Zizheng Zhou, Hongwei Fan, Cewu Lu, Lizhuang Ma, Yulong Chen, Yong-Lu Li
First submitted to arxiv on: 27 Dec 2024
Categories
- Main: Computer Vision and Pattern Recognition (cs.CV)
- Secondary: Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
GrooveSquid.com Paper Summaries
GrooveSquid.com’s goal is to make artificial intelligence research accessible by summarizing AI papers in simpler terms. Each summary below covers the same AI paper, written at different levels of difficulty. The medium difficulty and low difficulty versions are original summaries written by GrooveSquid.com, while the high difficulty version is the paper’s original abstract. Feel free to learn from the version that suits you best!
| Summary difficulty | Written by | Summary |
|---|---|---|
| High | Paper authors | High Difficulty Summary Read the original abstract here |
| Medium | GrooveSquid.com (original content) | Medium Difficulty Summary The proposed 4D question-answering framework (4D-QA) tackles the challenge of discovering interacted objects in diverse videos, which is crucial for activity understanding. The novel Grounding Interacted Objects (GIO) benchmark introduces an open-world setting with 1,098 interacted object classes and 290K annotated boxes. Existing detectors and grounding methods struggle to localize rare objects in GIO, highlighting the limitations of current vision systems. The authors leverage spatio-temporal cues to propose a 4D-QA framework for discovering interacted objects from diverse videos. Experimental results demonstrate significant superiority over baselines. |
| Low | GrooveSquid.com (original content) | Low Difficulty Summary This paper is about understanding how people interact with objects in videos. Right now, most video datasets only include a few types of objects, which makes it hard for computers to learn about all the different objects they see. The researchers created a new dataset called GIO that includes many more object classes and even annotated every single box where an object appears. They also came up with a way for computers to figure out what’s happening in these interactions, using information from both space and time. Their method did better than other current approaches on this task. |
Keywords
» Artificial intelligence » Grounding » Question answering
