Summary of 360+x: a Panoptic Multi-modal Scene Understanding Dataset, by Hao Chen et al.
360+x: A Panoptic Multi-modal Scene Understanding Dataset
by Hao Chen, Yuqi Hou, Chenyuan Qu, Irene Testini, Xiaohan Hong, Jianbo Jiao
First submitted to arxiv on: 1 Apr 2024
Categories
- Main: Computer Vision and Pattern Recognition (cs.CV)
- Secondary: Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
GrooveSquid.com Paper Summaries
GrooveSquid.com’s goal is to make artificial intelligence research accessible by summarizing AI papers in simpler terms. Each summary below covers the same AI paper, written at different levels of difficulty. The medium difficulty and low difficulty versions are original summaries written by GrooveSquid.com, while the high difficulty version is the paper’s original abstract. Feel free to learn from the version that suits you best!
| Summary difficulty | Written by | Summary |
|---|---|---|
| High | Paper authors | High Difficulty Summary Read the original abstract here |
| Medium | GrooveSquid.com (original content) | Medium Difficulty Summary The proposed 360+x dataset provides a panoptic perspective on scene understanding, combining multiple viewpoints and modalities such as video, audio, location data, and textual descriptions. This unique dataset mimics how daily information is accessed in the real world, offering a comprehensive observation of the world from various perspectives. The authors present five different scene understanding tasks on this dataset to evaluate the impact and benefit of each data modality and perspective in panoptic scene understanding. |
| Low | GrooveSquid.com (original content) | Low Difficulty Summary Imagine you’re trying to understand what’s happening in your daily life. You might look at things from different angles, listen to sounds, feel where you are, and read signs. A new dataset helps computers do just that! It has lots of scenes with multiple viewpoints (like looking left and right) and types of data (like video, sound, and words). This is important because it’s more like how we humans experience the world. The researchers tested their dataset by giving computers five tasks to complete, like recognizing objects or understanding what’s happening in a scene. |
Keywords
» Artificial intelligence » Scene understanding
