Summary of Vibecheck: Discover and Quantify Qualitative Differences in Large Language Models, by Lisa Dunlap et al.
VibeCheck: Discover and Quantify Qualitative Differences in Large Language Modelsby Lisa Dunlap, Krishna Mandal, Trevor…
Summary of Shapefilegpt: a Multi-agent Large Language Model Framework For Automated Shapefile Processing, by Qingming Lin et al.
ShapefileGPT: A Multi-Agent Large Language Model Framework for Automated Shapefile Processingby Qingming Lin, Rui Hu,…
Summary of Omnixr: Evaluating Omni-modality Language Models on Reasoning Across Modalities, by Lichang Chen and Hexiang Hu and Mingda Zhang and Yiwen Chen and Zifeng Wang and Yandong Li and Pranav Shyam and Tianyi Zhou and Heng Huang and Ming-hsuan Yang and Boqing Gong
OmnixR: Evaluating Omni-modality Language Models on Reasoning across Modalitiesby Lichang Chen, Hexiang Hu, Mingda Zhang,…
Summary of On a Scale From 1 to 5: Quantifying Hallucination in Faithfulness Evaluation, by Xiaonan Jing et al.
On A Scale From 1 to 5: Quantifying Hallucination in Faithfulness Evaluationby Xiaonan Jing, Srinivas…
Summary of Kallini Et Al. (2024) Do Not Compare Impossible Languages with Constituency-based Ones, by Tim Hunter
Kallini et al. (2024) do not compare impossible languages with constituency-based onesby Tim HunterFirst submitted to…
Summary of Videgothink: Assessing Egocentric Video Understanding Capabilities For Embodied Ai, by Sijie Cheng et al.
VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AIby Sijie Cheng, Kechen Fang, Yangyang Yu,…
Summary of Magnifier Prompt: Tackling Multimodal Hallucination Via Extremely Simple Instructions, by Yuhan Fu et al.
Magnifier Prompt: Tackling Multimodal Hallucination via Extremely Simple Instructionsby Yuhan Fu, Ruobing Xie, Jiazhen Liu,…
Summary of Evidence Of Cognitive Deficits Anddevelopmental Advances in Generative Ai: a Clock Drawing Test Analysis, by Isaac R. Galatzer-levy et al.
Evidence of Cognitive Deficits andDevelopmental Advances in Generative AI: A Clock Drawing Test Analysisby Isaac…
Summary of Code-mixer Ya Nahi: Novel Approaches to Measuring Multilingual Llms’ Code-mixing Capabilities, by Ayushman Gupta et al.
Code-Mixer Ya Nahi: Novel Approaches to Measuring Multilingual LLMs’ Code-Mixing Capabilitiesby Ayushman Gupta, Akhil Bhogal,…
Summary of In-context Learning For Long-context Sentiment Analysis on Infrastructure Project Opinions, by Alireza Shamshiri et al.
In-Context Learning for Long-Context Sentiment Analysis on Infrastructure Project Opinionsby Alireza Shamshiri, Kyeong Rok Ryu,…