Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricsby…
Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?by Jinhyuk Lee, Anthony Chen, Zhuyun…
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive…
Who’s asking? User personas and the mechanics of latent misalignmentby Asma Ghandeharioun, Ann Yuan, Marius…
LLMs Are Prone to Fallacies in Causal Inferenceby Nitish Joshi, Abulhair Saparov, Yixin Wang, He…
See It from My Perspective: How Language Affects Cultural Bias in Image Understandingby Amith Ananthram,…
Look Further Ahead: Testing the Limits of GPT-4 in Path Planningby Mohamed Aghzal, Erion Plaku,…
Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Waysby Shubham Atreja, Joshua…
The Base-Rate Effect on LLM Benchmark Performance: Disambiguating Test-Taking Strategies from Benchmark Performanceby Kyle Moore,…
Generating Tables from the Parametric Knowledge of Language Modelsby Yevgeni Berkovitch, Oren Glickman, Amit Somech,…