First numerical observation of the Berezinskii-Kosterlitz-Thouless transition in language modelsby Yuma Toji, Jun Takahashi, Vwani…
FuseGPT: Learnable Layers Fusion of Generative Pre-trained Transformersby Zehua Pei, Hui-Ling Zhen, Xianzhi Yu, Sinno…
Hymba: A Hybrid-head Architecture for Small Language Modelsby Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin…
ULTra: Unveiling Latent Token Interpretability in Transformer Based Understandingby Hesam Hosseini, Ghazal Hosseini Mighan, Amirabbas…
Bias in Large Language Models: Origin, Evaluation, and Mitigationby Yufei Guo, Muzhe Guo, Juntao Su,…
Benchmarking LLMs’ Judgments with No Gold Standardby Shengwei Xu, Yuxuan Lu, Grant Schoenebeck, Yuqing KongFirst…
HourVideo: 1-Hour Video-Language Understandingby Keshigeyan Chandrasegaran, Agrim Gupta, Lea M. Hadzic, Taran Kota, Jimming He,…
Ask, and it shall be given: On the Turing completeness of promptingby Ruizhong Qiu, Zhe…
Emergence of meta-stable clustering in mean-field transformer modelsby Giuseppe Bruno, Federico Pasqualotto, Andrea AgazziFirst submitted…
Reducing the Scope of Language Models with Circuit Breakersby David Yunis, Siyu Huo, Chulaka Gunasekara,…