Summary of Transformer Normalisation Layers and the Independence Of Semantic Subspaces, by Stephen Menary et al.
Transformer Normalisation Layers and the Independence of Semantic Subspacesby Stephen Menary, Samuel Kaski, Andre FreitasFirst…
Summary of Calmqa: Exploring Culturally Specific Long-form Question Answering Across 23 Languages, by Shane Arora et al.
CaLMQA: Exploring culturally specific long-form question answering across 23 languagesby Shane Arora, Marzena Karpinska, Hung-Ting…
Summary of Understanding and Mitigating Tokenization Bias in Language Models, by Buu Phan et al.
Understanding and Mitigating Tokenization Bias in Language Modelsby Buu Phan, Marton Havasi, Matthew Muckley, Karen…
Summary of From Decoding to Meta-generation: Inference-time Algorithms For Large Language Models, by Sean Welleck et al.
From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelsby Sean Welleck, Amanda Bertsch, Matthew…
Summary of Token-based Decision Criteria Are Suboptimal in In-context Learning, by Hakaze Cho et al.
Token-based Decision Criteria Are Suboptimal in In-context Learningby Hakaze Cho, Yoshihiro Sakai, Mariko Kato, Kenshiro…
Summary of Confidence Regulation Neurons in Language Models, by Alessandro Stolfo et al.
Confidence Regulation Neurons in Language Modelsby Alessandro Stolfo, Ben Wu, Wes Gurnee, Yonatan Belinkov, Xingyi…
Summary of Recall: Membership Inference Via Relative Conditional Log-likelihoods, by Roy Xie et al.
ReCaLL: Membership Inference via Relative Conditional Log-Likelihoodsby Roy Xie, Junlin Wang, Ruomin Huang, Minxing Zhang,…
Summary of Semantic Entropy Probes: Robust and Cheap Hallucination Detection in Llms, by Jannik Kossen et al.
Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMsby Jannik Kossen, Jiatong Han, Muhammed…
Summary of Sampleattention: Near-lossless Acceleration Of Long Context Llm Inference with Adaptive Structured Sparse Attention, by Qianchao Zhu et al.
SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attentionby Qianchao Zhu,…
Summary of Multi-view Empowered Structural Graph Wordification For Language Models, by Zipeng Liu et al.
Multi-View Empowered Structural Graph Wordification for Language Modelsby Zipeng Liu, Likang Wu, Ming He, Zhong…