Summary of Exploring Accuracy-fairness Trade-off in Large Language Models, by Qingquan Zhang et al.
Exploring Accuracy-Fairness Trade-off in Large Language Modelsby Qingquan Zhang, Qiqi Duan, Bo Yuan, Yuhui Shi,…
Summary of Multiset Transformer: Advancing Representation Learning in Persistence Diagrams, by Minghua Wang et al.
Multiset Transformer: Advancing Representation Learning in Persistence Diagramsby Minghua Wang, Ziyun Huang, Jinhui XuFirst submitted…
Summary of Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Models, by Javier Ferrando et al.
Do I Know This Entity? Knowledge Awareness and Hallucinations in Language Modelsby Javier Ferrando, Oscar…
Summary of Hymba: a Hybrid-head Architecture For Small Language Models, by Xin Dong et al.
Hymba: A Hybrid-head Architecture for Small Language Modelsby Xin Dong, Yonggan Fu, Shizhe Diao, Wonmin…
Summary of Transformers with Sparse Attention For Granger Causality, by Riya Mahesh et al.
Transformers with Sparse Attention for Granger Causalityby Riya Mahesh, Rahul Vashisht, Chandrashekar LakshminarayananFirst submitted to…
Summary of Llmsteer: Improving Long-context Llm Inference by Steering Attention on Reused Contexts, By Zhuohan Gu et al.
LLMSteer: Improving Long-Context LLM Inference by Steering Attention on Reused Contextsby Zhuohan Gu, Jiayi Yao,…
Summary of Selective Attention: Enhancing Transformer Through Principled Context Control, by Xuechen Zhang et al.
Selective Attention: Enhancing Transformer through Principled Context Controlby Xuechen Zhang, Xiangyu Chang, Mingchen Li, Amit…
Summary of Transformer Neural Processes – Kernel Regression, by Daniel Jenson et al.
Transformer Neural Processes - Kernel Regressionby Daniel Jenson, Jhonathan Navott, Mengyan Zhang, Makkunda Sharma, Elizaveta…
Summary of Higher Order Graph Attention Probabilistic Walk Networks, by Thomas Bailie et al.
Higher Order Graph Attention Probabilistic Walk Networksby Thomas Bailie, Yun Sing Koh, Karthik MukkavilliFirst submitted…
Summary of Mechanism and Emergence Of Stacked Attention Heads in Multi-layer Transformers, by Tiberiu Musat
Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformersby Tiberiu MusatFirst submitted to arxiv…