Summary of Mechanics Of Next Token Prediction with Self-attention, by Yingcong Li et al.
Mechanics of Next Token Prediction with Self-Attentionby Yingcong Li, Yixiao Huang, M. Emrullah Ildiz, Ankit…
Summary of Conditional Computation in Neural Networks: Principles and Research Trends, by Simone Scardapane et al.
Conditional computation in neural networks: principles and research trendsby Simone Scardapane, Alessandro Baiocchi, Alessio Devoto,…
Summary of Transformers Learn Low Sensitivity Functions: Investigations and Implications, by Bhavya Vasudeva et al.
Transformers Learn Low Sensitivity Functions: Investigations and Implicationsby Bhavya Vasudeva, Deqing Fu, Tianyi Zhou, Elliott…
Summary of The Pitfalls Of Next-token Prediction, by Gregor Bachmann et al.
The pitfalls of next-token predictionby Gregor Bachmann, Vaishnavh NagarajanFirst submitted to arxiv on: 11 Mar…
Summary of Fact-checking the Output Of Large Language Models Via Token-level Uncertainty Quantification, by Ekaterina Fadeeva et al.
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantificationby Ekaterina Fadeeva, Aleksandr Rubashevskii,…
Summary of Proxy-rlhf: Decoupling Generation and Alignment in Large Language Model with Proxy, by Yu Zhu et al.
Proxy-RLHF: Decoupling Generation and Alignment in Large Language Model with Proxyby Yu Zhu, Chuxiong Sun,…
Summary of Learning to Decode Collaboratively with Multiple Language Models, by Shannon Zejiang Shen et al.
Learning to Decode Collaboratively with Multiple Language Modelsby Shannon Zejiang Shen, Hunter Lang, Bailin Wang,…
Summary of On the Origins Of Linear Representations in Large Language Models, by Yibo Jiang et al.
On the Origins of Linear Representations in Large Language Modelsby Yibo Jiang, Goutham Rajendran, Pradeep…
Summary of Taylorshift: Shifting the Complexity Of Self-attention From Squared to Linear (and Back) Using Taylor-softmax, by Tobias Christian Nauen et al.
TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmaxby Tobias…
Summary of Taming Throughput-latency Tradeoff in Llm Inference with Sarathi-serve, by Amey Agrawal et al.
Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serveby Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree…