Summary of Block-attention For Efficient Rag, by East Sun et al.
Block-Attention for Efficient RAGby East Sun, Yan Wang, Lan TianFirst submitted to arxiv on: 14…
Summary of A Diagonal Structured State Space Model on Loihi 2 For Efficient Streaming Sequence Processing, by Svea Marie Meyer et al.
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processingby Svea…
Summary of Patch Ranking: Efficient Clip by Learning to Rank Local Patches, By Cheng-en Wu et al.
Patch Ranking: Efficient CLIP by Learning to Rank Local Patchesby Cheng-En Wu, Jinhong Lin, Yu…
Summary of Backtracking Improves Generation Safety, by Yiming Zhang et al.
Backtracking Improves Generation Safetyby Yiming Zhang, Jianfeng Chi, Hailey Nguyen, Kartikeya Upasani, Daniel M. Bikel,…
Summary of On-device Collaborative Language Modeling Via a Mixture Of Generalists and Specialists, by Dongyang Fan et al.
On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialistsby Dongyang Fan, Bettina Messmer,…
Summary of Test Time Learning For Time Series Forecasting, by Panayiotis Christou et al.
Test Time Learning for Time Series Forecastingby Panayiotis Christou, Shichu Chen, Xupeng Chen, Parijat DubeFirst…
Summary of Context-aware Membership Inference Attacks Against Pre-trained Large Language Models, by Hongyan Chang et al.
Context-Aware Membership Inference Attacks against Pre-trained Large Language Modelsby Hongyan Chang, Ali Shahin Shamsabadi, Kleomenis…
Summary of Taco-rl: Task Aware Prompt Compression Optimization with Reinforcement Learning, by Shivam Shandilya et al.
TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learningby Shivam Shandilya, Menglin Xia, Supriyo Ghosh,…
Summary of Interpolating Video-llms: Toward Longer-sequence Lmms in a Training-free Manner, by Yuzhang Shang et al.
Interpolating Video-LLMs: Toward Longer-sequence LMMs in a Training-free Mannerby Yuzhang Shang, Bingxin Xu, Weitai Kang,…
Summary of Grin: Gradient-informed Moe, by Liyuan Liu et al.
GRIN: GRadient-INformed MoEby Liyuan Liu, Young Jin Kim, Shuohang Wang, Chen Liang, Yelong Shen, Hao…