Summary of Coupling Speech Encoders with Downstream Text Models, by Ciprian Chelba and Johan Schalkwyk
Coupling Speech Encoders with Downstream Text Modelsby Ciprian Chelba, Johan SchalkwykFirst submitted to arxiv on:…
Summary of Data Mixture Inference: What Do Bpe Tokenizers Reveal About Their Training Data?, by Jonathan Hayase et al.
Data Mixture Inference: What do BPE Tokenizers Reveal about their Training Data?by Jonathan Hayase, Alisa…
Summary of Razorattention: Efficient Kv Cache Compression Through Retrieval Heads, by Hanlin Tang et al.
RazorAttention: Efficient KV Cache Compression Through Retrieval Headsby Hanlin Tang, Yang Lin, Jing Lin, Qingsen…
Summary of Long Input Sequence Network For Long Time Series Forecasting, by Chao Ma et al.
Long Input Sequence Network for Long Time Series Forecastingby Chao Ma, Yikai Hou, Xiang Li,…
Summary of Fundamental Limits Of Prompt Compression: a Rate-distortion Framework For Black-box Language Models, by Alliot Nagle et al.
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Modelsby Alliot Nagle, Adway…
Summary of When Can Transformers Count to N?, by Gilad Yehudai et al.
When Can Transformers Count to n?by Gilad Yehudai, Haim Kaplan, Asma Ghandeharioun, Mor Geva, Amir…
Summary of Efficient Visual Transformer by Learnable Token Merging, By Yancheng Wang et al.
Efficient Visual Transformer by Learnable Token Mergingby Yancheng Wang, Yingzhen YangFirst submitted to arxiv on:…
Summary of Lazyllm: Dynamic Token Pruning For Efficient Long Context Llm Inference, by Qichen Fu et al.
LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inferenceby Qichen Fu, Minsik Cho, Thomas…
Summary of Identifying the Source Of Generation For Large Language Models, by Bumjin Park and Jaesik Choi
Identifying the Source of Generation for Large Language Modelsby Bumjin Park, Jaesik ChoiFirst submitted to…
Summary of Patch-level Training For Large Language Models, by Chenze Shao et al.
Patch-Level Training for Large Language Modelsby Chenze Shao, Fandong Meng, Jie ZhouFirst submitted to arxiv…