Summary of In-context In-context Learning with Transformer Neural Processes, by Matthew Ashman et al.
In-Context In-Context Learning with Transformer Neural Processesby Matthew Ashman, Cristiana Diaconu, Adrian Weller, Richard E.…
Summary of Langtopo: Aligning Language Descriptions Of Graphs with Tokenized Topological Modeling, by Zhong Guan et al.
LangTopo: Aligning Language Descriptions of Graphs with Tokenized Topological Modelingby Zhong Guan, Hongke Zhao, Likang…
Summary of Reconciling Kaplan and Chinchilla Scaling Laws, by Tim Pearce et al.
Reconciling Kaplan and Chinchilla Scaling Lawsby Tim Pearce, Jinyeop SongFirst submitted to arxiv on: 12…
Summary of Mixture Of Scales: Memory-efficient Token-adaptive Binarization For Large Language Models, by Dongwon Jo et al.
Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Modelsby Dongwon Jo, Taesu Kim, Yulhwa…
Summary of Attention Score Is Not All You Need For Token Importance Indicator in Kv Cache Reduction: Value Also Matters, by Zhiyu Guo et al.
Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction:…
Summary of Hierarchical Associative Memory, Parallelized Mlp-mixer, and Symmetry Breaking, by Ryo Karakida et al.
Hierarchical Associative Memory, Parallelized MLP-Mixer, and Symmetry Breakingby Ryo Karakida, Toshihiro Ota, Masato TakiFirst submitted…
Summary of Trol: Traversal Of Layers For Large Language and Vision Models, by Byung-kwan Lee et al.
TroL: Traversal of Layers for Large Language and Vision Modelsby Byung-Kwan Lee, Sangyun Chung, Chae…
Summary of Prefixing Attention Sinks Can Mitigate Activation Outliers For Large Language Model Quantization, by Seungwoo Son et al.
Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantizationby Seungwoo Son, Wonpyo…
Summary of Breaking the Attention Bottleneck, by Kalle Hilsenbek
Breaking the Attention Bottleneckby Kalle HilsenbekFirst submitted to arxiv on: 16 Jun 2024CategoriesMain: Machine Learning…
Summary of Towards Signal Processing in Large Language Models, by Prateek Verma et al.
Towards Signal Processing In Large Language Modelsby Prateek Verma, Mert PilanciFirst submitted to arxiv on:…