Summary of Lexico: Extreme Kv Cache Compression Via Sparse Coding Over Universal Dictionaries, by Junhyuck Kim et al.
Lexico: Extreme KV Cache Compression via Sparse Coding over Universal Dictionariesby Junhyuck Kim, Jongho Park,…
Summary of Adversarial Vulnerabilities in Large Language Models For Time Series Forecasting, by Fuqiang Liu et al.
Adversarial Vulnerabilities in Large Language Models for Time Series Forecastingby Fuqiang Liu, Sicong Jiang, Luis…
Summary of Low-rank Correction For Quantized Llms, by Meyer Scetbon et al.
Low-Rank Correction for Quantized LLMsby Meyer Scetbon, James HensmanFirst submitted to arxiv on: 10 Dec…
Summary of Fully Open Source Moxin-7b Technical Report, by Pu Zhao et al.
Fully Open Source Moxin-7B Technical Reportby Pu Zhao, Xuan Shen, Zhenglun Kong, Yixin Shen, Sung-En…
Summary of Taming Sensitive Weights : Noise Perturbation Fine-tuning For Robust Llm Quantization, by Dongwei Wang et al.
Taming Sensitive Weights : Noise Perturbation Fine-tuning for Robust LLM Quantizationby Dongwei Wang, Huanrui YangFirst…
Summary of Alphaverus: Bootstrapping Formally Verified Code Generation Through Self-improving Translation and Treefinement, by Pranjal Aggarwal et al.
AlphaVerus: Bootstrapping Formally Verified Code Generation through Self-Improving Translation and Treefinementby Pranjal Aggarwal, Bryan Parno,…
Summary of Towards Learning to Reason: Comparing Llms with Neuro-symbolic on Arithmetic Relations in Abstract Reasoning, by Michael Hersche et al.
Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoningby Michael…
Summary of Frontier Models Are Capable Of In-context Scheming, by Alexander Meinke et al.
Frontier Models are Capable of In-context Schemingby Alexander Meinke, Bronson Schoen, Jérémy Scheurer, Mikita Balesni,…
Summary of Direct Quantized Training Of Language Models with Stochastic Rounding, by Kaiyan Zhao et al.
Direct Quantized Training of Language Models with Stochastic Roundingby Kaiyan Zhao, Tsuguchika Tabaru, Kenichi Kobayashi,…
Summary of Extractive Structures Learned in Pretraining Enable Generalization on Finetuned Facts, by Jiahai Feng et al.
Extractive Structures Learned in Pretraining Enable Generalization on Finetuned Factsby Jiahai Feng, Stuart Russell, Jacob…