Summary of Matryoshkakv: Adaptive Kv Compression Via Trainable Orthogonal Projection, by Bokai Lin et al.
MatryoshkaKV: Adaptive KV Compression via Trainable Orthogonal Projectionby Bokai Lin, Zihao Zeng, Zipeng Xiao, Siqi…
Summary of Harnessing Your Dram and Ssd For Sustainable and Accessible Llm Inference with Mixed-precision and Multi-level Caching, by Jie Peng et al.
Harnessing Your DRAM and SSD for Sustainable and Accessible LLM Inference with Mixed-Precision and Multi-level…
Summary of Bridging the Training-inference Gap in Llms by Leveraging Self-generated Tokens, By Zhepeng Cen and Yao Liu and Siliang Zeng and Pratik Chaudhari and Huzefa Rangwala and George Karypis and Rasool Fakoor
Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokensby Zhepeng Cen, Yao Liu, Siliang…
Summary of Decomposing the Dark Matter Of Sparse Autoencoders, by Joshua Engels et al.
Decomposing The Dark Matter of Sparse Autoencodersby Joshua Engels, Logan Riggs, Max TegmarkFirst submitted to…
Summary of Large Language Models Are Overparameterized Text Encoders, by Thennal D K et al.
Large Language Models Are Overparameterized Text Encodersby Thennal D K, Tim Fischer, Chris BiemannFirst submitted…
Summary of Dual-label Learning with Irregularly Present Labels, by Mingqian Li et al.
Dual-Label Learning With Irregularly Present Labelsby Mingqian Li, Qiao Han, Yiteng Zhai, Ruifeng Li, Yao…
Summary of Unscrambling Disease Progression at Scale: Fast Inference Of Event Permutations with Optimal Transport, by Peter A. Wijeratne et al.
Unscrambling disease progression at scale: fast inference of event permutations with optimal transportby Peter A.…
Summary of Efficient Annotator Reliability Assessment and Sample Weighting For Knowledge-based Misinformation Detection on Social Media, by Owen Cook et al.
Efficient Annotator Reliability Assessment and Sample Weighting for Knowledge-Based Misinformation Detection on Social Mediaby Owen…
Summary of Revisiting Slo and Goodput Metrics in Llm Serving, by Zhibin Wang et al.
Revisiting SLO and Goodput Metrics in LLM Servingby Zhibin Wang, Shipeng Li, Yuhang Zhou, Xue…
Summary of Latent Weight Diffusion: Generating Policies From Trajectories, by Shashank Hegde et al.
Latent Weight Diffusion: Generating Policies from Trajectoriesby Shashank Hegde, Gautam Salhotra, Gaurav S. SukhatmeFirst submitted…