Summary of Counterfactual Token Generation in Large Language Models, by Ivi Chatzi et al.
Counterfactual Token Generation in Large Language Modelsby Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri, Stratis…
Summary of Merging Loras Like Playing Lego: Pushing the Modularity Of Lora to Extremes Through Rank-wise Clustering, by Ziyu Zhao et al.
Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clusteringby…
Summary of Eagle: Efficient Training-free Router For Multi-llm Inference, by Zesen Zhao et al.
Eagle: Efficient Training-Free Router for Multi-LLM Inferenceby Zesen Zhao, Shuowei Jin, Z. Morley MaoFirst submitted…
Summary of Archon: An Architecture Search Framework For Inference-time Techniques, by Jon Saad-falcon et al.
Archon: An Architecture Search Framework for Inference-Time Techniquesby Jon Saad-Falcon, Adrian Gamarra Lafuente, Shlok Natarajan,…
Summary of Block-attention For Efficient Rag, by East Sun et al.
Block-Attention for Efficient RAGby East Sun, Yan Wang, Lan TianFirst submitted to arxiv on: 14…
Summary of Unlocking Memorization in Large Language Models with Dynamic Soft Prompting, by Zhepeng Wang et al.
Unlocking Memorization in Large Language Models with Dynamic Soft Promptingby Zhepeng Wang, Runxue Bao, Yawen…
Summary of You Can Remove Gpt2’s Layernorm by Fine-tuning, By Stefan Heimersheim
You can remove GPT2’s LayerNorm by fine-tuningby Stefan HeimersheimFirst submitted to arxiv on: 6 Sep…
Summary of Exploring Scaling Laws For Local Sgd in Large Language Model Training, by Qiaozhi He et al.
Exploring Scaling Laws for Local SGD in Large Language Model Trainingby Qiaozhi He, Xiaomin Zhuang,…
Summary of Democratizing Mllms in Healthcare: Tinyllava-med For Efficient Healthcare Diagnostics in Resource-constrained Settings, by Aya El Mir et al.
Democratizing MLLMs in Healthcare: TinyLLaVA-Med for Efficient Healthcare Diagnostics in Resource-Constrained Settingsby Aya El Mir,…
Summary of Lola — An Open-source Massively Multilingual Large Language Model, by Nikit Srivastava et al.
LOLA – An Open-Source Massively Multilingual Large Language Modelby Nikit Srivastava, Denis Kuchelev, Tatiana Moteu…