Summary of Energy-based Diffusion Language Models For Text Generation, by Minkai Xu et al.
Energy-Based Diffusion Language Models for Text Generationby Minkai Xu, Tomas Geffner, Karsten Kreis, Weili Nie,…
Summary of Peptide-gpt: Generative Design Of Peptides Using Generative Pre-trained Transformers and Bio-informatic Supervision, by Aayush Shah and Chakradhar Guntuboina and Amir Barati Farimani
Peptide-GPT: Generative Design of Peptides using Generative Pre-trained Transformers and Bio-informatic Supervisionby Aayush Shah, Chakradhar…
Summary of Tesseraq: Ultra Low-bit Llm Post-training Quantization with Block Reconstruction, by Yuhang Li et al.
TesseraQ: Ultra Low-Bit LLM Post-Training Quantization with Block Reconstructionby Yuhang Li, Priyadarshini PandaFirst submitted to…
Summary of Fedbaf: Federated Learning Aggregation Biased by a Foundation Model, By Jong-ik Park et al.
FedBaF: Federated Learning Aggregation Biased by a Foundation Modelby Jong-Ik Park, Srinivasa Pranav, José M.…
Summary of Methods Of Improving Llm Training Stability, by Oleg Rybakov et al.
Methods of improving LLM training stabilityby Oleg Rybakov, Mike Chrzanowski, Peter Dykas, Jinze Xue, Ben…
Summary of Compute-constrained Data Selection, by Junjie Oscar Yin et al.
Compute-Constrained Data Selectionby Junjie Oscar Yin, Alexander M. RushFirst submitted to arxiv on: 21 Oct…
Summary of A Realistic Threat Model For Large Language Model Jailbreaks, by Valentyn Boreiko et al.
A Realistic Threat Model for Large Language Model Jailbreaksby Valentyn Boreiko, Alexander Panfilov, Vaclav Voracek,…
Summary of Natural Galore: Accelerating Galore For Memory-efficient Llm Training and Fine-tuning, by Arijit Das
Natural GaLore: Accelerating GaLore for memory-efficient LLM Training and Fine-tuningby Arijit DasFirst submitted to arxiv…
Summary of Cartesianmoe: Boosting Knowledge Sharing Among Experts Via Cartesian Product Routing in Mixture-of-experts, by Zhenpeng Su et al.
CartesianMoE: Boosting Knowledge Sharing among Experts via Cartesian Product Routing in Mixture-of-Expertsby Zhenpeng Su, Xing…
Summary of Quailora: Quantization-aware Initialization For Lora, by Neal Lawton et al.
QuAILoRA: Quantization-Aware Initialization for LoRAby Neal Lawton, Aishwarya Padmakumar, Judith Gaspers, Jack FitzGerald, Anoop Kumar,…