Summary of Beyond Autoregression: Fast Llms Via Self-distillation Through Time, by Justin Deschenaux et al.
Beyond Autoregression: Fast LLMs via Self-Distillation Through Timeby Justin Deschenaux, Caglar GulcehreFirst submitted to arxiv…
Summary of Improving Multimodal Large Language Models Using Continual Learning, by Shikhar Srivastava et al.
Improving Multimodal Large Language Models Using Continual Learningby Shikhar Srivastava, Md Yousuf Harun, Robik Shrestha,…
Summary of Knowledge Distillation Using Frontier Open-source Llms: Generalizability and the Role Of Synthetic Data, by Anup Shirgaonkar et al.
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Databy Anup Shirgaonkar,…
Summary of Scaling Up Masked Diffusion Models on Text, by Shen Nie et al.
Scaling up Masked Diffusion Models on Textby Shen Nie, Fengqi Zhu, Chao Du, Tianyu Pang,…
Summary of Beyond Autoregression: Discrete Diffusion For Complex Reasoning and Planning, by Jiacheng Ye et al.
Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planningby Jiacheng Ye, Jiahui Gao, Shansan Gong,…
Summary of Enhancing Text Generation in Joint Nlg/nlu Learning Through Curriculum Learning, Semi-supervised Training, and Advanced Optimization Techniques, by Rahimanuddin Shaik et al.
Enhancing Text Generation in Joint NLG/NLU Learning Through Curriculum Learning, Semi-Supervised Training, and Advanced Optimization…
Summary of H2ovl-mississippi Vision Language Models Technical Report, by Shaikat Galib et al.
H2OVL-Mississippi Vision Language Models Technical Reportby Shaikat Galib, Shanshan Wang, Guanshuo Xu, Pascal Pfeiffer, Ryan…
Summary of Textlap: Customizing Language Models For Text-to-layout Planning, by Jian Chen et al.
TextLap: Customizing Language Models for Text-to-Layout Planningby Jian Chen, Ruiyi Zhang, Yufan Zhou, Jennifer Healey,…
Summary of Tapweight: Reweighting Pretraining Objectives For Task-adaptive Pretraining, by Ruiyi Zhang et al.
TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretrainingby Ruiyi Zhang, Sai Ashish Somayajula, Pengtao XieFirst submitted…
Summary of Mtl-lora: Low-rank Adaptation For Multi-task Learning, by Yaming Yang et al.
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learningby Yaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan, Jianfeng…