Summary of Rethinking Optimization and Architecture For Tiny Language Models, by Yehui Tang et al.
Rethinking Optimization and Architecture for Tiny Language Modelsby Yehui Tang, Fangcheng Liu, Yunsheng Ni, Yuchuan…
Summary of Brain: Bayesian Reward-conditioned Amortized Inference For Natural Language Generation From Feedback, by Gaurav Pandey et al.
BRAIn: Bayesian Reward-conditioned Amortized Inference for natural language generation from feedbackby Gaurav Pandey, Yatin Nandwani,…
Summary of Diversity Measurement and Subset Selection For Instruction Tuning Datasets, by Peiqi Wang et al.
Diversity Measurement and Subset Selection for Instruction Tuning Datasetsby Peiqi Wang, Yikang Shen, Zhen Guo,…
Summary of Multi-modal Causal Structure Learning and Root Cause Analysis, by Lecheng Zheng et al.
Multi-modal Causal Structure Learning and Root Cause Analysisby Lecheng Zheng, Zhengzhang Chen, Jingrui He, Haifeng…
Summary of Selecting Large Language Model to Fine-tune Via Rectified Scaling Law, by Haowei Lin et al.
Selecting Large Language Model to Fine-tune via Rectified Scaling Lawby Haowei Lin, Baizhou Huang, Haotian…
Summary of Variance Alignment Score: a Simple but Tough-to-beat Data Selection Method For Multimodal Contrastive Learning, by Yiping Wang et al.
Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learningby Yiping…
Summary of Hiqa: a Hierarchical Contextual Augmentation Rag For Multi-documents Qa, by Xinyue Chen et al.
HiQA: A Hierarchical Contextual Augmentation RAG for Multi-Documents QAby Xinyue Chen, Pengyu Gao, Jiangjiang Song,…
Summary of When Benchmarks Are Targets: Revealing the Sensitivity Of Large Language Model Leaderboards, by Norah Alzahrani et al.
When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboardsby Norah Alzahrani, Hisham…
Summary of Continual Learning For Large Language Models: a Survey, by Tongtong Wu et al.
Continual Learning for Large Language Models: A Surveyby Tongtong Wu, Linhao Luo, Yuan-Fang Li, Shirui…
Summary of Vaccine: Perturbation-aware Alignment For Large Language Models Against Harmful Fine-tuning Attack, by Tiansheng Huang et al.
Vaccine: Perturbation-aware Alignment for Large Language Models against Harmful Fine-tuning Attackby Tiansheng Huang, Sihao Hu,…