Summary of Llm-neo: Parameter Efficient Knowledge Distillation For Large Language Models, by Runming Yang et al.
LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Modelsby Runming Yang, Taiqiang Wu, Jiahao Wang,…
Summary of Accelerating Large Language Model Training with 4d Parallelism and Memory Consumption Estimator, by Kazuki Fujii et al.
Accelerating Large Language Model Training with 4D Parallelism and Memory Consumption Estimatorby Kazuki Fujii, Kohei…
Summary of Robust and Efficient Fine-tuning Of Llms with Bayesian Reparameterization Of Low-rank Adaptation, by Ayan Sengupta et al.
Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptationby Ayan Sengupta, Vaibhav…
Summary of Variational Low-rank Adaptation Using Ivon, by Bai Cong et al.
Variational Low-Rank Adaptation Using IVONby Bai Cong, Nico Daheim, Yuesong Shen, Daniel Cremers, Rio Yokota,…
Summary of Can Custom Models Learn In-context? An Exploration Of Hybrid Architecture Performance on In-context Learning Tasks, by Ryan Campbell et al.
Can Custom Models Learn In-Context? An Exploration of Hybrid Architecture Performance on In-Context Learning Tasksby…
Summary of Self-consistency Preference Optimization, by Archiki Prasad et al.
Self-Consistency Preference Optimizationby Archiki Prasad, Weizhe Yuan, Richard Yuanzhe Pang, Jing Xu, Maryam Fazel-Zarandi, Mohit…
Summary of A Comprehensive Survey Of Small Language Models in the Era Of Large Language Models: Techniques, Enhancements, Applications, Collaboration with Llms, and Trustworthiness, by Fali Wang et al.
A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques,…
Summary of Stochastic Monkeys at Play: Random Augmentations Cheaply Break Llm Safety Alignment, by Jason Vega et al.
Stochastic Monkeys at Play: Random Augmentations Cheaply Break LLM Safety Alignmentby Jason Vega, Junsheng Huang,…
Summary of “give Me Bf16 or Give Me Death”? Accuracy-performance Trade-offs in Llm Quantization, by Eldar Kurtic et al.
“Give Me BF16 or Give Me Death”? Accuracy-Performance Trade-Offs in LLM Quantizationby Eldar Kurtic, Alexandre…
Summary of Tablegpt2: a Large Multimodal Model with Tabular Data Integration, by Aofeng Su et al.
TableGPT2: A Large Multimodal Model with Tabular Data Integrationby Aofeng Su, Aowen Wang, Chao Ye,…