Summary of A Post-training Enhanced Optimization Approach For Small Language Models, by Keke Zhai
A Post-Training Enhanced Optimization Approach for Small Language Modelsby Keke ZhaiFirst submitted to arxiv on:…
Summary of A Mamba Foundation Model For Time Series Forecasting, by Haoyu Ma et al.
A Mamba Foundation Model for Time Series Forecastingby Haoyu Ma, Yushu Chen, Wenlai Zhao, Jinzhe…
Summary of Atm: Improving Model Merging by Alternating Tuning and Merging, By Luca Zhou et al.
ATM: Improving Model Merging by Alternating Tuning and Mergingby Luca Zhou, Daniele Solombrino, Donato Crisostomi,…
Summary of Stochastic Monkeys at Play: Random Augmentations Cheaply Break Llm Safety Alignment, by Jason Vega et al.
Stochastic Monkeys at Play: Random Augmentations Cheaply Break LLM Safety Alignmentby Jason Vega, Junsheng Huang,…
Summary of Specialized Foundation Models Struggle to Beat Supervised Baselines, by Zongzhe Xu et al.
Specialized Foundation Models Struggle to Beat Supervised Baselinesby Zongzhe Xu, Ritvik Gupta, Wenduo Cheng, Alexander…
Summary of On the Loss Of Context-awareness in General Instruction Fine-tuning, by Yihan Wang et al.
On the Loss of Context-awareness in General Instruction Fine-tuningby Yihan Wang, Andrew Bai, Nanyun Peng,…
Summary of Mm-embed: Universal Multimodal Retrieval with Multimodal Llms, by Sheng-chieh Lin et al.
MM-Embed: Universal Multimodal Retrieval with Multimodal LLMsby Sheng-Chieh Lin, Chankyu Lee, Mohammad Shoeybi, Jimmy Lin,…
Summary of Teleoracle: Fine-tuned Retrieval-augmented Generation with Long-context Support For Network, by Nouf Alabbasi et al.
TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Networkby Nouf Alabbasi, Omar Erak, Omar Alhussein,…
Summary of Improving Steering Vectors by Targeting Sparse Autoencoder Features, By Sviatoslav Chalnev and Matthew Siu and Arthur Conmy
Improving Steering Vectors by Targeting Sparse Autoencoder Featuresby Sviatoslav Chalnev, Matthew Siu, Arthur ConmyFirst submitted…
Summary of Provably Transformers Harness Multi-concept Word Semantics For Efficient In-context Learning, by Dake Bu et al.
Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learningby Dake Bu, Wei Huang, Andi…