Summary of A Post-training Enhanced Optimization Approach For Small Language Models, by Keke Zhai
A Post-Training Enhanced Optimization Approach for Small Language Modelsby Keke ZhaiFirst submitted to arxiv on:…
Summary of A Mamba Foundation Model For Time Series Forecasting, by Haoyu Ma et al.
A Mamba Foundation Model for Time Series Forecastingby Haoyu Ma, Yushu Chen, Wenlai Zhao, Jinzhe…
Summary of Stochastic Monkeys at Play: Random Augmentations Cheaply Break Llm Safety Alignment, by Jason Vega et al.
Stochastic Monkeys at Play: Random Augmentations Cheaply Break LLM Safety Alignmentby Jason Vega, Junsheng Huang,…
Summary of Specialized Foundation Models Struggle to Beat Supervised Baselines, by Zongzhe Xu et al.
Specialized Foundation Models Struggle to Beat Supervised Baselinesby Zongzhe Xu, Ritvik Gupta, Wenduo Cheng, Alexander…
Summary of Teleoracle: Fine-tuned Retrieval-augmented Generation with Long-context Support For Network, by Nouf Alabbasi et al.
TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Networkby Nouf Alabbasi, Omar Erak, Omar Alhussein,…
Summary of On the Loss Of Context-awareness in General Instruction Fine-tuning, by Yihan Wang et al.
On the Loss of Context-awareness in General Instruction Fine-tuningby Yihan Wang, Andrew Bai, Nanyun Peng,…
Summary of Mm-embed: Universal Multimodal Retrieval with Multimodal Llms, by Sheng-chieh Lin et al.
MM-Embed: Universal Multimodal Retrieval with Multimodal LLMsby Sheng-Chieh Lin, Chankyu Lee, Mohammad Shoeybi, Jimmy Lin,…
Summary of Provably Transformers Harness Multi-concept Word Semantics For Efficient In-context Learning, by Dake Bu et al.
Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learningby Dake Bu, Wei Huang, Andi…
Summary of Improving Steering Vectors by Targeting Sparse Autoencoder Features, By Sviatoslav Chalnev and Matthew Siu and Arthur Conmy
Improving Steering Vectors by Targeting Sparse Autoencoder Featuresby Sviatoslav Chalnev, Matthew Siu, Arthur ConmyFirst submitted…
Summary of Training on Test Proteins Improves Fitness, Structure, and Function Prediction, by Anton Bushuiev et al.
Training on test proteins improves fitness, structure, and function predictionby Anton Bushuiev, Roman Bushuiev, Nikola…