Summary of Task-adaptive Pretrained Language Models Via Clustered-importance Sampling, by David Grangier et al.
Task-Adaptive Pretrained Language Models via Clustered-Importance Samplingby David Grangier, Simin Fan, Skyler Seto, Pierre AblinFirst…
Summary of No Need to Talk: Asynchronous Mixture Of Language Models, by Anastasiia Filippova et al.
No Need to Talk: Asynchronous Mixture of Language Modelsby Anastasiia Filippova, Angelos Katharopoulos, David Grangier,…
Summary of Investigating on Rlhf Methodology, by Alexey Kutalev and Sergei Markoff
Investigating on RLHF methodologyby Alexey Kutalev, Sergei MarkoffFirst submitted to arxiv on: 2 Oct 2024CategoriesMain:…
Summary of Autotm 2.0: Automatic Topic Modeling Framework For Documents Analysis, by Maria Khodorchenko and Nikolay Butakov and Maxim Zuev and Denis Nasonov
AutoTM 2.0: Automatic Topic Modeling Framework for Documents Analysisby Maria Khodorchenko, Nikolay Butakov, Maxim Zuev,…
Summary of Rotated Runtime Smooth: Training-free Activation Smoother For Accurate Int4 Inference, by Ke Yi et al.
Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inferenceby Ke Yi, Zengke Liu, Jianwei…
Summary of Maskllm: Learnable Semi-structured Sparsity For Large Language Models, by Gongfan Fang et al.
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Modelsby Gongfan Fang, Hongxu Yin, Saurav Muralidharan, Greg…
Summary of Context-aware Membership Inference Attacks Against Pre-trained Large Language Models, by Hongyan Chang et al.
Context-Aware Membership Inference Attacks against Pre-trained Large Language Modelsby Hongyan Chang, Ali Shahin Shamsabadi, Kleomenis…
Summary of A Controlled Study on Long Context Extension and Generalization in Llms, by Yi Lu et al.
A Controlled Study on Long Context Extension and Generalization in LLMsby Yi Lu, Jing Nathan…
Summary of Understanding Knowledge Drift in Llms Through Misinformation, by Alina Fastowski and Gjergji Kasneci
Understanding Knowledge Drift in LLMs through Misinformationby Alina Fastowski, Gjergji KasneciFirst submitted to arxiv on:…
Summary of Improving Pretraining Data Using Perplexity Correlations, by Tristan Thrush et al.
Improving Pretraining Data Using Perplexity Correlationsby Tristan Thrush, Christopher Potts, Tatsunori HashimotoFirst submitted to arxiv…