Summary of Hashattention: Semantic Sparsity For Faster Inference, by Aditya Desai et al.
HashAttention: Semantic Sparsity for Faster Inferenceby Aditya Desai, Shuo Yang, Alejandro Cuadron, Ana Klimovic, Matei…
Summary of Faultexplainer: Leveraging Large Language Models For Interpretable Fault Detection and Diagnosis, by Abdullah Khan et al.
FaultExplainer: Leveraging Large Language Models for Interpretable Fault Detection and Diagnosisby Abdullah Khan, Rahul Nahar,…
Summary of Mix-ln: Unleashing the Power Of Deeper Layers by Combining Pre-ln and Post-ln, By Pengxiang Li et al.
Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LNby Pengxiang Li, Lu…
Summary of Lightweight Safety Classification Using Pruned Language Models, by Mason Sawtell et al.
Lightweight Safety Classification Using Pruned Language Modelsby Mason Sawtell, Tula Masterman, Sandi Besen, Jim BrownFirst…
Summary of Towards Llm-based Optimization Compilers. Can Llms Learn How to Apply a Single Peephole Optimization? Reasoning Is All Llms Need!, by Xiangxin Fang and Lev Mukhanov
Towards LLM-based optimization compilers. Can LLMs learn how to apply a single peephole optimization? Reasoning…
Summary of The Open Source Advantage in Large Language Models (llms), by Jiya Manchanda et al.
The Open Source Advantage in Large Language Models (LLMs)by Jiya Manchanda, Laura Boettcher, Matheus Westphalen,…
Summary of Frontier Ai Systems Have Surpassed the Self-replicating Red Line, by Xudong Pan et al.
Frontier AI systems have surpassed the self-replicating red lineby Xudong Pan, Jiarun Dai, Yihe Fan,…
Summary of No More Adam: Learning Rate Scaling at Initialization Is All You Need, by Minghao Xu et al.
No More Adam: Learning Rate Scaling at Initialization is All You Needby Minghao Xu, Lichuan…
Summary of Scifaultyqa: Benchmarking Llms on Faulty Science Question Detection with a Gan-inspired Approach to Synthetic Dataset Generation, by Debarshi Kundu
SciFaultyQA: Benchmarking LLMs on Faulty Science Question Detection with a GAN-Inspired Approach to Synthetic Dataset…
Summary of Spar: Self-play with Tree-search Refinement to Improve Instruction-following in Large Language Models, by Jiale Cheng et al.
SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Modelsby Jiale Cheng, Xiao…