Summary of Eagle: Speculative Sampling Requires Rethinking Feature Uncertainty, by Yuhui Li et al.
EAGLE: Speculative Sampling Requires Rethinking Feature Uncertaintyby Yuhui Li, Fangyun Wei, Chao Zhang, Hongyang ZhangFirst…
Summary of Adaptive Point Transformer, by Alessandro Baiocchi et al.
Adaptive Point Transformerby Alessandro Baiocchi, Indro Spinelli, Alessandro Nicolosi, Simone ScardapaneFirst submitted to arxiv on:…
Summary of A Structured Regression Approach For Evaluating Model Performance Across Intersectional Subgroups, by Christine Herlihy et al.
A structured regression approach for evaluating model performance across intersectional subgroupsby Christine Herlihy, Kimberly Truong,…
Summary of Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility Of Nli Models, by Erik Arakelyan et al.
Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Modelsby Erik Arakelyan, Zhaoqi Liu,…
Summary of Bayesian Optimization Through Gaussian Cox Process Models For Spatio-temporal Data, by Yongsheng Mei et al.
Bayesian Optimization through Gaussian Cox Process Models for Spatio-temporal Databy Yongsheng Mei, Mahdi Imani, Tian…
Summary of Moe-infinity: Efficient Moe Inference on Personal Machines with Sparsity-aware Expert Cache, by Leyang Xue et al.
MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cacheby Leyang Xue, Yao Fu,…
Summary of Serverlessllm: Low-latency Serverless Inference For Large Language Models, by Yao Fu et al.
ServerlessLLM: Low-Latency Serverless Inference for Large Language Modelsby Yao Fu, Leyang Xue, Yeqi Huang, Andrei-Octavian…
Summary of Multimodal Pathway: Improve Transformers with Irrelevant Data From Other Modalities, by Yiyuan Zhang et al.
Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalitiesby Yiyuan Zhang, Xiaohan Ding, Kaixiong…
Summary of Compactifai: Extreme Compression Of Large Language Models Using Quantum-inspired Tensor Networks, by Andrei Tomut et al.
CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networksby Andrei Tomut, Saeed S.…
Summary of Fp6-llm: Efficiently Serving Large Language Models Through Fp6-centric Algorithm-system Co-design, by Haojun Xia et al.
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Designby Haojun Xia, Zhen Zheng, Xiaoxia…