Summary of Cliqueformer: Model-based Optimization with Structured Transformers, by Jakub Grudzien Kuba et al.
Cliqueformer: Model-Based Optimization with Structured Transformersby Jakub Grudzien Kuba, Pieter Abbeel, Sergey LevineFirst submitted to…
Summary of An Evolved Universal Transformer Memory, by Edoardo Cetin et al.
An Evolved Universal Transformer Memoryby Edoardo Cetin, Qi Sun, Tianyu Zhao, Yujin TangFirst submitted to…
Summary of Estimating the Probabilities Of Rare Outputs in Language Models, by Gabriel Wu et al.
Estimating the Probabilities of Rare Outputs in Language Modelsby Gabriel Wu, Jacob HiltonFirst submitted to…
Summary of Hypothesis Testing the Circuit Hypothesis in Llms, by Claudia Shi et al.
Hypothesis Testing the Circuit Hypothesis in LLMsby Claudia Shi, Nicolas Beltran-Velez, Achille Nazaret, Carolina Zheng,…
Summary of Aero: Softmax-only Llms For Efficient Private Inference, by Nandan Kumar Jha and Brandon Reagen
AERO: Softmax-Only LLMs for Efficient Private Inferenceby Nandan Kumar Jha, Brandon ReagenFirst submitted to arxiv…
Summary of Context-scaling Versus Task-scaling in In-context Learning, by Amirhesam Abedsoltan et al.
Context-Scaling versus Task-Scaling in In-Context Learningby Amirhesam Abedsoltan, Adityanarayanan Radhakrishnan, Jingfeng Wu, Mikhail BelkinFirst submitted…
Summary of Recurformer: Not All Transformer Heads Need Self-attention, by Ruiqing Yan et al.
RecurFormer: Not All Transformer Heads Need Self-Attentionby Ruiqing Yan, Linghan Zheng, Xingbo Du, Han Zou,…
Summary of Tracking Universal Features Through Fine-tuning and Model Merging, by Niels Horn and Desmond Elliott
Tracking Universal Features Through Fine-Tuning and Model Mergingby Niels Horn, Desmond ElliottFirst submitted to arxiv…
Summary of Exotst: Exogenous-aware Temporal Sequence Transformer For Time Series Prediction, by Kshitij Tayal et al.
ExoTST: Exogenous-Aware Temporal Sequence Transformer for Time Series Predictionby Kshitij Tayal, Arvind Renganathan, Xiaowei Jia,…
Summary of Enhancing Llm Agents For Code Generation with Possibility and Pass-rate Prioritized Experience Replay, by Yuyang Chen et al.
Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replayby Yuyang Chen,…