ArchesWeather & ArchesWeatherGen: a deterministic and generative model for efficient ML weather forecastingby Guillaume Couairon,…
Benchmarking and Understanding Compositional Relational Reasoning of LLMsby Ruikang Ni, Da Xiao, Qingye Meng, Xiangyu…
A Comparative Study of Pruning Methods in Transformer-based Time Series Forecastingby Nicholas Kiefer, Arvid Weyrauch,…
TimeCHEAT: A Channel Harmony Strategy for Irregularly Sampled Multivariate Time Series Analysisby Jiexi Liu, Meng…
PT: A Plain Transformer is Good Hospital Readmission Predictorby Zhenyi Fan, Jiaqi Li, Dongyu Luo,…
Emergence of Abstractions: Concept Encoding and Decoding Mechanism for In-Context Learning in Transformersby Seungwook Han,…
Krony-PT: GPT2 compressed with Kronecker Productsby M. Ayoub Ben Ayad, Jelena Mitrovic, Michael GranitzerFirst submitted…
Numerical Pruning for Efficient Autoregressive Modelsby Xuan Shen, Zhao Song, Yufa Zhou, Bo Chen, Jing…
LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformersby Xuan Shen, Zhao Song, Yufa Zhou,…
Core Context Aware Attention for Long Context Language Modelingby Yaofo Chen, Zeng You, Shuhai Zhang,…