Enhanced Computationally Efficient Long LoRA Inspired Perceiver Architectures for Auto-Regressive Language Modelingby Kaleel Mahmood, Shaoyi…
Language-Guided Image Tokenization for Generationby Kaiwen Zha, Lijun Yu, Alireza Fathi, David A. Ross, Cordelia…
ProtGO: A Transformer based Fusion Model for accurately predicting Gene Ontology (GO) Terms from full…
KITE-DDI: A Knowledge graph Integrated Transformer Model for accurately predicting Drug-Drug Interaction Events from Drug…
KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Predictionby Zhenkai Qin, Baozhong Wei, Caifeng Gao,…
IterL2Norm: Fast Iterative L2-Normalizationby ChangMin Ye, Yonguk Sim, Youngchae Kim, SeongMin Jin, Doo Seok JeongFirst…
Transformers Struggle to Learn to Searchby Abulhair Saparov, Srushti Pawar, Shreyas Pimpalgaonkar, Nitish Joshi, Richard…
Understanding Hidden Computations in Chain-of-Thought Reasoningby Aryasomayajula Ram BharadwajFirst submitted to arxiv on: 5 Dec…
Coordinate In and Value Out: Training Flow Transformers in Ambient Spaceby Yuyang Wang, Anurag Ranjan,…
Modular addition without black-boxes: Compressing explanations of MLPs that compute numerical integrationby Chun Hei Yip,…