Summary of Ngpt: Normalized Transformer with Representation Learning on the Hypersphere, by Ilya Loshchilov et al.
nGPT: Normalized Transformer with Representation Learning on the Hypersphereby Ilya Loshchilov, Cheng-Ping Hsieh, Simeng Sun,…
Summary of Replacing Paths with Connection-biased Attention For Knowledge Graph Completion, by Sharmishtha Dutta et al.
Replacing Paths with Connection-Biased Attention for Knowledge Graph Completionby Sharmishtha Dutta, Alex Gittens, Mohammed J.…
Summary of Simplified Priors For Object-centric Learning, by Vihang Patil et al.
Simplified priors for Object-Centric Learningby Vihang Patil, Andreas Radler, Daniel Klotz, Sepp HochreiterFirst submitted to…
Summary of Sparse Attention Decomposition Applied to Circuit Tracing, by Gabriel Franco et al.
Sparse Attention Decomposition Applied to Circuit Tracingby Gabriel Franco, Mark CrovellaFirst submitted to arxiv on:…
Summary of Characterizing and Efficiently Accelerating Multimodal Generation Model Inference, by Yejin Lee et al.
Characterizing and Efficiently Accelerating Multimodal Generation Model Inferenceby Yejin Lee, Anna Sun, Basil Hosmer, Bilge…
Summary of Continuous-time Linear Positional Embedding For Irregular Time Series Forecasting, by Byunghyun Kim and Jae-gil Lee
Continuous-Time Linear Positional Embedding for Irregular Time Series Forecastingby Byunghyun Kim, Jae-Gil LeeFirst submitted to…
Summary of Cottention: Linear Transformers with Cosine Attention, by Gabriel Mongaras and Trevor Dohm and Eric C. Larson
Cottention: Linear Transformers With Cosine Attentionby Gabriel Mongaras, Trevor Dohm, Eric C. LarsonFirst submitted to…
Summary of Token Caching For Diffusion Transformer Acceleration, by Jinming Lou et al.
Token Caching for Diffusion Transformer Accelerationby Jinming Lou, Wenyang Luo, Yufan Liu, Bing Li, Xinmiao…
Summary of Towards An Active-learning Approach to Resource Allocation For Population-based Damage Prognosis, by George Tsialiamanis et al.
Towards an active-learning approach to resource allocation for population-based damage prognosisby George Tsialiamanis, Keith Worden,…
Summary of Latent Representation Learning For Multimodal Brain Activity Translation, by Arman Afrasiyabi et al.
Latent Representation Learning for Multimodal Brain Activity Translationby Arman Afrasiyabi, Dhananjay Bhaskar, Erica L. Busch,…