Dynamic Universal Approximation Theory: The Basic Theory for Transformer-based Large Language Modelsby Wei Wang, Qing…
Closed-Form Test Functions for Biophysical Sequence Optimization Algorithmsby Samuel Stanton, Robert Alberstein, Nathan Frey, Andrew…
Pairwise Difference Learning for Classificationby Mohamed Karim Belaid, Maximilian Rabus, Eyke HüllermeierFirst submitted to arxiv…
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Managementby Wonbeom Lee,…
MCNC: Manifold Constrained Network Compressionby Chayne Thrash, Ali Abbasi, Parsa Nooralinejad, Soroush Abbasi Koohpayegani, Reed…
Fast Optimizer Benchmarkby Simon Blauth, Tobias Bürger, Zacharias Häringer, Jörg Franke, Frank HutterFirst submitted to…
Fair Differentiable Neural Network Architecture Search for Long-Tailed Data with Self-Supervised Learningby Jiaming YanFirst submitted…
From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelsby Sean Welleck, Amanda Bertsch, Matthew…
Effect of Random Learning Rate: Theoretical Analysis of SGD Dynamics in Non-Convex Optimization via Stationary…
Credit Attribution and Stable Compressionby Roi Livni, Shay Moran, Kobbi Nissim, Chirag PabbarajuFirst submitted to…