A large language model-type architecture for high-dimensional molecular potential energy surfacesby Xiao Zhu, Srinivasan S.…
CPTQuant - A Novel Mixed Precision Post-Training Quantization Techniques for Large Language Modelsby Amitash Nanda,…
Theoretical limitations of multi-layer Transformerby Lijie Chen, Binghui Peng, Hongxun WuFirst submitted to arxiv on:…
ESA: Example Sieve Approach for Multi-Positive and Unlabeled Learningby Zhongnian Li, Meng Wei, Peng Ying,…
First numerical observation of the Berezinskii-Kosterlitz-Thouless transition in language modelsby Yuma Toji, Jun Takahashi, Vwani…
CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Searchby Kaixin Wu, Yixin…
FedAH: Aggregated Head for Personalized Federated Learningby Pengzhan Zhou, Yuepeng He, Yijun Zhai, Kaixin Gao,…
Incentivizing Truthful Collaboration in Heterogeneous Federated Learningby Dimitar Chakarov, Nikita Tsoy, Kristian Minchev, Nikola KonstantinovFirst…
Training and Evaluating Language Models with Template-based Data Generationby Yifan ZhangFirst submitted to arxiv on:…
Non-Contextual BERT or FastText? A Comparative Analysisby Abhay Shanbhag, Suramya Jadhav, Amogh Thakurdesai, Ridhima Sinare,…