Summary of Is It a Free Lunch For Removing Outliers During Pretraining?, by Baohao Liao et al.
Is It a Free Lunch for Removing Outliers during Pretraining?by Baohao Liao, Christof MonzFirst submitted…
Summary of Deciphering the Impact Of Pretraining Data on Large Language Models Through Machine Unlearning, by Yang Zhao et al.
Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearningby Yang Zhao,…
Summary of Fintral: a Family Of Gpt-4 Level Multimodal Financial Large Language Models, by Gagan Bhatia et al.
FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelsby Gagan Bhatia, El Moatez…
Summary of Data Engineering For Scaling Language Models to 128k Context, by Yao Fu et al.
Data Engineering for Scaling Language Models to 128K Contextby Yao Fu, Rameswar Panda, Xinyao Niu,…
Summary of Hardware Phi-1.5b: a Large Language Model Encodes Hardware Domain Specific Knowledge, by Weimin Fu et al.
Hardware Phi-1.5B: A Large Language Model Encodes Hardware Domain Specific Knowledgeby Weimin Fu, Shijie Li,…
Summary of Infini-gram: Scaling Unbounded N-gram Language Models to a Trillion Tokens, by Jiacheng Liu et al.
Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokensby Jiacheng Liu, Sewon Min, Luke…
Summary of Bpdec: Unveiling the Potential Of Masked Language Modeling Decoder in Bert Pretraining, by Wen Liang et al.
BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretrainingby Wen Liang, Youzhi…
Summary of Geodecoder: Empowering Multimodal Map Understanding, by Feng Qi et al.
GeoDecoder: Empowering Multimodal Map Understandingby Feng Qi, Mian Dai, Zixian Zheng, Chao WangFirst submitted to…
Summary of Unlearning Traces the Influential Training Data Of Language Models, by Masaru Isonuma and Ivan Titov
Unlearning Traces the Influential Training Data of Language Modelsby Masaru Isonuma, Ivan TitovFirst submitted to…
Summary of Romansetu: Efficiently Unlocking Multilingual Capabilities Of Large Language Models Via Romanization, by Jaavid Aktar Husain et al.
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanizationby Jaavid Aktar Husain, Raj…