Summary of Improving Pretraining Data Using Perplexity Correlations, by Tristan Thrush et al.
Improving Pretraining Data Using Perplexity Correlationsby Tristan Thrush, Christopher Potts, Tatsunori HashimotoFirst submitted to arxiv…
Summary of How Does Code Pretraining Affect Language Model Task Performance?, by Jackson Petty et al.
How Does Code Pretraining Affect Language Model Task Performance?by Jackson Petty, Sjoerd van Steenkiste, Tal…
Summary of Vila-u: a Unified Foundation Model Integrating Visual Understanding and Generation, by Yecheng Wu et al.
VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationby Yecheng Wu, Zhuoyang Zhang, Junyu…
Summary of Probing Self-attention in Self-supervised Speech Models For Cross-linguistic Differences, by Sai Gopinath and Joselyn Rodriguez
Probing self-attention in self-supervised speech models for cross-linguistic differencesby Sai Gopinath, Joselyn RodriguezFirst submitted to…
Summary of A Lesion-aware Edge-based Graph Neural Network For Predicting Language Ability in Patients with Post-stroke Aphasia, by Zijian Chen et al.
A Lesion-aware Edge-based Graph Neural Network for Predicting Language Ability in Patients with Post-stroke Aphasiaby…
Summary of Revisiting Smoe Language Models by Evaluating Inefficiencies with Task Specific Expert Pruning, By Soumajyoti Sarkar et al.
Revisiting SMoE Language Models by Evaluating Inefficiencies with Task Specific Expert Pruningby Soumajyoti Sarkar, Leonard…