Summary of Zyda-2: a 5 Trillion Token High-quality Dataset, by Yury Tokpanov et al.
Zyda-2: a 5 Trillion Token High-Quality Datasetby Yury Tokpanov, Paolo Glorioso, Quentin Anthony, Beren MillidgeFirst…
Summary of Lego-graphrag: Modularizing Graph-based Retrieval-augmented Generation For Design Space Exploration, by Yukun Cao et al.
LEGO-GraphRAG: Modularizing Graph-based Retrieval-Augmented Generation for Design Space Explorationby Yukun Cao, Zengyi Gao, Zhiyang Li,…
Summary of Spechub: Provable Acceleration to Multi-draft Speculative Decoding, by Ryan Sun et al.
SpecHub: Provable Acceleration to Multi-Draft Speculative Decodingby Ryan Sun, Tianyi Zhou, Xun Chen, Lichao SunFirst…
Summary of Improving Multi-domain Task-oriented Dialogue System with Offline Reinforcement Learning, by Dharmendra Prajapat et al.
Improving Multi-Domain Task-Oriented Dialogue System with Offline Reinforcement Learningby Dharmendra Prajapat, Durga ToshniwalFirst submitted to…
Summary of Llm Generated Distribution-based Prediction Of Us Electoral Results, Part I, by Caleb Bradshaw et al.
LLM Generated Distribution-Based Prediction of US Electoral Results, Part Iby Caleb Bradshaw, Caelen Miller, Sean…
Summary of Wave Network: An Ultra-small Language Model, by Xin Zhang et al.
Wave Network: An Ultra-Small Language Modelby Xin Zhang, Victor S.ShengFirst submitted to arxiv on: 4…
Summary of Vq-map: Bird’s-eye-view Map Layout Estimation in Tokenized Discrete Space Via Vector Quantization, by Yiwei Zhang et al.
VQ-Map: Bird’s-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantizationby Yiwei Zhang, Jin…
Summary of Ragviz: Diagnose and Visualize Retrieval-augmented Generation, by Tevin Wang et al.
RAGViz: Diagnose and Visualize Retrieval-Augmented Generationby Tevin Wang, Jingyuan He, Chenyan XiongFirst submitted to arxiv…
Summary of Beyond Label Attention: Transparency in Language Models For Automated Medical Coding Via Dictionary Learning, by John Wu et al.
Beyond Label Attention: Transparency in Language Models for Automated Medical Coding via Dictionary Learningby John…
Summary of Length-induced Embedding Collapse in Transformer-based Models, by Yuqi Zhou et al.
Length-Induced Embedding Collapse in Transformer-based Modelsby Yuqi Zhou, Sunhao Dai, Zhanshuo Cao, Xiao Zhang, Jun…