Summary of Olmoe: Open Mixture-of-experts Language Models, by Niklas Muennighoff et al.
OLMoE: Open Mixture-of-Experts Language Modelsby Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Morrison,…
Summary of Revisiting Smoe Language Models by Evaluating Inefficiencies with Task Specific Expert Pruning, By Soumajyoti Sarkar et al.
Revisiting SMoE Language Models by Evaluating Inefficiencies with Task Specific Expert Pruningby Soumajyoti Sarkar, Leonard…
Summary of Prompt Compression with Context-aware Sentence Encoding For Fast and Improved Llm Inference, by Barys Liskavets et al.
Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inferenceby Barys Liskavets, Maxim…
Summary of Self-supervised Vision Transformers For Writer Retrieval, by Tim Raven et al.
Self-Supervised Vision Transformers for Writer Retrievalby Tim Raven, Arthur Matei, Gernot A. FinkFirst submitted to…
Summary of Implicit Geometry Of Next-token Prediction: From Language Sparsity Patterns to Model Representations, by Yize Zhao et al.
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representationsby Yize Zhao, Tina…
Summary of Boosting Lossless Speculative Decoding Via Feature Sampling and Partial Alignment Distillation, by Lujun Gui et al.
Boosting Lossless Speculative Decoding via Feature Sampling and Partial Alignment Distillationby Lujun Gui, Bin Xiao,…
Summary of Generative Verifiers: Reward Modeling As Next-token Prediction, by Lunjun Zhang et al.
Generative Verifiers: Reward Modeling as Next-Token Predictionby Lunjun Zhang, Arian Hosseini, Hritik Bansal, Mehran Kazemi,…
Summary of Advancing Adversarial Suffix Transfer Learning on Aligned Large Language Models, by Hongfu Liu et al.
Advancing Adversarial Suffix Transfer Learning on Aligned Large Language Modelsby Hongfu Liu, Yuxi Xie, Ye…
Summary of Llms As Zero-shot Graph Learners: Alignment Of Gnn Representations with Llm Token Embeddings, by Duo Wang and Yuan Zuo and Fengzhi Li and Junjie Wu
LLMs as Zero-shot Graph Learners: Alignment of GNN Representations with LLM Token Embeddingsby Duo Wang,…
Summary of Log-vmamba: Local-global Vision Mamba For Medical Image Segmentation, by Trung Dinh Quoc Dang et al.
LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentationby Trung Dinh Quoc Dang, Huy Hoang Nguyen,…