Summary of Qpruner: Probabilistic Decision Quantization For Structured Pruning in Large Language Models, by Changhai Zhou and Yuhua Zhou and Shijie Han and Qian Qiao and Hongguang Li
QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Modelsby Changhai Zhou, Yuhua Zhou,…