Summary of Llm-pq: Serving Llm on Heterogeneous Clusters with Phase-aware Partition and Adaptive Quantization, by Juntao Zhao et al.
LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantizationby Juntao Zhao, Borui…