Summary of Implicit Geometry Of Next-token Prediction: From Language Sparsity Patterns to Model Representations, by Yize Zhao et al.
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representationsby Yize Zhao, Tina…