Applied Math Seminar

Large language models (LLMs) can use examples provided in a prompt to make predictions for new queries without updating their parameters, a capability known as in-context learning. In this talk, I will explore how transformers, the architectural backbone of many LLMs, can perform nonlinear kernel ridge regression (KRR). I will first present numerical observations showing […]