比利时vs摩洛哥足彩
,
university of california san diego
****************************
math 278b - mathematics of information, data, and signals
liam madden
university of british columbia
memory capacity of two-layer neural networks with analytic activations
abstract:
the memory capacity of a statistical model is the largest size of generic data that the model can memorize and has important implications for both training and generalization. in this talk, we will prove a tight memory capacity result for two-layer neural networks with polynomial or real analytic activations. in order to do so, we will use tools from linear algebra, combinatorics, differential topology, and the theory of real analytic functions of several variables. in particular, we will show how to get memorization if the model is a local submersion and we will show that the jacobian has generically full rank. the perspective that is developed also opens up a path towards deeper architectures, alternative models, and training.
host: alex cloninger
october 19, 2023
11:30 am
apm 2402
****************************