The talk concerned with the asymptotic empirical eigenvalue distribution of a non linear random matrix ensemble. More precisely we consider $M=
\frac{1}{m} YY^*$ with $Y=f(WX)$ where W and X are random rectangular matrices with i.i.d. centered entries. The function f is applied pointwise and can be seen as an activation function in (random) neural networks. We compute the asymptotic empirical distribution of this ensemble in the case where W and X have subGaussian tails and f is smooth. This extends a result of [PW17] where the case of Gaussian matrices W and X is considered. We also investigate the same questions in the multi-layer case, regarding neural network applications.
Recording during the meeting "Integrability and Randomness in Mathematical Physics and Geometry " the April 12, 2019 at the Centre International de Rencontres Mathématiques (Marseille, France)
Filmmaker: Guillaume Hennenfent
Find this video and other talks given by worldwide mathematicians on CIRM's Audiovisual Mathematics Library: http://library.cirm-math.fr. And discover all its functionalities:
- Chapter markers and keywords to watch the parts of your choice in the video
- Videos enriched with abstracts, bibliographies, Mathematics Subject Classification
- Multi-criteria search by author, title, tags, mathematical area
\frac{1}{m} YY^*$ with $Y=f(WX)$ where W and X are random rectangular matrices with i.i.d. centered entries. The function f is applied pointwise and can be seen as an activation function in (random) neural networks. We compute the asymptotic empirical distribution of this ensemble in the case where W and X have subGaussian tails and f is smooth. This extends a result of [PW17] where the case of Gaussian matrices W and X is considered. We also investigate the same questions in the multi-layer case, regarding neural network applications.
Recording during the meeting "Integrability and Randomness in Mathematical Physics and Geometry " the April 12, 2019 at the Centre International de Rencontres Mathématiques (Marseille, France)
Filmmaker: Guillaume Hennenfent
Find this video and other talks given by worldwide mathematicians on CIRM's Audiovisual Mathematics Library: http://library.cirm-math.fr. And discover all its functionalities:
- Chapter markers and keywords to watch the parts of your choice in the video
- Videos enriched with abstracts, bibliographies, Mathematics Subject Classification
- Multi-criteria search by author, title, tags, mathematical area
Sandrine Péché: Eigenvalue distribution for non linear models of random matrices amulet meaning | |
2 Likes | 2 Dislikes |
88 views views | 10K followers |
Science & Technology | Upload TimePublished on 10 May 2019 |
Không có nhận xét nào:
Đăng nhận xét