The Computing Research Association (CRA) has named fourth-year undergraduates Jacob Kelly and Winnie Xu as finalists in the program.
The program recognizes undergraduate students in North American colleges and universities who show outstanding potential in an area of computing research.
Assistant Professor David Duvenaud
Kelly and Xu have each led neural network experiments under the guidance of Assistant Professor .
鈥淛acob and Winnie both produced world-class research projects as third-year undergrads, which is extremely impressive,鈥 remarked Duvenaud. 鈥淭he key ingredients were determination, being able to say 鈥業 don't know,鈥 and to be willing to use unfinished, bleeding-edge tools.鈥
Winnie Xu
Xu led the experiments on a project to develop a new kind of deep neural network architecture that has infinitely many parameters and infinitely many layers.
鈥淥f course, learning and prediction in such a network can't be handled exactly, but different approximations correspond to different existing architectures,鈥 explained Duvenaud. 鈥淭he advantage of this approach is that the user can adjust the quality of these approximations at any point, trading off compute cost against solution quality, without having to restart from scratch.鈥
Earlier this month, this paper was accepted to one of the top 5 international machine learning conferences, the conference on Artificial Intelligence and Statistics (AISTATS).
Winnie Xu, Ricky T.Q. Chen, Xuechen Li, David Duvenaud
Jacob Kelly
Kelly led the experiments on a project to make training infinitely-deep neural networks, and differential equations more generally, easier to solve.
鈥淪pecifically, when parameters of ordinary differential equations are being fit to data, the resulting model sometimes ends up being very expensive to simulate. Jacob investigated ways to encourage the resulting models to be as fast to solve as possible, while still fitting the data well,鈥 said Duvenaud.
The resulting paper was accepted to the top international machine learning conference, Neural Information Processing Systems (NeurIPS).
Jacob Kelly, Jesse Bettencourt, Matthew James Johnson, David Duvenaud