Geoffrey Hinton
(Photo by Daniel Ehrenworth)
Presentations by deep learning pioneer and University of Toronto alumnus and entrepreneur Allen Lau were among the highlights of the opening day at this year鈥檚 influential .
Hinton, a U of T Emeritus who now works at Google and has been dubbed the 鈥済odfather of deep learning,鈥 spoke on Tuesday about his efforts to develop a new type of artificial neural network that can recognize and interpret images better than existing systems.
One of more than 600 presenters at the annual conference that runs until April 22, Hinton noted that most current systems use convolutional neural nets that don鈥檛 recognize objects the way people do.
鈥淭hey use lots of texture information, which people are insensitive to, and they use a lot of shape information that people are sensitive to,鈥 said Hinton, an who is also the chief scientific adviser at the Vector Institute for Artificial Intelligence.
鈥淭hey also aren鈥檛 very good at extrapolating to new viewpoints. People can see an object from one viewpoint and then extrapolate to many different viewpoints. But convolutional neural nets need to see objects from lots of different viewpoints to understand them.鈥
To illustrate this flaw, Hinton showed images of a school bus that had been mildly obscured with visual noise. While humans can still easily recognize the images as showing school buses, Hinton revealed that convolutional neural nets mistake the buses for ostriches.
His solution? A system called GLOM 鈥 short for 鈥渁gglomeration鈥 鈥 that鈥檚 inspired, in part, by the relationship between cells, organs and DNA.
鈥淲hat I want to do is design neural nets so they have different ways of seeing the same thing, just as people do, and they see things the way people see things,鈥 he said. 鈥淭hat would make them far more interpretable and far less likely to make crazy errors 鈥 like that school bus.鈥
For the second year running, Collision 鈥 which features global speakers from technology, business and media 鈥 is being held virtually due to the COVID-19 pandemic. The event, which counts U of T as an official partner, .