Equivariant and Coordinate Independent CNNs by Maurice Weiler (.PDF)
File Size: 32.7 MB
Equivariant and Coordinate Independent Convolutional Networks: A Gauge Field Theory of Neural Networks (Progress in Data Science) by Maurice Weiler, Patrick Forré, Erik Verlinde, Max Welling
Requirements: .PDF reader, 32.7 MB | True PDF
Overview: What is the appropriate geometric structure for neural networks that process spatial signals on Euclidean spaces or more general manifolds? This question takes us on a journey which leads to a gauge field theory of convolutional networks. Feature vector fields: The spatial signals we are interested in are fields of feature vectors. Feature fields allow to describe data like images, audio, videos, point clouds, or tensor fields, such as fluid flows and electromagnetic fields. Equivariant networks commute with actions of some symmetry group on their feature spaces. The relevant group actions in this work are geometric transformations of feature fields, like translations, rotations, or reflections of images. Equivariant models generalize everything they learn over the considered group of transformations. This property makes them significantly more data efficient, interpretable, and robust in comparison to non-equivariant models. Convolutional Neural Networks (CNNs) are the most common network architecture for processing feature fields. Conventional CNNs operate on Euclidean spaces and are translation equivariant, i.e. position independent. This work explains how to extend CNNs to be equivariant under more general symmetries of space.
Genre: Non-Fiction > Tech & Devices
Free Download links: