In recent years, neural networks have once again triggered an increased interest among researchers in the machine learning community. So-called deep neural networks model functions using a composition ...

Automatic differentiation is a transformation of the computational graph associated with the algorithmic implementation of a mathematical function. It breaks it down into atomistic primitive ...