SGD learns the conjugate class of the network

   Abstract