Google Brain Residency

A Brief Study of In-Domain Transfer and Learning from Fewer Samples using A Few Simple Priors

Marc Pickett, Ayush Sekhari, James Davidson

Picky Learners Workshop (2017)

A Neural Representation of Sketch Drawings

David Ha, Doug Eck

arXiv (2017)

Bridging the Gap Between Value and Policy Based Reinforcement Learning

Ofir Nachum, Mohammad Norouzi, Kelvin Xu, Dale Schuurmans

arXiv (2017)

Capacity and Trainability in Recurrent Neural Networks

Jasmine Collins, Jascha Sohl-Dickstein, David Sussillo

ICLR (2017)

Changing Model Behavior at Test-time using Reinforcement Learning

Augustus Odena, Dieterich Lawson, Chris Olah

ICLR Workshop (2017)

Conditional Image Synthesis With Auxiliary Classifier GANs

Augustus Odena, Christopher Olah, Jonathon Shlens

ICML (2017)

Deep Information Propagation

Samuel S. Schoenholz, Justin Gilmer, Surya Ganguli, Jascha Sohl-Dickstein

ICLR (2017)

Device Placement Optimization with Reinforcement Learning

Azalia Mirhoseini, Hieu Pham, Quoc Le, Mohammad Norouzi, Samy Bengio, Benoit Steiner, Yuefeng Zhou, Naveen Kumar, Rasmus Larsen, Jeff Dean

ICML (2017)

Discrete Sequential Prediction of Continuous Actions for Deep RL

Luke Metz, Julian Ibarz, Navdeep Jaitly, James Davidson

arXiv (2017)

Efficient Attention using a Fixed-Size Memory Representation

Denny Britz, Melody Guan, Thang Luong

EMNLP (2017)

Explaining the Learning Dynamics of Direct Feedback Alignment

Justin Gilmer, Colin Raffel, Samuel S. Schoenholz, Maithra Raghu, Jascha Sohl-Dickstein

ICLR Workshop (2017)

Filtering Variational Objectives

Chris J Maddison, Dieterich Lawson, George Tucker, Nicolas Heess, Mohammad Norouzi, Andriy Mnih, Arnaud Doucet, Yee Whye Teh

ICML Workshop (2017)

Generating High-Quality and Informative Conversation Responses with Sequence-to-Sequence Models

Louis Shao, Stephan Gouws, Denny Britz, Anna Goldie, Brian Strope, Ray Kurzweil

EMNLP (2017)

HyperNetworks

David Ha, Andrew Dai, Quoc V. Le

ICLR (2017)

Improving Policy Gradient by Exploring Under-appreciated Rewards

Ofir Nachum, Mohammad Norouzi, Dale Schuurmans

ICLR (2017)

Intelligible Language Modeling with Input Switched Affine Networks

Jakob N. Foerster, Justin Gilmer, Jan Chorowski, Jascha Sohl-Dickstein, David Sussillo

ICML (2017)

Learning Hierarchical Information Flow with Recurrent Neural Modules

Danijar Hafner, Alex Irpan, James Davidson, Nicolas Heess

arXiv (2017)

Learning to Remember Rare Events

Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio

ICLR (2017)

Massive Exploration of Neural Machine Translation Architectures

Denny Britz, Anna Goldie, Thang Luong, Quoc Le

EMNLP (2017)

Neural Architecture Search with Reinforcement Learning

Barret Zoph, Quoc V. Le

ICLR (2017)

Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders

Jesse Engel, Cinjon Resnick, Adam Roberts, Sander Dieleman, Douglas Eck, Karen Simonyan, Mohammad Norouzi

ICML (2017)

Neural Combinatorial Optimization with Reinforcement Learning

Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, Samy Bengio

ICLR Workshop (2017)

Neural Message Passing for Quantum Chemistry

Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

ICML (2017)

Neural Optimizer Search with Reinforcement Learning

Irwan Bello, Barret Zoph, Vijay Vasudevan, Quoc Le

ICML (2017) (to appear)

Next-Step Conditioned Deep Convolutional Neural Networks Improve Protein Secondary Structure Prediction

Akosua Busia, Navdeep Jaitly

ISMB (2017)

Online and Linear-Time Attention by Enforcing Monotonic Alignments

Colin Raffel, Douglas Eck, Peter Liu, Ron J. Weiss, Thang Luong

Thirty-fourth International Conference on Machine Learning (2017)

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, Jeff Dean

ICLR (2017)

Particle Value Function

Chris Maddison, Dieterich Lawson, George Tucker, Nicolas Heess, Arnaud Doucet, Andriy Minh, Yee Whye Teh

ICLR Workshop (2017)

PathNet: Evolution Channels Gradient Descent in Super Neural Networks

Chrisantha Fernando, Dylan Banarse, Charles Blundell, Yori Zwols, David Ha, Andrei A. Rusu, Alexander Pritzel, Daan Wierstra

GECCO (2017)

PixColor: Pixel Recursive Colorization

Sergio Guadarrama, Ryan Dahl, David Bieber, Mohammad Norouzi, Jonathon Shlens, Kevin Murphy

Proceedings of the 28th British Machine Vision Conference (BMVC) (2017)

Pixel Recursive Super Resolution

Ryan Dahl, Mohammad Norouzi, Jonathan Shlens

ICCV (2017)

Precise Estimates of Single-Trial Dynamics in Motor Cortex using Deep Learning Techniques

Chethan Pandarinath, Jasmine Collins, Rafal Jozefowicz, Sergey Stavisky, Jonathan Kao, Mark Churchland, Matt Kaufman, Stephen Ryu, John Henderson, Krishna Shenoy, Larry Abbott, David Sussillo

Cosyne (2017)

REBAR: Low-variance, unbiased gradient estimates for discrete latent variable models

George Tucker, Andriy Mnih, Chris J. Maddison, Jascha Sohl-Dickstein

ICML Workshop (2017)

Regularizing Neural Networks by Penalizing Confident Output Distributions

Gabriel Pereyra, George Tucker, Jan Chorowski, Łukasz Kaiser, Geoffrey Hinton

ICLR Workshop (2017)

Time-Contrastive Networks: Self-Supervised Learning from Multi-View Observation

Pierre Sermanet, Corey Lynch, Jasmine Hsu, Sergey Levine

CVPR Workshop (2017)

Training a Subsampling Mechanism in Expectation

Colin Raffel, Dieterich Lawson

ICLR Workshop (2017)

Unrolled Generative Adversarial Networks

Luke Metz, Ben Poole, David Pfau, Jascha Sohl-Dickstein

ICLR (2017)

Unsupervised Perceptual Rewards for Imitation Learning

Pierre Sermanet, Kelvin Xu, Sergey Levine

RSS (2017)

Unsupervised Pixel-level Domain Adaptation with Generative Adversarial Networks

Konstantinos Bousmalis, Nathan Silberman, David Dohan, Dumitru Erhan, Dilip Krishnan

CVPR (2017)

Who Said What: Modelling Individual Labels Improves Classification

Melody Y. Guan, Varun Gulshan, Andrew M. Dai, Geoffrey Hinton

CVPR Workshop (2017)

Audio Deepdream: Optimizing raw audio with convolutional networks

Adam Roberts, Cinjon Resnick, Diego Ardila, Doug Eck

International Society for Music Information Retrieval Conference, Google Brain (2016)

Deconvolution and Checkerboard Artifacts

Augustus Odena, Vincent Dumoulin, Chris Olah

Distill (2016)

Experiments in Handwriting with a Neural Network

Shan Carter, David Ha, Ian Johnson, Chris Olah

Distill (2016)