Google Brain Team
The Google Brain Team is a machine intelligence team focused on deep learning. We believe that openly disseminating research is critical to a healthy exchange of ideas, which in turn leads to rapid and innovative progress in the field as a whole. Listed here are the Google Brain team publications from leading CS conferences and journals. To learn more about the work we do, visit the Google Brain team page.
92 Publications
-
Alireza Makhzani, Jonathon Shlens, Navdeep Jaitly, Ian Goodfellow
International Conference on Learning Representations (2016) (to appear)
-
Continuous Deep Q-Learning with Model-based Acceleration
Shixiang Gu, Timothy Lillicrap, Ilya Sutskever, Sergey Levine
International Conference on Machine Learning (2016)
-
Deep Learning with Differential Privacy
Martin Abadi, Andy Chu, Ian Goodfellow, Brendan McMahan, Ilya Mironov, Kunal Talwar, Li Zhang
23rd ACM Conference on Computer and Communications Security (ACM CCS) (2016) (to appear)
-
DeepMath - Deep Sequence Models for Premise Selection
Alex A. Alemi, Francois Chollet, Geoffrey Irving, Christian Szegedy, Josef Urban
arXiv preprint arXiv:1606.04442 (2016)
-
Density Estimation using Real NVP
Laurent Dinh, Jascha Sohl-Dickstein, Samy Bengio
arXiv preprint (2016)
-
End-to-End Text-Dependent Speaker Verification
Georg Heigold, Ignacio Moreno, Samy Bengio, Noam M. Shazeer
International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE (2016)
-
Exploring the limits of language modeling
Rafal Jozefowicz, Oriol Vinyals, Mike Schuster, Noam Shazeer, Yonghui Wu
Google Inc. (2016)
-
Generating Sentences from a Continuous Space
Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal Jozefowicz, Samy Bengio
CoNLL (2016) (to appear)
-
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke
ICLR 2016 Workshop (to appear)
-
Sergey Levine, Peter Pastor Sampedro, Alex Krizhevsky, Deirdre Quillen
International Symposium on Experimental Robotics (2016)
-
Listen, Attend and Spell: A Neural Network for Large Vocabulary Conversational Speech Recognition
William Chan, Navdeep Jaitly, Quoc V. Le, Oriol Vinyals
ICASSP (2016)
-
Mastering the game of Go with deep neural networks and tree search
David Silver, Aja Huang, Christopher J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, Demis Hassabis
Nature, vol. 529 (2016), pp. 484-503
-
MuProp: Unbiased Backpropagation for Stochastic Neural Networks
Shixiang Gu, Sergey Levine, Ilya Sutskever, Andriy Mnih
International Conference on Learning Representations (2016)
-
Multi-task Sequence to Sequence Learning
Thang Luong, Quoc V. Le, Ilya Sutskever, Oriol Vinyals, Lukasz Kaiser
International Conference on Learning Representations (2016)
-
Multilingual Language Processing From Bytes
Dan Gillick, Cliff Brunk, Oriol Vinyals, Amarnag Subramanya
NAACL (2016) (to appear)
-
Net2Net: Accelerating Learning via Knowledge Transfer
Tianqi Chen, Ian Goodfellow, Jonathon Shlens
International Conference on Learning Representations (2016)
-
Neural GPUs Learn Algorithms
Lukasz Kaiser, Ilya Sutskever
International Conference on Learning Representations (2016)
-
Neural Programmer: Inducing Latent Programs with Gradient Descent
arvind neelakantan, Quoc V. Le, Ilya Sutskever
International Conference on Learning Representations (2016)
-
Karol Kurach, Marcin Andrychowicz, Ilya Sutskever
CoRR, vol. abs/1511.06392 (2016)
-
Order matters: Sequence to sequence for sets
Oriol Vinyals, Samy Bengio, Manjunath Kudlur
International Conference on Learning Representations (ICLR) (2016) (to appear)
-
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, Zbigniew Wojna
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (2016) (to appear)
-
Revisiting Distributed Synchronous SGD
Jianmin Chen, Rajat Monga, Samy Bengio, Rafal Jozefowicz
International Conference on Learning Representations Workshop Track (2016) (to appear)
-
TensorFlow: A system for large-scale machine learning
Martin Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, Xiaoqiang Zheng
Google Brain (2016)
-
Unsupervised Learning for Physical Interaction through Video Prediction
Chelsea Finn, Ian Goodfellow, Sergey Levine
arXiv e-prints (2016)
-
Virtual Adversarial Training for Semi-Supervised Text Classification
Takeru Miayto, Andrew M. Dai, Ian Goodfellow
arXiv preprint (2016)
-
ICML Deep Learning Workshop (2015)
-
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
Quoc V. Le, Navdeep Jaitly, Geoffrey E. Hinton
CoRR, vol. abs/1504.00941 (2015)
-
A Unified Approach to Boundedness Properties in MSO
Lukasz Kaiser, Martin Lang 0001, Simon Leßenich, Christof Löding
CSL (2015), pp. 441-456
-
Adding Gradient Noise Improves Learning for Very Deep Networks
arvind neelakantan, Luke Vilnis, Quoc V. Le, Ilya Sutskever, Lukasz Kaiser, Karol Kurach, James Martens
CoRR, vol. abs/1511.06807 (2015)
-
Addressing the Rare Word Problem in Neural Machine Translation
Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, Wojciech Zaremba
ACL (2015)
-
An Online Sequence-to-Sequence Model Using Partial Conditioning
Navdeep Jaitly, Quoc V. Le, Oriol Vinyals, Samy Bengio
ARXIV (2015)
-
An empirical exploration of recurrent network architectures
Rafal Jozefowicz, Wojciech Zaremba, Ilya Sutskever
Journal of Machine Learning Research (2015)
-
Attention for fine-grained categorization
Pierre Sermanet, Andrea Frome, Esteban Real
International Conference on Learning Representations (ICLR) workshop, Arxiv (2015)
-
Beyond Short Snippets: Deep Networks for Video Classification
Joe Yue-Hei Ng, Matthew Hausknecht, Sudheendra Vijayanarasimhan, Oriol Vinyals, Rajat Monga, George Toderici
Computer Vision and Pattern Recognition (2015)
-
BilBOWA: Fast Bilingual Distributed Representations without Word Alignments
Stephan Gouws, Yoshua Bengio, Greg Corrado
Proceedings of the 32nd International Conference on Machine Learning (2015)
-
Characterising Choiceless Polynomial Time with First-Order Interpretations
Erich Grädel, Wied Pakusa, Svenja Schalthöfer, Lukasz Kaiser
LICS (2015), pp. 677-688
-
Convolutional, Long Short-Term Memory, Fully Connected Deep Neural Networks
Tara Sainath, Oriol Vinyals, Andrew Senior, Hasim Sak
ICASSP (2015)
-
Deep Networks With Large Output Spaces
Sudheendra Vijayanarasimhan, Jonathon Shlens, Rajat Monga, Jay Yagnik
International Conference on Learning Representations (2015)
-
Explaining and Harnessing Adversarial Examples
Ian Goodfellow, Jonathon Shlens, Christian Szegedy
International Conference on Learning Representations (2015)
-
Going Deeper with Convolutions
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, Andrew Rabinovich
Computer Vision and Pattern Recognition (CVPR) (2015)
-
Grammar as a Foreign Language
Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton
Arxiv (2015)
-
Graph Searching Games and Width Measures for Directed Graphs
Saeed Akhoondian Amiri, Lukasz Kaiser, Stephan Kreutzer, Roman Rabinovich, Sebastian Siebertz
STACS (2015), pp. 34-47
-
Guest Editorial: Deep Learning
Marc'Aurelio Ranzato, Geoffrey E. Hinton, Yann LeCun
International Journal of Computer Vision, vol. 113 (2015), pp. 1-2
-
Learning semantic relationships for better action retrieval in images
Vignesh Ramanathan, Congcong Li, Jia Deng, Wei Han, Zhen Li, Kunlong Gu, Yang Song, Samy Bengio, Chuck Rosenberg, Li Fei-Fei
CVPR (2015)
-
Learning the Speech Front-end with Raw Waveform CLDNNs
Tara Sainath, Ron J. Weiss, Kevin Wilson, Andrew W. Senior, Oriol Vinyals
Interspeech (2015)
-
Wojciech Zaremba, Ilya Sutskever
arXiv (2015)
-
Move evaluation in go using deep convolutional neural networks
Chris J. Maddison, Aja Huang, Ilya Sutskever, David Silver
ICLR, ICLR (2015)
-
Pedestrian Detection with a Large-Field-Of-View Deep Network
Anelia Angelova, Alex Krizhevsky, Vincent Vanhoucke
Proceedings of ICRA 2015
-
Pointer Networks
Oriol Vinyals, Meire Fortunato, Navdeep Jaitly
CoRR, vol. abs/1506.03134 (2015)
-
Qualitatively Characterizing Neural Network Optimization Problems
Ian Goodfellow, Oriol Vinyals, Andrew Saxe
International Conference on Learning Representations (2015)
-
Real-Time Grasp Detection Using Convolutional Neural Networks
Joseph Redmon, Anelia Angelova
International Conference on Robotics and Automation (ICRA), IEEE (2015)
-
Real-Time Pedestrian Detection With Deep Network Cascades
Anelia Angelova, Alex Krizhevsky, Vincent Vanhoucke, Abhijit Ogale, Dave Ferguson
Proceedings of BMVC 2015
-
Reinforcement learning neural Turing machines
Wojciech Zaremba, Ilya Sutskever
Google Inc. (2015)
-
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Samy Bengio, Oriol Vinyals, Navdeep Jaitly, Noam M. Shazeer
Advances in Neural Information Processing Systems, NIPS (2015)
-
Semi-supervised sequence learning
Advances in Neural Information Processing Systems, NIPS (2015)
-
Sentence Compression by Deletion with LSTMs
Katja Filippova, Enrique Alfonseca, Carlos Colmenares, Lukasz Kaiser, Oriol Vinyals
Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP'15)
-
Show and tell: A neural image caption generator
Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan
Computer Vision and Pattern Recognition (2015)
-
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng
tensorflow.org (2015)
-
Towards Principled Unsupervised Learning
Ilya Sutskever, Rafal Jozefowicz, Karol Gregor, Danilo Rezende, Tim Lillicrap, Oriol Vinyals
Google Inc. (2015)
-
Training Deep Neural Networks on Noisy Labels with Bootstrapping
Scott E. Reed, Honglak Lee, Dragomir Anguelov, Christian Szegedy, Dumitru Erhan, Andrew Rabinovich
ICLR 2015
-
Asynchronous Stochastic Optimization for Sequence Training of Deep Neural Networks
Georg Heigold, Erik McDermott, Vincent Vanhoucke, Andrew Senior, Michiel Bacchiani
Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Firenze, Italy (2014)
-
Autoregressive Product of Multi-frame Predictions Can Improve the Accuracy of Hybrid Models
Navdeep Jaitly, Vincent Vanhoucke, Geoffrey Hinton
Proceedings of Interspeech 2014
-
Distilling the Knowledge in a Neural Network
Geoffrey Hinton, Oriol Vinyals, Jeffrey Dean
NIPS Deep Learning and Representation Learning Workshop (2014)
-
Distributed Representations of Sentences and Documents
Quoc V. Le, Tomas Mikolov
International Conference on Machine Learning (2014)
-
Intriguing properties of neural networks
Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, Rob Fergus
International Conference on Learning Representations (2014)
-
Large-Scale Object Classification Using Label Relation Graphs
Jia Deng, Nan Ding, Yangqing Jia, Andrea Frome, Kevin Murphy, Samy Bengio, Yuan Li, Hartmut Neven, Hartwig Adam
European Conference on Computer Vision (2014)
-
Learning Factored Representations in a Deep Mixture of Experts
David Eigen, Marc'Aurelio Ranzato, Ilya Sutskever
arVix (2014)
-
Joonseok Lee, Samy Bengio, Seungyeon Kim, Guy Lebanon, Yoram Singer
Proceedings of the 23rd International World Wide Web Conference (WWW), ACM (2014)
-
Marc'Aurelio Ranzato
Google Inc. (2014)
-
Random Walk Initialization for Training Very Deep Feedforward Networks
David Sussillo, L.F. Abbott
arXiv preprint, Google Inc. (2014), pp. 1-10
-
Recurrent Neural Network Regularization
Wojciech Zaremba, Ilya Sutskever, Oriol Vinyals
Google Inc. (2014)
-
Sequence Discriminative Distributed Training of Long Short-Term Memory Recurrent Neural Networks
Hasim Sak, Oriol Vinyals, Georg Heigold, Andrew Senior, Erik McDermott, Rajat Monga, Mark Mao
Interspeech (2014)
-
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le
Proc. NIPS, Montreal, CA (2014)
-
Training Highly Multi-class Linear Classifiers
Maya R. Gupta, Samy Bengio, Jason Weston
Journal Machine Learning Research (JMLR) (2014), 1461-−1492
-
Word Embeddings for Speech Recognition
Proceedings of the 15th Conference of the International Speech Communication Association, Interspeech (2014)
-
Zero-Shot Learning by Convex Combination of Semantic Embeddings
Mohammad Norouzi, Tomas Mikolov, Samy Bengio, Yoram Singer, Jonathon Shlens, Andrea Frome, Greg Corrado, Jeffrey Dean
International Conference on Learning Representations (2014)
-
An Empirical study of learning rates in deep neural networks for speech recognition
Andrew Senior, Georg Heigold, Marc'aurelio Ranzato, Ke Yang
Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Vancouver, CA (2013) (to appear)
-
DeViSE: A Deep Visual-Semantic Embedding Model
Andrea Frome, Greg Corrado, Jonathon Shlens, Samy Bengio, Jeffrey Dean, Marc’Aurelio Ranzato, Tomas Mikolov
Neural Information Processing Systems (NIPS) (2013)
-
Distributed Representations of Words and Phrases and their Compositionality
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, Jeffrey Dean
Neural and Information Processing System (NIPS) (2013)
-
Efficient Estimation of Word Representations in Vector Space
Tomas Mikolov, Kai Chen, Greg S. Corrado, Jeffrey Dean
International Conference on Learning Representations (2013)
-
Exploiting Similarities among Languages for Machine Translation
Tomas Mikolov, Quoc V. Le, Ilya Sutskever
ARXIV (2013)
-
Fastfood-computing hilbert space expansions in loglinear time
Quoc V. Le, Tamas Sarlos, Alex Smola
International Conference on Machine Learning (2013) (to appear)
-
Grounded compositional semantics for finding and describing images with sentences
Richard Socher, Andrej Karpathy, Quoc V. Le, Chris D. Manning, Andrew Y. Ng
Transactions of the Association for Computational Linguistics (2013) (to appear)
-
Multiframe Deep Neural Networks for Acoustic Modeling
Vincent Vanhoucke, Matthieu Devin, Georg Heigold
Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Vancouver, CA (2013)
-
Multilingual acoustic models using distributed deep neural networks
Georg Heigold, Vincent Vanhoucke, Andrew Senior, Patrick Nguyen, Marc'aurelio Ranzato, Matthieu Devin, Jeff Dean
Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE, Vancouver, CA (2013)
-
On Rectified Linear Units For Speech Processing
M.D. Zeiler, M. Ranzato, R. Monga, M. Mao, K. Yang, Q.V. Le, P. Nguyen, A. Senior, V. Vanhoucke, J. Dean, G.E. Hinton
38th International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver (2013)
-
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling
Ciprian Chelba, Tomas Mikolov, Mike Schuster, Qi Ge, Thorsten Brants, Phillipp Koehn, Tony Robinson
ArXiv, Google (2013)
-
Using Web Co-occurrence Statistics for Improving Image Categorization
Samy Bengio, Jeffrey Dean, Dumitru Erhan, Eugene Ie, Quoc Le, Andrew Rabinovich, Jonathon Shlens, Yoram Singer
arXiv (2013)
-
Application Of Pretrained Deep Neural Networks To Large Vocabulary Speech Recognition
Navdeep Jaitly, Patrick Nguyen, Andrew Senior, Vincent Vanhoucke
Proceedings of Interspeech 2012
-
Building high-level features using large scale unsupervised learning
Quoc Le, Marc'Aurelio Ranzato, Rajat Monga, Matthieu Devin, Kai Chen, Greg Corrado, Jeff Dean, Andrew Ng
International Conference in Machine Learning (2012)
-
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Geoffrey Hinton, Li Deng, Dong Yu, George Dahl, Abdel-rahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara Sainath, Brian Kingsbury
Signal Processing Magazine (2012)
-
Large Scale Distributed Deep Networks
Jeffrey Dean, Greg S. Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc’Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, Andrew Y. Ng
NIPS (2012)
