Oriol Vinyals

Oriol Vinyals is a Research Scientist at Google DeepMind, working in Deep Learning. Prior to joining DeepMind, Oriol was part of the Google Brain team. He holds a Ph.D. in EECS from University of California, Berkeley and is a recipient of the 2016 MIT TR35 innovator award. His research has been featured multiple times at the New York Times, BBC, etc., and his articles have been cited over 17000 times. His academic involvement includes program chair for the International Conference on Learning Representations (ICLR) of 2017, and 2018. He has also been an area chair for many editions of the NIPS and ICML conferences. At DeepMind he continues working on his areas of interest, which include artificial intelligence, with particular emphasis on machine learning, deep learning and reinforcement learning.

Google Publications

Neural Message Passing for Quantum Chemistry

Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

ICML (2017)
Parallel WaveNet: Fast High-Fidelity Speech Synthesis

Aäron van den Oord, Yazhe Li, Igor Babuschkin, Karen Simonyan, Oriol Vinyals, Koray Kavukcuoglu, George van den Driessche, Edward Lockhart, Luis Carlos Cobo Rus, Florian Stimberg, Norman Casagrande, Dominik Grewe, Seb Noury, Sander Dieleman, Erich Elsen, Nal Kalchbrenner, Heiga Zen, Alexander Graves, Helen King, Thomas Walters, Dan Belov, Demis Hassabis

NA, Google Deepmind, NA (2017)
Prediction errors of molecular machine learning models lower than hybrid DFT error

Felix Faber, Luke Hutchinson, Huang Bing, Justin Gilmer, Sam Schoenholz, George Dahl, Oriol Vinyals, Steven Kearnes, Patrick Riley, Anatole von Lilienfeld

Journal of Chemical Theory and Computation (2017)
Understanding deep learning requires rethinking generalization

Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals

ICLR (2017)
A Neural Transducer

Navdeep Jaitly, David Sussillo, Quoc V. Le, Oriol Vinyals, Ilya Sutskever, Samy Bengio

NIPS 2016 (2016)
Adversarial Evaluation of Dialogue Models

Anjuli Kannan, Oriol Vinyals

NIPS Workshop (2016)
An Online Sequence-to-Sequence Model Using Partial Conditioning

Navdeep Jaitly, Quoc V. Le, Oriol Vinyals, Samy Bengio

ARXIV (2016)
Contextual LSTM: A Step towards Hierarchical Language Modeling

Shalini Ghosh, Oriol Vinyals, Brian Strope, Scott Roy, Tom Dean, Larry Heck

Workshop on Large-scale Deep Learning for Data Mining - KDD (2016) (to appear)
Exploring the limits of language modeling

Rafal Jozefowicz, Oriol Vinyals, Mike Schuster, Noam Shazeer, Yonghui Wu

Google Inc. (2016)
Generating Sentences from a Continuous Space

Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew M. Dai, Rafal Jozefowicz, Samy Bengio

CoNLL (2016)
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation

Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, Jeffrey Dean

CoRR, vol. abs/1609.08144 (2016)
Listen, Attend and Spell: A Neural Network for Large Vocabulary Conversational Speech Recognition

William Chan, Navdeep Jaitly, Quoc V. Le, Oriol Vinyals

ICASSP (2016)
Multi-task Sequence to Sequence Learning

Thang Luong, Quoc V. Le, Ilya Sutskever, Oriol Vinyals, Lukasz Kaiser

International Conference on Learning Representations (2016)
Multilingual Language Processing From Bytes

Dan Gillick, Cliff Brunk, Oriol Vinyals, Amarnag Subramanya

NAACL (2016)
Order matters: Sequence to sequence for sets

Oriol Vinyals, Samy Bengio, Manjunath Kudlur

International Conference on Learning Representations (ICLR) (2016)
WaveNet: A Generative Model for Raw Audio

Aäron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alexander Graves, Nal Kalchbrenner, Andrew Senior, Koray Kavukcuoglu

Arxiv (2016)
A Neural Conversational Model

Oriol Vinyals, Quoc V. Le

ICML Deep Learning Workshop (2015)
Addressing the Rare Word Problem in Neural Machine Translation

Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, Wojciech Zaremba

ACL (2015)
Beyond Short Snippets: Deep Networks for Video Classification

Joe Yue-Hei Ng, Matthew Hausknecht, Sudheendra Vijayanarasimhan, Oriol Vinyals, Rajat Monga, George Toderici

Computer Vision and Pattern Recognition (2015)
Convolutional, Long Short-Term Memory, Fully Connected Deep Neural Networks

Tara Sainath, Oriol Vinyals, Andrew Senior, Hasim Sak

ICASSP (2015)
Distilling the Knowledge in a Neural Network

Geoffrey Hinton, Oriol Vinyals, Jeffrey Dean

NIPS Deep Learning and Representation Learning Workshop (2015)
Grammar as a Foreign Language

Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey Hinton

NIPS (2015)
Learning the Speech Front-end with Raw Waveform CLDNNs

Tara Sainath, Ron J. Weiss, Kevin Wilson, Andrew W. Senior, Oriol Vinyals

Interspeech (2015)
Listen, Attend and Spell

William Chan, Navdeep Jaitly, Quoc V. Le, Oriol Vinyals

CoRR, vol. abs/1508.01211 (2015)
Pointer Networks

Oriol Vinyals, Meire Fortunato, Navdeep Jaitly

NIPS (2015), pp. 2692-2700
Qualitatively Characterizing Neural Network Optimization Problems

Ian Goodfellow, Oriol Vinyals, Andrew Saxe

International Conference on Learning Representations (2015)
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks

Samy Bengio, Oriol Vinyals, Navdeep Jaitly, Noam M. Shazeer

Advances in Neural Information Processing Systems, NIPS (2015)
Sentence Compression by Deletion with LSTMs

Katja Filippova, Enrique Alfonseca, Carlos Colmenares, Lukasz Kaiser, Oriol Vinyals

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP'15)
Show and tell: A neural image caption generator

Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan

Computer Vision and Pattern Recognition (2015)
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng

tensorflow.org (2015)
Towards Principled Unsupervised Learning

Ilya Sutskever, Rafal Jozefowicz, Karol Gregor, Danilo Rezende, Tim Lillicrap, Oriol Vinyals

Google Inc. (2015)
Recurrent Neural Network Regularization

Wojciech Zaremba, Ilya Sutskever, Oriol Vinyals

Google Inc. (2014)
Sequence Discriminative Distributed Training of Long Short-Term Memory Recurrent Neural Networks

Hasim Sak, Oriol Vinyals, Georg Heigold, Andrew Senior, Erik McDermott, Rajat Monga, Mark Mao

Interspeech (2014)
Sequence to Sequence Learning with Neural Networks

Ilya Sutskever, Oriol Vinyals, Quoc V. Le

Proc. NIPS, Montreal, CA (2014)

Previous Publications

Recurrent Neural Networks for Noise Reduction in Robust ASR

Andrew Maas, Quoc V. Le, Tyler M. O’Neil, Oriol Vinyals, Patrick Nguyen, Andrew Y. Ng

INTERSPEECH (2012)

Oriol Vinyals

Co-Authors

Google Publications

Previous Publications