
Shumeet Baluja, Ph.D., is currently a Senior Staff Research Scientist at Google, where he works on a broad set of topics ranging from image processing and machine learning to wireless application development and user interaction measurement. Shumeet was formerly the Chief Technology Officer (CTO) of JAMDAT Mobile, Inc., where he oversaw all aspects of technology initiation, development and deployment. Previously, Shumeet was Chief Scientist at Lycos Inc., where he led the Research and Applied Technology Group in the quantitative and qualitative analysis of user behavior, including data mining and trend analysis, advertisement optimization, and statistical modeling of traffic and site interactions. As Senior Vice President of R&D at eCompanies LLC, he spearheaded the creation of their wireless practice and was responsible for finding and evaluating new technologies and technology entrepreneurs. Shumeet has filed numerous patents and has published scientific papers in fields including computer vision and facial image processing, advertisement display and optimization, automated vehicle control, statistical machine learning, and high-dimensional optimization. Shumeet graduated from the University of Virginia with a Bachelor of Science, with high distinction, in 1991. He received his Ph.D. in computer science from Carnegie Mellon University in 1996.
Finding Images and Line Drawings in Document-Scanning Systems, Shumeet Baluja, Michele Covell, Proc. International Conference on Document Analysis and Retrieval, 2009.
LSH Banding for Large-Scale Retrieval with Memory and Recall Constraints, Michele Covell, Shumeet Baluja, International Conference on Acoustics, Speech, and Signal Processing, 2009.
Text Classification Through Time: Efficient Label Propagation in Time-Based Graphs, Shumeet Baluja, Deepak Ravichandran, D. Sivakumar, International Conference on Knowledge Discovery and Information Retrieval, 2009.
What's Up CAPTCHA? A CAPTCHA Based On Image Orientation, Rich Gossweiler, Maryam Kamvar, Shumeet Baluja, WWW 2009.
Learning to hash: forgiving hash functions and applications Learning to hash: forgiving hash functions and applications, Shumeet Baluja, Michele Covell, Data Mining and Knowledge Discovery (2008).
Mass Personalization: Social and Interactive Applications using Sound-Track Identification, Michael Fink, Michele Covell, Shumeet Baluja, Journal of Multimedia Tools and Applications, vol. 36 (2008), pp. 115-132.
PageRank for Product Image Search, Yushi Jing, Shumeet Baluja, WWW-2008.
Permutation Grouping: Intelligent Hash Function Design for Audio & Image Retrieval, Shumeet Baluja, Michele Covell, Sergey Ioffe, International Conference on Acoustics, Speech and Signal Processing (ICASSP-2008).
Query Suggestions for Mobile Search: Understanding Usage Patterns, Maryam Kamvar, Shumeet Baluja, Proceedings of the SIGCHI conference on Human Factors in computing systems (CHI), 2008.
Video Suggestion and Discovery for YouTube: Taking Random Walks Through the View Graph, Shumeet Baluja, Rohan Seth, D. Sivakumar, Yushi Jing, Jay Yagnik, Shankar Kumar, Deepak Ravichandran, Mohamed Aly, WWW-2008.
VisualRank: Applying PageRank to Large-Scale Image Search, Yushi Jing, Shumeet Baluja, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30 (2008), pp. 1877-1890.
Waveprint: Efficient Wavelet-Based Audio Fingerprinting, Shumeet Baluja, Michele Covell, Pattern Recognition (2008).
Audio Fingerprinting: Combining Computer Vision & Data Stream Processing, Shumeet Baluja, Michele Covell, Proceedings of the 2007 International Conference on Acoustics, Speech, and Signal Processing.
Automated Image Orientation Detection: A Scalable Boosting Approach, Shumeet Baluja, Pattern Analysis and Applications (2007).
Boosting Sex Identification Performance, Shumeet Baluja, Henry A. Rowley, International Journal of Computer Vision, vol. 71 (2007), pp. 111-119.
Deciphering Trends in Mobile Search, Maryam Kamvar, Shumeet Baluja, IEEE Computer, vol. 40, no. 8 (2007), pp. 58-62.
Known-Audio Detection Using Waveprint: Spectrogram Fingerprinting By Wavelet Hashing, Michele Covell, Shumeet Baluja, Proceedings of the 2007 International Conference on Acoustics, Speech, and Signal Processing.
Learning Forgiving Hash Functions: Algorithms and Large Scale Tests, Shumeet Baluja, Michele Covell, IJCAI-07: International Joint Conference on Artificial Intelligence, 2007.
The Role of Context in Query Input: Using contexual signals to complete queries on mobile devices, Maryam Kamvar, Shumeet Baluja, 2007.
A Large Scale Study of Wireless Search Behavior: Google Mobile Search, Maryam Kamvar, Shumeet Baluja, Proceedings of the SIGCHI conference on Human Factors in computing systems (CHI), 2006.
Advertisement Detection and Replacement using Acoustic and Visual Repetition, Michele Covell, Shumeet Baluja, Michael Fink, Proceedings of the 2006 International Workshop on Multimedia Signal Processing.
Browsing on Small Screens: Recasting Web-Page Segmentation into an Efficient Machine Learning Framework, Shumeet Baluja, Proceedings of the Fifteenth International World Wide Web Conference, 2006.
Content Fingerprinting Using Wavelets, Shumeet Baluja, Michele Covell, Proceedings of the Conference of Visual Media Production, 2006.
Large Scale Image-Based Adult-Content Filtering, Henry A. Rowley, Yushi Jing, Shumeet Baluja, 1st International Conference on Computer Vision Theory, 2006.
Social- and Interactive-Television Applications Based on Real-Time Ambient-Audio Identification, Michael Fink, Michele Covell, Shumeet Baluja, European Interactive TV Conference (Euro-ITV), 2006.
Boosting Sex Identification Performance, Shumeet Baluja, Henry A. Rowley, Proceedings of the Seventeenth Innovative Applications of Artificial Intelligence Conference, 2005, pp. 1508-1513.
Large Scale Performance Measurement of Content-Based Automated Image-Orientation Detection, Shumeet Baluja, Henry A. Rowley, International Conference on Image Processing, 2005.
Efficient Face Orientation Discrimination, Shumeet Baluja, Mehran Sahami, Henry A. Rowley, International Conference on Image Processing (ICIP-2004).
The Happy Searcher: Challenges in Web Information Retrieval, Mehran Sahami, Vibhu Mittal, Shumeet Baluja, Henry A. Rowley, The Eighth Pacific Rim International Conference on Artificial Intelligence (PRICAI-2004).
Browsing on small screens: recasting web-page segmentation into an efficient machine learning framework, Shumeet Baluja, WWW, 2006, pp. 33-42.
Using a priori knowledge to create probabilistic models for optimization, Shumeet Baluja, Int. J. Approx. Reasoning, vol. 31 (2002), pp. 193-220.
Applying Machine Learning for High-Performance Named-Entity Extraction, Shumeet Baluja, Vibhu O. Mittal, Rahul Sukthankar, Computational Intelligence, vol. 16 (2000), pp. 586-596.
Memory-Based Face Recognition for Visitor Identification, Terence Sim, Rahul Sukthankar, Matthew Mullin, Shumeet Baluja, FG, 2000, pp. 214-220.
Using Labeled and Unlabeled Data for Probabilistic Modeling of Face Orientation, Shumeet Baluja, IJPRAI, vol. 14 (2000), pp. 1097-1107.
Evolution-Based Methods for Selecting Point Data for Object Localization: Applications to Computer-Assisted Surgery, Shumeet Baluja, David Simon, Appl. Intell., vol. 8 (1998), pp. 7-19.
Fast Probabilistic Modeling for Combinatorial Optimization, Shumeet Baluja, Scott Davies, AAAI/IAAI, 1998, pp. 469-476.
Making Templates Rotationally Invariant. An Application to Rotated Digit Recognition, Shumeet Baluja, NIPS, 1998, pp. 847-853.
Neural Network-Based Face Detection, Henry A. Rowley, Shumeet Baluja, Takeo Kanade, IEEE Trans. Pattern Anal. Mach. Intell., vol. 20 (1998), pp. 23-38.
Probabilistic Modeling for Face Orientation Discrimination: Learning from Labeled and Unlabeled Data, Shumeet Baluja, NIPS, 1998, pp. 854-860.
Rotation Invariant Neural Network-Based Face Detection, Henry A. Rowley, Shumeet Baluja, Takeo Kanade, CVPR, 1998, pp. 38-44.
Dynamic Relevance: Vision-Based Focus of Attention Using Artificial Neural Networks. (Technical Note), Shumeet Baluja, Dean Pomerleau, Artif. Intell., vol. 97 (1997), pp. 381-395.
Expectation-based selective attention for visual monitoring and control of a robot vehicle, Shumeet Baluja, Dean Pomerleau, Robotics and Autonomous Systems, vol. 22 (1997), pp. 329-344.
Using Expectation to Guide Processing: A Study of Three Real-World Applications, Shumeet Baluja, NIPS, 1997.
Using Optimal Dependency-Trees for Combinational Optimization, Shumeet Baluja, Scott Davies, ICML, 1997, pp. 30-38.
Genetic Algorithms and Explicit Search Statistics, Shumeet Baluja, NIPS, 1996, pp. 319-325.
Neural Network-Based Face Detection, Henry A. Rowley, Shumeet Baluja, Takeo Kanade, CVPR, 1996, pp. 203-208.
Human Face Detection in Visual Scenes, Henry A. Rowley, Shumeet Baluja, Takeo Kanade, NIPS, 1995, pp. 875-881.
Removing the Genetics from the Standard Genetic Algorithm, Shumeet Baluja, Rich Caruana, ICML, 1995, pp. 38-46.
Using the Future to Sort Out the Present: Rankprop and Multitask Learning for Medical Risk Evaluation, Rich Caruana, Shumeet Baluja, Tom M. Mitchell, NIPS, 1995, pp. 959-965.
Using the Representation in a Neural Network's Hidden Layer for Task-Specific Focus of Attention, Shumeet Baluja, Dean Pomerleau, IJCAI, 1995, pp. 133-141.
Non-Intrusive Gaze Tracking Using Artificial Neural Networks, Shumeet Baluja, Dean Pomerleau, NIPS, 1993, pp. 753-760.