Yang Li

Yang Li is a Senior Research Scientist in Human Computer Interaction and Mobile Computing at Google, and an affiliate faculty member in Computer Science & Engineering at the University of Washington. Yang’s research focuses on novel tools and methods for creating mobile interaction behaviors, particularly regarding emerging input modalities (such as gestures and cameras), cross-device interaction and predictive user interfaces. Yang wrote Gesture Search, a popular Android app for random access of mobile content using gestures. Yang develops software tool support and recognition methods by drawing insights from user behaviors, and leveraging techniques such as machine learning, computer vision and crowdsourcing to make complex tasks simple and intuitive. See Yang Li's personal website.

Google Publications

  •  

    Detecting Tapping Motion on the Side of Mobile Devices By Probabilistically Combining Hand Postures

    William McGrath, Yang Li

    UIST 2014: ACM Symposium on User Interface Software and Technology, ACM (to appear)

  •  

    GestKeyboard: Enabling Gesture-Based Interaction on Ordinary Physical Keyboard

    Haimo Zhang, Yang Li

    CHI 2014: ACM Conference on Human Factors in Computing Systems

  •  

    Gesture Script: Recognizing Gestures and their Structure using Rendering Scripts and Interactively Trained Parts

    Hao Lu, James Fogarty, Yang Li

    CHI 2014: ACM Conference on Human Factors in Computing Systems

  •  

    Gesturemote: interacting with remote displays through touch gestures

    Hao Lü, Matei Negulescu, Yang Li

    AVI 2014: International Working Conference on Advanced Visual Interfaces

  •  

    Hierarchical Route Maps for Efficient Navigation

    Noah Wang, Yang Li, Daisuke Sakamoto, Takeo Igarashi

    IUI 2014: International Conference on Intelligent User Interfaces

  •  

    InkAnchor: Enhancing Informal Ink-Based Note Taking on Touchscreen Mobile Phones

    Yi Ren, Yang Li, Edward Lank

    CHI 2014: ACM Conference on Human Factors in Computing Systems

  •  

    Optimistic Programming of Touch Interaction

    Yang Li, Hao Lu, Haimo Zhang

    TOCHI: ACM Transactions on Computer-Human Interaction (2014) (to appear)

  •  

    Reflection: Enabling Event Prediction As an On-Device Service for Mobile Interaction

    Yang Li

    UIST 2014: ACM Symposium on User Interface Software and Technology (to appear)

  •  

    Teaching Motion Gestures via Recognizer Feedback

    Ankit Kamal, Yang Li, Edward Lank

    IUI 2014: International Conference on Intelligent User Interfaces

  •   

    CrowdLearner: Rapidly Creating Mobile Recognizers Using Crowdsourcing

    Shahriyar Amini, Yang Li

    UIST'13: Proceedings of the 26th annual ACM symposium on User interface software and technology (2013), pp. 163-172

  •    

    FFitts Law: Modeling Finger Touch with Fitts’ Law

    Xiaojun Bi, Yang Li, Shumin Zhai

    Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), ACM, New York, NY, USA, pp. 1363-1372

  •   

    Gesture Studio: Authoring Multi-Touch Interactions through Demonstration and Composition

    Hao Lu, Yang Li

    CHI 2013: ACM Conference on Human Factors in Computing Systems

  •   

    Open project: a lightweight framework for remote sharing of mobile applications

    Matei Negulescu, Yang Li

    UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology (2013), pp. 281-290

  •   

    Bootstrapping Personal Gesture Shortcuts with the Wisdom of the Crowd and Handwriting Recognition

    Tom Ouyang, Yang Li

    CHI 2012: ACM Conference on Human Factors in Computing Systems, pp. 2895-2904

  •   

    Gesture coder: a tool for programming multi-touch gestures by demonstration

    Hao Lu, Yang Li

    Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, ACM, New York, NY, USA, pp. 2875-2884

  •  

    Gesture Search: Random Access to Smartphone Content

    Yang Li

    IEEE Computer: Pervasive Computing, vol. 11 (2012), pp. 10-13

  •   

    Gesture-based interaction: a new dimension for mobile user interfaces

    Yang Li

    Proceedings of the International Working Conference on Advanced Visual Interfaces, ACM, New York, NY, USA (2012), pp. 6-6

  •   

    Tap, swipe, or move: attentional demands for distracted smartphone input

    Matei Negulescu, Jaime Ruiz, Yang Li, Edward Lank

    Proceedings of the International Working Conference on Advanced Visual Interfaces, ACM, New York, NY, USA (2012), pp. 173-180

  •   

    Deep Shot: A Framework for Migrating Tasks Across Devices Using Mobile Phone Cameras

    Sean Chang, Yang Li

    CHI 2011: ACM Conference on Human Factors in Computing Systems, pp. 2163-2172

  •   

    DoubleFlip: A Motion Gesture Delimiter for Mobile Interaction

    Jaime Ruiz, Yang Li

    CHI 2011: ACM Conference on Human Factors in Computing Systems, pp. 2717-2720

  •   

    Experimental Analysis of Touch-Screen Gesture Designs in Mobile Environments

    Andrew Bragdon, Eugene Nelson, Yang Li, Ken Hinckley

    CHI 2011: ACM Conference on Human Factors in Computing Systems, pp. 403-412

  •   

    Gesture Avatar: A Technique for Operating Mobile User Interfaces Using Gestures

    Hao Lü, Yang Li

    CHI 2011: ACM Conference on Human Factors in Computing Systems, pp. 207-216

  •   

    User-Defined Motion Gestures for Mobile Interaction

    Jaime Ruiz, Yang Li, Edward Lank

    CHI 2011: ACM Conference on Human Factors in Computing Systems, pp. 197-206

  •    

    Gesture Search: A Tool for Fast Mobile Data Access

    Yang Li

    UIST'10: Symposium on User Interface Software and Technology, ACM (2010), pp. 87-96

  •   

    Protractor: A Fast and Accurate Gesture Recognizer

    Yang Li

    CHI 2010: ACM Conference on Human Factors in Computing Systems, ACM

  •  

    Beyond Pinch and Flick: Enriching Mobile Gesture Interaction

    Yang Li

    IEEE Comuter, vol. 42 (2009), pp. 87-89

Previous Publications

  •  

    FrameWire: A Tool for Automatically Extracting Interaction Logic from Paper Prototyping Tests

    Yang Li, Xiang Cao, Katherine Everitt, Morgan Dixon, James Landay

    CHI 2010: ACM Conference on Human Factors in Computing Systems, pp. 503-512