Shumin Zhai

Shumin Zhai is a Human-Computer Interaction research scientist at Google Inc. From 1996 to 2011 he worked at the IBM Almaden Research Center. He is interested in both foundational research of user interfaces and practical product and service innovations. He originated and led the ShapeWriter project that pioneered the touch screen gesture keyboard paradigm. He has published over 100 research papers and received 30 patents. He is active in the academic community and is currently the Editor-in-Chief of ACM Transactions on Computer-Human Interaction. He has been a visiting professor and lectured at universities in the US, Europe and China. He is a Fellow of the ACM and a Member of the CHI Academy.

His external web page is at www.shuminzhai.com.

Google Publications

Previous Publications

  •   

    Multilingual Touchscreen Keyboard Design and Optimization

    Xiaojun Bi, Barton A. Smith, Shumin Zhai

    Human Computer Interaction, vol. 27 (2012), pp. 352-382

  •  

    Foundations for designing and evaluating user interfaces based on the crossing paradigm

    Georg Apitz, François Guimbretière, Shumin Zhai

    ACM Trans. Comput.-Hum. Interact., vol. 17 (2010)

  •  

    Pen pressure control in trajectory-based interaction

    Jibin Yin, Xiangshi Ren, Shumin Zhai

    Behaviour & Information Technology, vol. 29 (2010), pp. 137-148

  •  

    Phone n' Computer: teaming up an information appliance with a PC

    Min Yin, Jeffrey S. Pierce, Shumin Zhai

    Personal and Ubiquitous Computing, vol. 14 (2010), pp. 601-607

  •  

    Quasi-qwerty soft keyboard optimization

    Xiaojun Bi, Barton A. Smith, Shumin Zhai

    CHI (2010), pp. 283-286

  •  

    SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture

    Jingtao Wang, Shumin Zhai, John F. Canny

    CHI (2010), pp. 15-24

  •   

    “Writing with music”: Exploring the use of auditory feedback in gesture interfaces

    Tue Haste Andersen, Shumin Zhai

    ACM Transactions on Applied Perception (TAP), vol. 7 (2010)

  •  

    Shapewriter on the iphone: from the laboratory to the real world

    Shumin Zhai, Per Ola Kristensson, Pengjun Gong, Michael Greiner, Shilei Allen Peng, Liang Mico Liu, Anthony Dunnigan

    CHI Extended Abstracts (2009), pp. 2667-2670

  •  

    The performance of touch screen soft buttons

    Seungyon Lee, Shumin Zhai

    CHI (2009), pp. 309-318

  •  

    Using strokes as command shortcuts: cognitive benefits and toolkit support

    Caroline Appert, Shumin Zhai

    CHI (2009), pp. 2289-2298

  •  

    Improving word-recognizers using an interactive lexicon with active and passive words

    Per Ola Kristensson, Shumin Zhai

    IUI (2008), pp. 353-356

  •  

    Interlaced QWERTY: accommodating ease of visual search and input flexibility in shape writing

    Shumin Zhai, Per Ola Kristensson

    CHI (2008), pp. 593-596

  •  

    On the ease and efficiency of human-computer interfaces

    Shumin Zhai

    ETRA (2008), pp. 9-10

  •  

    Command strokes with and without preview: using pen gestures on keyboard for command selection

    Per Ola Kristensson, Shumin Zhai

    CHI (2007), pp. 1137-1146

  •  

    Hard lessons: effort-inducing interfaces benefit spatial learning

    Andy Cockburn, Per Ola Kristensson, Jason Alexander, Shumin Zhai

    CHI (2007), pp. 1571-1580

  •  

    Learning shape writing by game playing

    Per Ola Kristensson, Shumin Zhai

    CHI Extended Abstracts (2007), pp. 1971-1976

  •  

    Modeling human performance of pen stroke gestures

    Xiang Cao, Shumin Zhai

    CHI (2007), pp. 1495-1504

  •  

    Camera phone based motion sensing: interaction techniques, applications and performance study

    Jingtao Wang, Shumin Zhai, John F. Canny

    UIST (2006), pp. 101-110

  •  

    The benefits of augmenting telephone voice menu navigation with visual browsing and search

    Min Yin, Shumin Zhai

    CHI (2006), pp. 319-328

  •  

    Conversing with the user based on eye-gaze patterns

    Pernilla Qvarfordt, Shumin Zhai

    CHI (2005), pp. 221-230

  •  

    Dial and see: tackling the voice menu navigation problem with cross-device user experience integration

    Min Yin, Shumin Zhai

    UIST (2005), pp. 187-190

  •  

    In search of effective text input interfaces for off the desktop computing

    Shumin Zhai, Per Ola Kristensson, Barton A. Smith

    Interacting with Computers, vol. 17 (2005), pp. 229-250

  •  

    Introduction to sensing-based interaction

    Shumin Zhai, Victoria Bellotti

    ACM Trans. Comput.-Hum. Interact., vol. 12 (2005), pp. 1-2

  •  

    RealTourist - A Study of Augmenting Human-Human and Human-Computer Dialogue with Eye-Gaze Overlay

    Pernilla Qvarfordt, David Beymer, Shumin Zhai

    INTERACT (2005), pp. 767-780

  •  

    Relaxing stylus typing precision by geometric pattern matching

    Per Ola Kristensson, Shumin Zhai

    IUI (2005), pp. 151-158

  •  

    Characterizing computer input with Fitts' law parameters-the information and non-information aspects of pointing

    Shumin Zhai

    Int. J. Hum.-Comput. Stud., vol. 61 (2004), pp. 791-809

  •  

    Human Action Laws in Electronic Virtual Worlds - An Empirical Study of Path Steering Performance in VR

    Shumin Zhai, Johnny Accot, Rogier Woltjer

    Presence, vol. 13 (2004), pp. 113-127

  •  

    SHARK2: a large vocabulary shorthand writing system for pen-based computers

    Per Ola Kristensson, Shumin Zhai

    UIST (2004), pp. 43-52

  •  

    Speed-accuracy tradeoff in Fitts' law tasks-on the equivalency of actual and nominal pointing precision

    Shumin Zhai, Jing Kong, Xiangshi Ren

    Int. J. Hum.-Comput. Stud., vol. 61 (2004), pp. 823-856

  •  

    TNT: a numeric keypad based text input method

    Magnus Ingmarsson, David Dinka, Shumin Zhai

    CHI (2004), pp. 639-646

  •  

    Top-down learning strategies: can they facilitate stylus keyboard learning?

    Paul Ung-Joon Lee, Shumin Zhai

    Int. J. Hum.-Comput. Stud., vol. 60 (2004), pp. 585-598

  •  

    View size and pointing difficulty in multi-scale navigation

    Yves Guiard, Michel Beaudouin-Lafon, Julien Bastin, Dennis Pasveer, Shumin Zhai

    AVI (2004), pp. 117-124

  •  

    Candidate Display Styles in Japanese Input

    Xiangshi Ren, Kinya Tamura, Jing Kong, Shumin Zhai

    INTERACT (2003)

  •  

    Collaboration Meets Fitts' Law: Passing Virtual Objects with and without Haptic Force Feedback

    Eva-Lotta Sallnäs, Shumin Zhai

    INTERACT (2003)

  •  

    High precision touch screen interaction

    Pär-Anders Albinsson, Shumin Zhai

    CHI (2003), pp. 105-112

  •  

    Human Movement Performance in Relation to Path Constraint - The Law of Steering in Locomotion

    Shumin Zhai, Rogier Woltjer

    VR (2003), pp. 149-

  •  

    Human on-line response to target expansion

    Shumin Zhai, Stéphane Conversy, Michel Beaudouin-Lafon, Yves Guiard

    CHI (2003), pp. 177-184

  •  

    Refining Fitts' law models for bivariate pointing

    Johnny Accot, Shumin Zhai

    CHI (2003), pp. 193-200

  •  

    Shorthand writing on stylus keyboard

    Shumin Zhai, Per Ola Kristensson

    CHI (2003), pp. 97-104

  •  

    What's in the eyes for attentive input

    Shumin Zhai

    Commun. ACM, vol. 46 (2003), pp. 34-39

  •  

    More than dotting the i's - foundations for crossing-based interfaces

    Johnny Accot, Shumin Zhai

    CHI (2002), pp. 73-80

  •  

    Movement model, hits distribution and learning in virtual keyboarding

    Shumin Zhai, Alison E. Sue, Johnny Accot

    CHI (2002), pp. 17-24

  •  

    Chinese input with keyboard and eye-tracking: an anatomical study

    Jingtao Wang, Shumin Zhai, Hui Su

    CHI (2001), pp. 349-356

  •  

    Scale effects in steering law tasks

    Johnny Accot, Shumin Zhai

    CHI (2001), pp. 1-8

  •  

    Gaze and Speech in Attentive User Interfaces

    Paul P. Maglio, Teenie Matlock, Christopher S. Campbell, Shumin Zhai, Barton A. Smith

    ICMI (2000), pp. 1-7

  •  

    Hand eye coordination patterns in target selection

    Barton A. Smith, Janet Ho, Wendy S. Ark, Shumin Zhai

    ETRA (2000), pp. 117-122

  •  

    The metropolis keyboard - an exploration of quantitative techniques for virtual keyboard design

    Shumin Zhai, Michael A. Hunter, Barton A. Smith

    UIST (2000), pp. 119-128

  •  

    In Search of the `Magic Carpet': Design and Experimentation of a Bimanual 3D Navigation Interface

    Shumin Zhai, Eser Kandogan, Barton A. Smith, Ted Selker

    J. Vis. Lang. Comput., vol. 10 (1999), pp. 3-17

  •  

    Keeping an Eye for HCI

    Carlos Hitoshi Morimoto, David Koons, Arnon Amir, Myron Flickner, Shumin Zhai

    SIBGRAPI (1999), pp. 171-176

  •  

    Manual and Gaze Input Cascaded (MAGIC) Pointing

    Shumin Zhai, Carlos Morimoto, Steven Ihde

    CHI (1999), pp. 246-253

  •  

    Multistream Input: An Experimental Study of Document Scrolling Methods

    Shumin Zhai, Barton A. Smith

    IBM Systems Journal, vol. 38 (1999), pp. 642-651

  •  

    Performance Evaluation of Input Devices in Trajectory-Based Tasks: An Application of the Steering Law

    Johnny Accot, Shumin Zhai

    CHI (1999), pp. 466-472

  •  

    Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study

    Andrea Leganchuk, Shumin Zhai, William Buxton

    ACM Trans. Comput.-Hum. Interact., vol. 5 (1998), pp. 326-359

  •  

    Quantifying Coordination in Multiple DOF Movement and Its Application to Evaluating 6 DOF Input Devices

    Shumin Zhai, Paul Milgram

    CHI (1998), pp. 320-327

  •  

    Representation Matters: The Effect of 3D Objects and a Spatial Metaphor in a Graphical User Interface

    Wendy S. Ark, D. Christopher Dryer, Ted Selker, Shumin Zhai

    BCS HCI (1998), pp. 209-219

  •  

    An Isometric Tongue Pointing Device

    Chris Salem, Shumin Zhai

    CHI (1997), pp. 538-539

  •  

    Anisotropic human performance in six degree-of-freedom tracking: an evaluation of three-dimensional display and control interfaces

    Shumin Zhai, Paul Milgram, Anu Rastogi

    IEEE Transactions on Systems, Man, and Cybernetics, Part A, vol. 27 (1997), pp. 518-528

  •  

    Beyond Fitts' Law: Models for Trajectory-Based HCI Tasks

    Johnny Accot, Shumin Zhai

    CHI (1997), pp. 295-302

  •  

    Dual Stream Input for Pointing and Scrolling

    Shumin Zhai, Barton A. Smith, Ted Selker

    CHI Extended Abstracts (1997), pp. 305-306

  •  

    Graphical Means of Directing User's Attention in the Visual Interface

    Shumin Zhai, Julie Wright, Ted Selker, Sabra-Anne Kelin

    INTERACT (1997), pp. 59-66

  •  

    Improving Browsing Performance: A study of four input devices for scrolling and pointing tasks

    Shumin Zhai, Barton A. Smith, Ted Selker

    INTERACT (1997), pp. 286-293

  •  

    The Influence of Muscle Groups on Performance of Multiple Degree-of-Freedom Input

    Shumin Zhai, Paul Milgram, William Buxton

    CHI (1996), pp. 308-315

  •  

    The Partial-Occlusion Effect: Utilizing Semitransparency in 3D Human-Computer Interaction

    Shumin Zhai, William Buxton, Paul Milgram

    ACM Trans. Comput.-Hum. Interact., vol. 3 (1996), pp. 254-284

  •  

    Input techniques for HCI in 3D environments

    Shumin Zhai, Paul Milgram

    CHI Conference Companion (1994), pp. 85-86

  •  

    The "Silk Cursor": investigating transparency for 3D target acquisition

    Shumin Zhai, William Buxton, Paul Milgram

    CHI (1994), pp. 459-464

  •  

    The "silk cursor": investigating

    Shumin Zhai, William Buxton, Paul Milgram

    CHI Conference Companion (1994), pp. 233

  •  

    ARGOS: a display system for augmenting reality

    David Drascic, Julius Grodski, Paul Milgram, Ken Ruffo, Peter Wong, Shumin Zhai

    INTERCHI (1993), pp. 521

  •  

    An evaluation of four 6 degree-of-freedom input techniques

    Shumin Zhai, Paul Milgram, David Drascic

    INTERCHI Adjunct Proceedings (1993), pp. 123-125

  •  

    From Icons to Interface Models: Designing Hypermedia from the Bottom Up

    John A. Waterworth, Mark H. Chignell, Shumin Zhai

    International Journal of Man-Machine Studies, vol. 39 (1993), pp. 453-472

  •  

    Human Performance Evaluation of Manipulation Schemes in Virtual Environments

    Shumin Zhai, Paul Milgram

    VR (1993), pp. 155-161

  •  

    Virtual Reality for Palmtop Computers

    George W. Fitzmaurice, Shumin Zhai, Mark H. Chignell

    ACM Trans. Inf. Syst., vol. 11 (1993), pp. 197-218