Sensory Perception & Interaction Research Group

University of British Columbia

Devices with small screens, such as smartwatches and fitness trackers, struggle with limited forms of input - relying on touch, physical buttons, or voice. Inspired by new materials (such as Gelly, a mutual capacitance based sensor that can sense touch localization, proximity, pressure, and shear developed in the UBC Madden lab), this project explores the potential of in-air gestures performed above the surface to expand both the interaction space and richness of input for such devices.

Flexible smartphones can use life-like movement to communicate information to users.

Hop, run, skip, and jump your way to better health (and context-aware applications).


To guide walking rate, we detect cadence and cue individual steps with minimal attentional impact.