Vocal Shortcuts for Creative Experts

Yea-Seul Kim, Mira Dontcheva, Eytan Adar, Jessica Hullman

ACM CHI 2019

voicecut_teaser

A depiction of the research process of Voicecuts: we identify use cases and design guidelines for speech interaction gained from interviewing experts, develop a prototype implementation of a speech interface, and evaluate the prototype's use to understand how and when such interactions benefit expert use.

Abstract

Vocal shortcuts, short spoken phrases to control interfaces, have the potential to reduce cognitive and physical costs of interactions. They may benefit expert users of creative applications (e.g., designers, illustrators) by helping them maintain creative focus. To aid the design of vocal shortcuts and gather use cases and design guidelines for speech interaction, we interviewed ten creative experts. Based on our findings, we built VoiceCuts, a prototype implementation of vocal shortcuts in the context of an existing creative application. In contrast to other speech interfaces, VoiceCuts targets experts’ unique needs by handling short and partial commands and leverages document model and application context to disambiguate user utterances. We report on the viability and limitations of our approach based on feedback from creative experts.