Some Prior(s) Experience Necessary

Chanda Phelan, Jessica Hullman, Matthew Kay, Paul Resnick

ACM CHI 2019

bayesian_phelan

Work of of the code templates we created to help HCI researchers conduct a Bayesian statistical analysis. Sections that require user input are bolded.

Abstract

Bayesian statistical analysis has gained attention in recent years, including in HCI. The Bayesian approach has several advantages over traditional statistics, including producing results with more intuitive interpretations. Despite growing interest, few papers in CHI use Bayesian analysis. Existing tools to learn Bayesian statistics require signi cant time in- vestment, making it di cult to casually explore Bayesian methods. Here, we present a tool that lowers the barrier to exploration: a set of R code templates that guide Bayesian novices through their rst analysis. The templates are tai- lored to CHI, supporting analyses found to be most common in recent CHI papers. In a user study, we found that the tem- plates were easy to understand and use. However, we found that participants without a statistical background were not con dent in their use. Together our contributions provide a concise analysis tool and empirical results for understanding and addressing barriers to using Bayesian analysis in HCI.