Design
User Experience
Statistics
Practical Statistics for The User Experience I
3.9 (229 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
4,868 students enrolled

Practical Statistics for The User Experience I

Are your designs statistically significant? A Practical Online Course for using stats in User Experience (UX)
3.9 (229 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
4,868 students enrolled
Created by Jeff Sauro
Published 5/2012
English
English [Auto]
Preview this course
Practical Statistics for The User Experience I
Current price: $121.99 Original price: $174.99 Discount: 30% off
5 hours left at this price!
Buy now
30-Day Money-Back Guarantee
This course includes
  • 2.5 hours on-demand video
  • 2 downloadable resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
Description

Measurement is important but statistics can be intimidating. In this Practical Statistics for User Experience (UX) Course we will present approachable concepts and lots examples for generating statistical solutions to common questions in user research. The presentation includes many graphical representations and a "What test do I use?" decision tree.

Is Design A more usable than Design B? Do more users convert on the new design? Is our Net Promoter Score statistically better than last year?

Learn to use and interpret the right statistical tests on small and large sample user-data using just Excel.  We will cover:

  • Sampling Fundamentals
  • The Normal Distribution
  • Confidence Intervals
  • Comparing Means and Proportions
  • Understanding what statistical test to perform and how to perform it
  • Interpreting p-values
  • Reporting and Explaining Statistical Significance to Stakeholders
  • Making better decsions with data and understanding uncertainty and risk

This course is course number E 60.2 from a comprehensive curriculum on User experience (UX) currently under development at The Online User eXperience Institute (OUXI).

Course content
Expand all 18 lectures 07:58:56
+ – Introduction and a Crash Course in Statistics
4 lectures 16:35

In this lecture we'll cover:

  • Fundamenteal Concepts of Sampling
  • Core UX Metrics
  • Population Parameters and Sample Statistics
  • Why you can use statistics in UX and with small sample sizes
Introduction and Foundations
Preview 11:12
Download a PDF copy of the Book: Excel & R Companion to Quantifying the User Experience ($60 on Amazon) as part of the lecture. We will use sections in this book along with the Excel calculator.
Excel & R Companion to Quantifying the User Experience
336 pages

Included in this course is a lite version of the Usability Statistics Package which will allow you to follow along with the video lectures.

Stats Usability Pak Lite
1.7 MB

We continue to review the normal distribution as a statistical concept, it's properties, the empirical rule and understand how it applies to UX data.

Fundamentals Continued (Includes The Normal Distribution)
05:23
+ – Confidence Intervals
6 lectures 01:08:04

Reviews the normal distribution and introduces the concept of confidence intervals.

Confidence intervals tell us the plausible range of the unknown user population average or proportion we estimate from our sample data. We can use confidence intervals on small and large sample sizes. 

How Precise are our Estimates? Confidence Intervals in User Research
10:03

We continue to work through the concept of confidence intervals and calculate them using an Excel calculator. The lecture points to parts in the companion book (available for free with this course) that provides more practice and how to use the R statistics package.

Confidence Interval Explanation and Examples
13:01

More practice with confidence intervals and generating confidence intervals around binary (yes/no) data. We review a method called the Adjusted-Wald interval which generates accurante intervals even for very small sample sizes.

Confidence Interval Practice Exercises
13:21

Probably one of the most useful things you can compute is the binomial confidence interval. We get plenty of practice computing this. You can use the free online calculator at http://www.measuringusability.com/wald.htm to get the same results as the Excel Calculator.

Confidence Interval Practice Exercises 2
06:36

Task time tends to be positively skewed and requires special treatment to generate more accurate confidence intervals. We will cover the log-transformation, the geometric mean and how to report time-on-task averages.

Confidence Intervals for Task Time Data
17:11

We will review the concept of confidence intervals, 10 Things you need to remember about them and do a few more practice exercies to get you comfortable with this valuable method.

Confidence Interval Practice Exercises 3 & Review
07:52
+ – Comparing Two Means or Proportions
8 lectures 58:17

This is where the rubber meets the road.  In this lecture we introduce you to the concept of how sample means fluctuate and how we are able to determine if the difference between means or proportions are statistically significant.


The lecture includes detailed animation and minimal formuals so you can grasp the important concept of hypothesis testing and the central limit theorem as applied to comparing two means.

Is there are Statistical Difference? Comparing Two Means or Proportions
08:41

We cover:

p-values

Null Hypothesis

Rejecting the Null

Understanding the sort of backward thinking of Null Hypothesis Statistics Testing (NHST)

Hypothesis Testing and the p-value
08:20

Just because there is a statistical difference doesn't mean the difference is always meaningful. We revisit our friend the confidence interval to understand how large of a difference we can excpect with our sample size.

Confidence Interval Around the Difference Between Means
03:43

Practice comparing two means in the Excel Calculator.

Comparing Two Means Practice Exercise 1
09:46

More practice comparing two means using the Excel calculator and interpreting p-values, confidence intervals and statistical significance.

Free online calculators are also available:

http://www.usablestats.com/calcs/2samplet
http://www.measuringusability.com/ab-calc.php

Comparing Two Means Practice Exercise 2
09:44

A very common calculation is comparing two binary variables: convert/didn't convert, purchase/didn't purchase and is used in A/B testing.  We show how this works for small and large sample sizes and how to interpret the results.

Free online calculators are also available :

http://www.measuringusability.com/ab-calc.php

Comparing Two Proportions (A/B Testing)
11:35

A review of the hypothesis testing framework:

Type I and Type II errors

Rejecting and Failing to Reject the Null Hypothesis

Hypothesis Testing Review
05:22

Some final thoughts and where to get more information and resources to help make better decisions with data.


Go to MeasuringUsability.com and contact Jeff Sauro with any questions.

Concluding Remarks and Resources
01:06