Practical Statistics for The User Experience I
4.5 (103 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
4,141 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Practical Statistics for The User Experience I to your Wishlist.

Add to Wishlist

Practical Statistics for The User Experience I

Are your designs statistically significant? A Practical Online Course for using stats in User Experience (UX)
4.5 (103 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
4,141 students enrolled
Created by Jeff Sauro
Published 5/2012
English
English [Auto-generated]
Current price: $10 Original price: $175 Discount: 94% off
5 hours left at this price!
30-Day Money-Back Guarantee
Includes:
  • 2.5 hours on-demand video
  • 1 Supplemental Resource
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Description

Measurement is important but statistics can be intimidating. In this Practical Statistics for User Experience (UX) Course we will present approachable concepts and lots examples for generating statistical solutions to common questions in user research. The presentation includes many graphical representations and a "What test do I use?" decision tree.

Is Design A more usable than Design B? Do more users convert on the new design? Is our Net Promoter Score statistically better than last year?

Learn to use and interpret the right statistical tests on small and large sample user-data using just Excel.  We will cover:

  • Sampling Fundamentals
  • The Normal Distribution
  • Confidence Intervals
  • Comparing Means and Proportions
  • Understanding what statistical test to perform and how to perform it
  • Interpreting p-values
  • Reporting and Explaining Statistical Significance to Stakeholders
  • Making better decsions with data and understanding uncertainty and risk

This course is course number E 60.2 from a comprehensive curriculum on User experience (UX) currently under development at The Online User eXperience Institute (OUXI).

Compare to Other User Experience Design Courses
Curriculum For This Course
18 Lectures
07:58:56
+
Introduction and a Crash Course in Statistics
4 Lectures 16:35

In this lecture we'll cover:

  • Fundamenteal Concepts of Sampling
  • Core UX Metrics
  • Population Parameters and Sample Statistics
  • Why you can use statistics in UX and with small sample sizes
Preview 11:12

Download a PDF copy of the Book: Excel & R Companion to Quantifying the User Experience ($60 on Amazon) as part of the lecture. We will use sections in this book along with the Excel calculator.
Excel & R Companion to Quantifying the User Experience
336 pages

Included in this course is a lite version of the Usability Statistics Package which will allow you to follow along with the video lectures.

Stats Usability Pak Lite
1.7 MB

We continue to review the normal distribution as a statistical concept, it's properties, the empirical rule and understand how it applies to UX data.

Fundamentals Continued (Includes The Normal Distribution)
05:23
+
Confidence Intervals
6 Lectures 01:08:04

Reviews the normal distribution and introduces the concept of confidence intervals.

Confidence intervals tell us the plausible range of the unknown user population average or proportion we estimate from our sample data. We can use confidence intervals on small and large sample sizes. 

How Precise are our Estimates? Confidence Intervals in User Research
10:03

We continue to work through the concept of confidence intervals and calculate them using an Excel calculator. The lecture points to parts in the companion book (available for free with this course) that provides more practice and how to use the R statistics package.

Confidence Interval Explanation and Examples
13:01

More practice with confidence intervals and generating confidence intervals around binary (yes/no) data. We review a method called the Adjusted-Wald interval which generates accurante intervals even for very small sample sizes.

Confidence Interval Practice Exercises
13:21

Probably one of the most useful things you can compute is the binomial confidence interval. We get plenty of practice computing this. You can use the free online calculator at http://www.measuringusability.com/wald.htm to get the same results as the Excel Calculator.

Confidence Interval Practice Exercises 2
06:36

Task time tends to be positively skewed and requires special treatment to generate more accurate confidence intervals. We will cover the log-transformation, the geometric mean and how to report time-on-task averages.

Confidence Intervals for Task Time Data
17:11

We will review the concept of confidence intervals, 10 Things you need to remember about them and do a few more practice exercies to get you comfortable with this valuable method.

Confidence Interval Practice Exercises 3 & Review
07:52
+
Comparing Two Means or Proportions
8 Lectures 58:17

This is where the rubber meets the road.  In this lecture we introduce you to the concept of how sample means fluctuate and how we are able to determine if the difference between means or proportions are statistically significant.


The lecture includes detailed animation and minimal formuals so you can grasp the important concept of hypothesis testing and the central limit theorem as applied to comparing two means.

Is there are Statistical Difference? Comparing Two Means or Proportions
08:41

We cover:

p-values

Null Hypothesis

Rejecting the Null

Understanding the sort of backward thinking of Null Hypothesis Statistics Testing (NHST)

Hypothesis Testing and the p-value
08:20

Just because there is a statistical difference doesn't mean the difference is always meaningful. We revisit our friend the confidence interval to understand how large of a difference we can excpect with our sample size.

Confidence Interval Around the Difference Between Means
03:43

Practice comparing two means in the Excel Calculator.

Comparing Two Means Practice Exercise 1
09:46

More practice comparing two means using the Excel calculator and interpreting p-values, confidence intervals and statistical significance.

Free online calculators are also available:

http://www.usablestats.com/calcs/2samplet
http://www.measuringusability.com/ab-calc.php

Comparing Two Means Practice Exercise 2
09:44

A very common calculation is comparing two binary variables: convert/didn't convert, purchase/didn't purchase and is used in A/B testing.  We show how this works for small and large sample sizes and how to interpret the results.

Free online calculators are also available :

http://www.measuringusability.com/ab-calc.php

Comparing Two Proportions (A/B Testing)
11:35

A review of the hypothesis testing framework:

Type I and Type II errors

Rejecting and Failing to Reject the Null Hypothesis

Hypothesis Testing Review
05:22

Some final thoughts and where to get more information and resources to help make better decisions with data.


Go to MeasuringUsability.com and contact Jeff Sauro with any questions.

Concluding Remarks and Resources
01:06
About the Instructor
Jeff Sauro
4.5 Average rating
103 Reviews
4,141 Students
1 Course
Statistical Analyst and Usability Engineer

Jeff is a Six-Sigma trained statistical analyst and pioneer in quantifying the user experience. He specializes in making statistical concepts understandable and actionable. Jeff has published over fifteen peer-reviewed research articles and presents tutorials and papers regularly at the leading Human Computer Interaction conferences: CHI, UPA and HCII and HFES. He is author of four books including: Quantifying the User Experience: Practical Statistics for User Research (Morgan Kaufmann).

He has worked for GE, Intuit, PeopleSoft and Oracle and has consulted with dozens of Fortune 500 companies.


Jeff received his Masters in Learning, Design and Technology from Stanford University with a concentration in statistical concepts. Prior to Stanford, he received his B.S. in Information Management & Technology and BS in Television, Radio and Film from Syracuse University. While at Syracuse he completed a two-year thesis study on web-usability.

Jeff is a Six-Sigma trained statistical analyst and pioneer in quantifying the user experience. He specializes in making statistical concepts understandable and actionable. Jeff has published over fifteen peer-reviewed research articles and presents tutorials and papers regularly at the leading Human Computer Interaction conferences: CHI, UPA and HCII and HFES. He is author of the forthcoming book: Quantifying the User Experience: Practical Statistics for User Research (Morgan Kaufman, March 2012).  He has worked for GE, Intuit, PeopleSoft and Oracle and has consulted with dozens of Fortune 500 companies.

Education
Jeff received his Masters in Learning, Design and Technology from Stanford University with a concentration in statistical concepts. Prior to Stanford, he received his B.S. in Information Management & Technology and BS in Television, Radio and Film from Syracuse University. While at Syracuse he completed a two-year thesis study on web-usability.