You can learn anything on Udemy. Start today with one of our 10,000+ online courses

Practical Statistics for The User Experience I

Are your designs statistically significant? A Practical Online Course for using stats in User Experience (UX)
4 reviews
WHAT'S INSIDE
  • Lifetime access to 18 lectures
  • 7+ hours of high quality content
  • A community of 100+ students learning together!
TAUGHT BY
  • Jeff Sauro Statistical Analyst and Usability Engineer

    Jeff is a Six-Sigma trained statistical analyst and pioneer in quantifying the user experience. He specializes in making statistical concepts understandable and actionable. Jeff has published over fifteen peer-reviewed research articles and presents tutorials and papers regularly at the leading Human Computer Interaction conferences: CHI, UPA and HCII and HFES. He is author of four books including: Quantifying the User Experience: Practical Statistics for User Research (Morgan Kaufmann).

    He has worked for GE, Intuit, PeopleSoft and Oracle and has consulted with dozens of Fortune 500 companies.


    Jeff received his Masters in Learning, Design and Technology from Stanford University with a concentration in statistical concepts. Prior to Stanford, he received his B.S. in Information Management & Technology and BS in Television, Radio and Film from Syracuse University. While at Syracuse he completed a two-year thesis study on web-usability.

    Jeff is a Six-Sigma trained statistical analyst and pioneer in quantifying the user experience. He specializes in making statistical concepts understandable and actionable. Jeff has published over fifteen peer-reviewed research articles and presents tutorials and papers regularly at the leading Human Computer Interaction conferences: CHI, UPA and HCII and HFES. He is author of the forthcoming book: Quantifying the User Experience: Practical Statistics for User Research (Morgan Kaufman, March 2012).  He has worked for GE, Intuit, PeopleSoft and Oracle and has consulted with dozens of Fortune 500 companies.

    Education
    Jeff received his Masters in Learning, Design and Technology from Stanford University with a concentration in statistical concepts. Prior to Stanford, he received his B.S. in Information Management & Technology and BS in Television, Radio and Film from Syracuse University. While at Syracuse he completed a two-year thesis study on web-usability.
SHARE

Practical Statistics for The User Experience I

Are your designs statistically significant? A Practical Online Course for using stats in User Experience (UX)
4 reviews

Measurement is important but statistics can be intimidating. In this Practical Statistics for User Experience (UX) Course we will present approachable concepts and lots examples for generating statistical solutions to common questions in user research. The presentation includes many graphical representations and a "What test do I use?" decision tree.

Is Design A more usable than Design B? Do more users convert on the new design? Is our Net Promoter Score statistically better than last year?

Learn to use and interpret the right statistical tests on small and large sample user-data using just Excel.  We will cover:

  • Sampling Fundamentals
  • The Normal Distribution
  • Confidence Intervals
  • Comparing Means and Proportions
  • Understanding what statistical test to perform and how to perform it
  • Interpreting p-values
  • Reporting and Explaining Statistical Significance to Stakeholders
  • Making better decsions with data and understanding uncertainty and risk

This course is course number E 60.2 from a comprehensive curriculum on User experience (UX) currently under development at The Online User eXperience Institute (OUXI).

    • Over 18 lectures and 8 hours of content!

CURRICULUM

  • SECTION 1:
    Introduction and a Crash Course in Statistics
  • 1
    Introduction and Foundations
    11:12

    In this lecture we'll cover:

    • Fundamenteal Concepts of Sampling
    • Core UX Metrics
    • Population Parameters and Sample Statistics
    • Why you can use statistics in UX and with small sample sizes
  • 2
    Excel & R Companion to Quantifying the User Experience
    336 pages
    Download a PDF copy of the Book: Excel & R Companion to Quantifying the User Experience ($60 on Amazon) as part of the lecture. We will use sections in this book along with the Excel calculator.
  • 3
    Stats Usability Pak Lite
    1.58 MB

    Included in this course is a lite version of the Usability Statistics Package which will allow you to follow along with the video lectures.

  • 4
    Fundamentals Continued (Includes The Normal Distribution)
    05:23

    We continue to review the normal distribution as a statistical concept, it's properties, the empirical rule and understand how it applies to UX data.

  • SECTION 2:
    Confidence Intervals
  • 5
    How Precise are our Estimates? Confidence Intervals in User Research
    10:03

    Reviews the normal distribution and introduces the concept of confidence intervals.

    Confidence intervals tell us the plausible range of the unknown user population average or proportion we estimate from our sample data. We can use confidence intervals on small and large sample sizes. 

  • 6
    Confidence Interval Explanation and Examples
    13:01

    We continue to work through the concept of confidence intervals and calculate them using an Excel calculator. The lecture points to parts in the companion book (available for free with this course) that provides more practice and how to use the R statistics package.

  • 7
    Confidence Interval Practice Exercises
    13:21

    More practice with confidence intervals and generating confidence intervals around binary (yes/no) data. We review a method called the Adjusted-Wald interval which generates accurante intervals even for very small sample sizes.

  • 8
    Confidence Interval Practice Exercises 2
    06:36

    Probably one of the most useful things you can compute is the binomial confidence interval. We get plenty of practice computing this. You can use the free online calculator at http://www.measuringusability.com/wald.htm to get the same results as the Excel Calculator.

  • 9
    Confidence Intervals for Task Time Data
    17:11

    Task time tends to be positively skewed and requires special treatment to generate more accurate confidence intervals. We will cover the log-transformation, the geometric mean and how to report time-on-task averages.

  • 10
    Confidence Interval Practice Exercises 3 & Review
    07:52

    We will review the concept of confidence intervals, 10 Things you need to remember about them and do a few more practice exercies to get you comfortable with this valuable method.

  • SECTION 3:
    Comparing Two Means or Proportions
  • 11
    Is there are Statistical Difference? Comparing Two Means or Proportions
    08:41

    This is where the rubber meets the road.  In this lecture we introduce you to the concept of how sample means fluctuate and how we are able to determine if the difference between means or proportions are statistically significant.


    The lecture includes detailed animation and minimal formuals so you can grasp the important concept of hypothesis testing and the central limit theorem as applied to comparing two means.

  • 12
    Hypothesis Testing and the p-value
    08:20

    We cover:

    p-values

    Null Hypothesis

    Rejecting the Null

    Understanding the sort of backward thinking of Null Hypothesis Statistics Testing (NHST)

  • 13
    Confidence Interval Around the Difference Between Means
    03:43

    Just because there is a statistical difference doesn't mean the difference is always meaningful. We revisit our friend the confidence interval to understand how large of a difference we can excpect with our sample size.

  • 14
    Comparing Two Means Practice Exercise 1
    09:46

    Practice comparing two means in the Excel Calculator.

  • 15
    Comparing Two Means Practice Exercise 2
    09:44

    More practice comparing two means using the Excel calculator and interpreting p-values, confidence intervals and statistical significance.

    Free online calculators are also available:

    http://www.usablestats.com/calcs/2samplet
    http://www.measuringusability.com/ab-calc.php

  • 16
    Comparing Two Proportions (A/B Testing)
    11:35

    A very common calculation is comparing two binary variables: convert/didn't convert, purchase/didn't purchase and is used in A/B testing.  We show how this works for small and large sample sizes and how to interpret the results.

    Free online calculators are also available :

    http://www.measuringusability.com/ab-calc.php

  • 17
    Hypothesis Testing Review
    05:22

    A review of the hypothesis testing framework:

    Type I and Type II errors

    Rejecting and Failing to Reject the Null Hypothesis

  • 18
    Concluding Remarks and Resources
    01:06

    Some final thoughts and where to get more information and resources to help make better decisions with data.


    Go to MeasuringUsability.com and contact Jeff Sauro with any questions.

RATING

  • 2
  • 2
  • 0
  • 0
  • 0
AVERAGE RATING
NUMBER OF RATINGS
4

REVIEWS

  • Dawn
    Great digital companion to the books

    Being a former designer, I found the books alone to be a little complicated to follow since I don't have a statistics background. Sauro's great presentation and speaking style really helped me understand the theories without feeling like I was in over my head and he has a great sense of humor. My greatest challenge would be explaining the theories and hypothesis to others as well as Sauro does!

  • Dr. Diane Hamilton
    Very Helpful

    I enjoyed this course very much. The instructor was funny and made statistics very enjoyable. I only took off one star because I need to know some information that was not covered here.

  • 30 day money back guarantee!
  • Lifetime Access. No Limits!
  • Mobile Accessibility
  • Certificate of Completion