Build a Data Analysis Library from Scratch in Python
What you'll learn
- Build a fully-functioning Python library similar to pandas that you can use to do data analysis
- Complete a large, comprehensive project
- Test-driven development with pytest
- Environment creation with conda
- Advanced Python topics such as special methods and property decorators
Course content
- Preview09:38
- Preview13:51
- 02:36Downloading the Material from GitHub
Requirements
- Students must know the fundamentals of Python. This is an intermediate/advanced course.
- Must feel comfortable using and iterating through lists, tuples, sets, and dictionaries
- Exposure to numpy and pandas is helpful
Description
Build a Data a Data Analysis Library from Scratch in Python targets those that have a desire to immerse themselves in a single, long, and comprehensive project that covers several advanced Python concepts. By the end of the project you will have built a fully-functioning Python library that is able to complete many common data analysis tasks. The library will be titled Pandas Cub and have similar functionality to the popular pandas library.
This course focuses on developing software within the massive ecosystem of tools available in Python. There are 40 detailed steps that you must complete in order to finish the project. During each step, you will be tasked with writing some code that adds functionality to the library. In order to complete each step, you must pass the unit-tests that have already been written. Once you pass all the unit tests, the project is complete. The nearly 100 unit tests give you immediate feedback on whether or not your code completes the steps correctly.
There are many important concepts that you will learn while building Pandas Cub.
Creating a development environment with conda
Using test-driven development to ensure code quality
Using the Python data model to allow your objects to work seamlessly with builtin Python functions and operators
Build a DataFrame class with the following functionality:
Select subsets of data with the brackets operator
Aggregation methods - sum, min, max, mean, median, etc...
Non-aggregation methods such as isna, unique, rename, drop
Group by one or two columns to create pivot tables
Specific methods for handling string columns
Read in data from a comma-separated value file
A nicely formatted display of the DataFrame in the notebook
It is my experience that many people will learn just enough of a programming language like Python to complete basic tasks, but will not possess the skills to complete larger projects or build entire libraries. This course intends to provide a means for students looking for a challenging and exciting project that will take serious effort and a long time to complete.
This course is taught by expert instructor Ted Petrou, author of Pandas Cookbook, Master Data Analysis with Python, and Exercise Python.
Who this course is for:
- Students who understand the fundamentals of Python and are looking for a longer more comprehensive project covering advanced topics that they can immerse themselves in.
Featured review
![Sanny Kumar](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
Instructor
- 4.6 Instructor Rating
- 1,189 Reviews
- 37,348 Students
- 3 Courses
I am the author of Pandas Cookbook, a highly rated text on performing real-world data analysis with Pandas. I am also the author of the books Exercise Python and Master Data Analysis with Python.
I am the founder of Dunder Data, a company that teaches the fundamentals of data science and machine learning. I really enjoy discovering best practices on how to use and teach data analysis with Python.