Udemy
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  
Development
Web Development Data Science Mobile Development Programming Languages Game Development Database Design & Development Software Testing Software Engineering Development Tools No-Code Development
Business
Entrepreneurship Communications Management Sales Business Strategy Operations Project Management Business Law Business Analytics & Intelligence Human Resources Industry E-Commerce Media Real Estate Other Business
Finance & Accounting
Accounting & Bookkeeping Compliance Cryptocurrency & Blockchain Economics Finance Finance Cert & Exam Prep Financial Modeling & Analysis Investing & Trading Money Management Tools Taxes Other Finance & Accounting
IT & Software
IT Certification Network & Security Hardware Operating Systems Other IT & Software
Office Productivity
Microsoft Apple Google SAP Oracle Other Office Productivity
Personal Development
Personal Transformation Personal Productivity Leadership Career Development Parenting & Relationships Happiness Esoteric Practices Religion & Spirituality Personal Brand Building Creativity Influence Self Esteem & Confidence Stress Management Memory & Study Skills Motivation Other Personal Development
Design
Web Design Graphic Design & Illustration Design Tools User Experience Design Game Design Design Thinking 3D & Animation Fashion Design Architectural Design Interior Design Other Design
Marketing
Digital Marketing Search Engine Optimization Social Media Marketing Branding Marketing Fundamentals Marketing Analytics & Automation Public Relations Advertising Video & Mobile Marketing Content Marketing Growth Hacking Affiliate Marketing Product Marketing Other Marketing
Lifestyle
Arts & Crafts Beauty & Makeup Esoteric Practices Food & Beverage Gaming Home Improvement Pet Care & Training Travel Other Lifestyle
Photography & Video
Digital Photography Photography Portrait Photography Photography Tools Commercial Photography Video Design Other Photography & Video
Health & Fitness
Fitness General Health Sports Nutrition Yoga Mental Health Dieting Self Defense Safety & First Aid Dance Meditation Other Health & Fitness
Music
Instruments Music Production Music Fundamentals Vocal Music Techniques Music Software Other Music
Teaching & Academics
Engineering Humanities Math Science Online Education Social Science Language Teacher Training Test Prep Other Teaching & Academics
AWS Certification Microsoft Certification AWS Certified Solutions Architect - Associate AWS Certified Cloud Practitioner CompTIA A+ Cisco CCNA Amazon AWS CompTIA Security+ Microsoft AZ-900
Graphic Design Photoshop Adobe Illustrator Drawing Digital Painting InDesign Character Design Canva Figure Drawing
Life Coach Training Neuro-Linguistic Programming Personal Development Mindfulness Personal Transformation Life Purpose Meditation CBT Emotional Intelligence
Web Development JavaScript React CSS Angular PHP Node.Js WordPress Vue JS
Google Flutter Android Development iOS Development React Native Swift Dart Programming Language Mobile Development Kotlin SwiftUI
Digital Marketing Google Ads (Adwords) Social Media Marketing Google Ads (AdWords) Certification Marketing Strategy Internet Marketing YouTube Marketing Email Marketing Retargeting
Microsoft Power BI SQL Tableau Business Analysis Data Modeling Business Intelligence MySQL Data Analysis Blockchain
Business Fundamentals Entrepreneurship Fundamentals Business Strategy Business Plan Startup Online Business Freelancing Blogging Home Business
Unity Game Development Fundamentals Unreal Engine C# 3D Game Development C++ 2D Game Development Unreal Engine Blueprints Blender
30-Day Money-Back Guarantee
Development Programming Languages Python

Data Processing with Python

Learn how to use Python and Pandas for cleaning and reorganizing huge amounts of data.
Rating: 3.9 out of 53.9 (1,553 ratings)
11,508 students
Created by Ardit Sulce
Last updated 10/2019
English
English
30-Day Money-Back Guarantee

What you'll learn

  • Build 10 advanced Python scripts which together make up a data analysis and visualization program.
  • Solve six exercises related to processing, analyzing and visualizing US income data with Python.
  • Learn the fundamental blocks of the Python programming language such as variables, datatypes, loops, conditionals, functions and more.
  • Use Python to batch download files from FTP sites, extract, rename and store remote files locally.
  • Import data into Python for analysis and visualization from various sources such as CSV and delimited TXT files.
  • Keep the data organized inside Python in easily manageable pandas dataframes.
  • Merge large datasets taken from various data file formats.
  • Create pivot tables in Python out of large datasets.
  • Perform various operations among data columns and rows.
  • Query data from Python pandas dataframes.
  • Export data from Python into various formats such as TXT, CSV, Excel, HTML and more.
  • Use Python to perform various visualizations such as time series, plots, heatmaps, and more.
  • Create KML Google Earth files out of CSV files.
Curated for the Udemy for Business collection

Course content

11 sections • 50 lectures • 3h 46m total length

  • Preview08:06
  • Python editors - Spyder and iPython
    03:21

  • Section introduction
    01:34
  • Navigating through FTP directory trees with Python
    07:00
  • Storing Python code
    04:32
  • Creating an FTP function
    02:29
  • Downloading an FTP file
    08:32
  • About the next lecture
    00:27
  • Practice No.1: Creating an FTP File Downloader
    13:42

  • Extracting ZIP, TAR, GZ and other archive file formats
    03:41
  • Extracting RAR files
    01:57
  • Practice No.2: Creating a Batch Archive Extractor
    05:52

  • Section introduction
    01:22
  • Reading delimited TXT and CSV files
    10:06
  • Reading Excel files
    00:16
  • Exporting data from Python to files
    04:14
  • Reading fixed width TXT files
    01:58
  • Exporting data back to HTML and other file formats
    01:02
  • Data Analysis Exercise 1
    01:09
  • Data Analysis Exercise 1: Solution
    00:02

  • Get started with Pandas
    06:16
  • Practice No.3: Calculating and Adding Columns to CSV Files
    04:57
  • Data Analysis Exercise 2
    00:56
  • Data Analysis Exercise 2: Solution
    00:03

  • Practical No.4: Concatenating multiple CSV files
    06:18
  • Data Analysis Exercise 3
    00:40
  • Data Analysis Exercise 3: Solution
    00:38
  • Practice No. 5: Joining Data Based on a Matching Column
    08:59
  • Preview01:30
  • Data Analysis Exercise 4: Solution
    00:21
  • Data Analysis Exercise 5
    01:14
  • Solution: 5 of 6
    00:03

  • Practice No. 6: Pivoting Large Amounts of Data
    07:41

  • Data visualization with Python
    11:31
  • More visualization techniques
    Preview12:23
  • Practice No. 7: Producing Image Files
    03:08
  • Data Analysis Exercise 6
    01:08
  • Data Analysis Exercise 6: Solution
    00:08

  • Programmatically creating KML Google Earth files with Python
    04:37
  • Practice No, 8: Creating KML Google Earth fIles from CSV data
    07:46

  • User interaction
    06:07
  • Exercise: User interaction
    00:39
  • Exercise: User interaction: Solution
    00:20
  • Practice No. 9: Polishing the Program, I
    05:00
  • Practice No. 10: Polishing the Program, II
    05:30
  • Practice No. 11: Creating Python Modules
    05:00

Requirements

  • A working computer (Windows, Mac, or Linux)
  • No prior knowledge of Python is required

Description

Data scientists spend only 20 percent of their time on building machine learning algorithms and 80 percent of their time finding, cleaning, and reorganizing huge amounts of data. That mostly happen because many use graphical tools such as Excel to process their data. However, if you use a programming language such as Python you can drastically reduce the time it takes for processing your data and make them ready for use in your project. This course will show how Python can be used to manage, clean, and organize huge amounts of data.

This course assumes you have basic knowledge of variables, functions, for loops, and conditionals. In the course you will be given access to a million records of raw historical weather data and you will use Python in every single step to deal with that dataset. That includes learning how to use Python to batch download and extract the data files, load thousands of files in Python via pandas, cleaning the data, concatenating and joining data from different sources, converting between fields, aggregating, conditioning, and many more data processing operations. On top of that, you will also learn how to calculate statistics and visualize the final data. The course also covers a series of exercises where you will be given some sample data then practice what you learned by cleaning and reorganizing those data using Python.

Who this course is for:

  • Those who come from any technology field that deals with any kind of data.
  • Those who want to leverage the power of the Python programming language for handling data.
  • Those who need to learn Python basics and want to quickly advance their skills by learning how to perform data cleaning, analysis and visualization with Python - all in one single course.
  • Those who want to switch from programming languages such as Java, C, R, Matlab, etc. to Python.

Instructor

Ardit Sulce
Python Programmer. Founder and Author, PythonHow.
Ardit Sulce
  • 4.6 Instructor Rating
  • 62,145 Reviews
  • 327,674 Students
  • 7 Courses

Hi, I am Ardit! I am a Python programmer and teacher. I graduated in 2013 with a Master of Science in Geospatial Technologies from the University of Muenster in Germany.

I have worked with companies from various countries both as an employee and self-employed using Python together with companies such as the Center for Conservation Geography to map and understand Australian ecosystems, processing orthophotos with the Swiss in-Terra, and performing data mining to gain business insights with the Australian Rapid Intelligence. I am also the founder and author of PythonHow, a Python learning resource designed particularly for people with no previous programming experience.

If you are interested in Python, I would suggest the following roadmap to becoming a Python developer.

Start by taking my course, The Python Mega Course: Build 10 Real World Applications and then take my other course, The  Python Pro Course: Build 10 Real World OOP Programs. Both courses are listed here on my profile page. Both courses are designed around learning Python by practice rather than rote memorization.

The mega course will guide you step by step, starting with Python basics and all the way to building real-world Python programs, including GUIs, web apps, web scrapers, mobile apps, etc. Once you complete that course, take the other one.

The pro course will take you to a new professional level, teaching you Python from a deeper computer science perspective, covering programming logic, and giving you the skills for building complex, professional applications in an object-oriented programming (OOP) style. After you complete the second course, you can practice Python even further by remaking the 10 apps of the first mega course, but this time in OOP style. If you can manage to do that, you will be job-ready.

  • Udemy for Business
  • Teach on Udemy
  • Get the app
  • About us
  • Contact us
  • Careers
  • Blog
  • Help and Support
  • Affiliate
  • Impressum Kontakt
  • Terms
  • Privacy policy
  • Cookie settings
  • Sitemap
  • Featured courses
Udemy
© 2021 Udemy, Inc.