Udemy
    •  
    •  
    •  
    •  
    •  
    •  
    •  
    •  
Turn what you know into an opportunity and reach millions around the world.
Learn More
Your cart is empty.
Keep shopping
Learn Web Scraping with Python from Scratch
Rating: 4.1 out of 5(2,222 ratings)
52,270 students

Learn Web Scraping with Python from Scratch

Python Web Scraping Tutorial. Use BeautifulSoup & Requests to scrape & crawl Craigslist directory with Python
Last updated 2/2019
English

What you'll learn

  • Installing Python Web Scraping libraries, BeautifulSoup & Requests.
  • Extracting URLs from a webpage.
  • Scraping text data from a webpage.
  • Crawling multiple webpages and scraping data from each of them.
  • Handling navigation links and move to next pages.
  • Saving scraped data into a CSV file with Pandas.
  • Overview about other popular web scraping frameworks.

Course content

3 sections11 lectures31m total length
  • Web Scraping Course Overview1:28
  • Installing BeautifulSoup & Requests0:58

    In this web scraping tutorial, will learn how to install BeautifulSoup and Requests libraries.

  • URL Extraction3:07

    In this web scraping tutorial, will learn how to extract the job URLs from Craigslist.

  • Web Scraping Craigslist - Titles1:51

    In this web scraping tutorial, will learn how to scrape job titles.

  • Web Scraping Craigslist - Job Details Wrapper3:27

    In this web scraping tutorial, will learn how to how to deal with HTML wrappers to be able to extract job details from each job section.

  • Web Scraping Craigslist - Job Description Page2:57

    In this web scraping tutorial, will learn how to follow the job URL, open the job description page and scrape it.

  • Crawling & Scraping Next Pages2:36

    In this web scraping tutorial, will learn how to crawl next pages and scrape all the job lists.

  • Saving Output to CSV File4:22

    In this web scraping tutorial, will learn how to save your scraped output to a CSV file using Pandas.

Requirements

  • Basic knowledge of Python programming

Description

Q. Do you want to extract data from a specific website but it takes a lot of time doing so manually?

A. Web Scraping is the process of automating data extraction from websites.


Q. Do you see many Web Scraping jobs, but you do not feel confident enough to apply?

A. This Web Scraping tutorial will teach you how web scrape a real-life project from a to z.


When the webpage structure is so complicated, making it difficult to extract specific pieces of data, or when you need to open so many pages to extract data from each of them, the manual process can become boring and time-wasting, and that is when automated Web Scraping can make the process more efficient and effective.


In this Web Scraping tutorial:

  • Grasp Python Web Scraping fundamentals.

  • Use BeautifulSoup & Requests to scrape & crawl Craigslist with Python

  • Learn how to save your scraped output to a CSV / Excel file.

  • Understand the difference between Web Scraping Python libraries and frameworks.


So let's start your Web Scraping real-life project.



Who this course is for:

  • Python developers and students who are new to Web Scraping