Web scraping: doing 20 real web scraping projects
4.2 (81 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
778 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Web scraping: doing 20 real web scraping projects to your Wishlist.

Add to Wishlist

Web scraping: doing 20 real web scraping projects

Master web scraping python in just 2 hours, most practical python web scraping course
4.2 (81 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
778 students enrolled
Created by Tan Pham
Last updated 9/2016
English
Curiosity Sale
Current price: $10 Original price: $25 Discount: 60% off
30-Day Money-Back Guarantee
Includes:
  • 4 hours on-demand video
  • 37 Supplemental Resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • Understanding in deep how data web scraping work
  • Get real skill by doing 20 real life project
View Curriculum
Requirements
  • All students are well come to go with this course if they have interested and web data scraping
  • This course is explain from beginning so it suit for all level
Description

What special about this course ?

  • This is only course on market provide you 20 real life web scraping data projects, all of these projects coding with Python programming language
  • Practical approach, learning by doing, you will learn to coding python language with 20 real life web scraping projects, 
  • Step by step method, from understand big picture to understand each step, and finally apply skill to solve problem.
  • All web scraping projects source codes are provide for reference.
  • Love to do web scraping ?


What you will get from this course ?

  • Understand indeed how web scraping work.
  • Hand - on experience by doing 20 real life web scraping projects.
  • Hand - on experience working with Sublime Text, one very cool IDE to working with python
  • Love to do web scraping ?

 

Course summary

 This course teach you step by step, from simple example to real life web scraping project.

  •  Introduce with you what is web scraping and why we need web scraping. The big picture of web scraping or 4 steps to do web scraping.  And then  we will install all kind of tools which be used in next sections.
  • Step 1 in 4 steps to do web scrape, we do inspecting web page and locating data between HTML source.
  • Step 2 in 4 steps, we do download HTML content.
  • Step 3 in 4 steps, we do  create Beautiful Soup object and search for tags contain Information.
  • Step 4 in 4 steps, we do scrape data from tags.
  • Finally we do 20 hand-on web scraping project to collect data from Amazon, Linkedin, Airbnb, Nba, Imbd.
  • Love to do web scraping ?

Why web scraping is important ?

Most important data on the web do not available from API. Could you get the product data from Amazon with API ? Could you get housing data from Airbnb ?. Of course not. So the only way to collect these kind of data is using web scraping. Have data mean have power, you are having that power. Well come to my course on web scraping.


-------->>>  Take this course and get any data you want from the web automatically <<<--------

Who is the target audience?
  • This course is present step by step and from simple to more complicate so it is suit for all people
  • All steps are explain carefully with intent to make every one can understand
Students Who Viewed This Course Also Viewed
Curriculum For This Course
53 Lectures
04:05:40
+
Web Scraping Introduction and installation
6 Lectures 18:26

First introduction about web scrape and do the first demo for student

Preview 02:16

Describe overall about 4 steps to do web scraping

Preview 01:48

Practical steps to install python from anaconda distribution

Install python and other packages with anaconda
03:01

Practical steps to install text editor sublime text

Install sublime text - IDE for python development
02:14

Practical steps to install :

- package control

- anaconda package

- build view package

for sublime text

Install support packages for sublime text
06:16

Demo coding with python from Sublime Text

- Create new python file

- Print 'hello world'

- Run python file

Working with Sublime Text
02:51
+
Step 1 : Inspecting Web Page and Locating Data between HTML Source
3 Lectures 11:16

Describe about Chrome inspection tool

Inspecting tool introduction
03:30

Use chrome inspection tool to inspecting NBA site

Example with inspecting NBA player page
03:21

Use chrome inspection tool to inspecting IMDB site

Example with inspecting IMDB poster page
04:25
+
Step 2 : Download HTML Content
2 Lectures 09:47

Install chrome driver and using selenium combine with chromdriver to download html page source

Download HTML use selenium with chrome driver
06:17

Install phantomjs driver and using selenium combine with phantomjs to download html page source

Download HTML use selenium in headless mode with phantomjs driver
03:30
+
Step 3 : Create Beautiful Soup Object and Search for Tags Contain Information
8 Lectures 27:25

Introduction about Beautiful Soup and the way to create Beautiful Soup object from python code

Introduction about Beautiful Soup and create soup object
04:18

Using Beautiful Soup to search for first tag by name

Search for first tag by name
02:52

Using Beautiful Soup to search for all tags by name

Search for all tags by name
03:05

Use Beautiful Soup to search for tag name combine with class name condition

Search with tag name and class attribute
03:52

Use Beautiful Soup to search for tag name combine with other attribute, example : id

Search with tag name and other attributes
01:31

Use Beautiful Soup to search for tag name combine with string inside the tag

Search with tag name and string inside tag
01:57

Travel inside HTML tree structure by search for parent, child or sibling tag

Search parent, child, sibling tag
07:18

Explain search scope in Beautiful Soup

Search scope in Beautiful Soup object
02:32
+
Step 4 : Scrape Data From Tags
3 Lectures 07:44

Explain practical way to get text data inside tag

Scrape for text data
02:07

Explain practical way to get link data inside tag

Scrape for link (href attribute)
02:11

Explain practical way to get data inside table

Scrape data inside table
03:26
+
Hand on with NBA projects
7 Lectures 53:53

From players page, scrape all players name

Project 1 scrape name of all basketball player
07:40

From players page, scrape all players name and detail link of each player

Project 2 get players name and detail link of each and put result to a list
07:14

From player detail page,scrape player information

Project3 Part1 get detail information for one player
09:03

Scrape detail information of all player

Project3 Part2 get detail information for all player
08:59

Scrape image for one player from player detail page

Project4 part1 get image for one player
09:40

For each player, scrape one official image

Project 4 part 2 get image for all players
09:31

Form couch list page, scrape all couch name

Project 5 Get list of all couch (exercise)
01:46
+
Hand on with IMDB projects
7 Lectures 43:41
Project1 part1 scrape list of best films ever as text
07:13

Project1 part2 scrape list of best film ever with link to detail
10:59

Project2 part1 scrape poster get link contain full size poster
07:42

Project2 part2 scrape poster image for one film
07:21


Project3 scrape all poster (exercise)
02:15

Project 4 and 5 scrape list of current popular film and all poster (exercise)
01:49
+
Hand on with AIRBNB projects
3 Lectures 19:23
Project1 part1 get list of room available in one page, inspect strategy
08:39

Project1 part2 get list of room available on onepage
09:54

Project 2 get list of room available on NY - allpage (exercise)
00:50
+
Hand on with AMAZON projects
8 Lectures 32:57


Project2 part1 scrape detail information for one book, inspect strategy
03:26

Project2 part2 scrape detail information for one book, coding
05:49

Project2 part3 scrape detail information for a book list, coding
05:14

Project 3 scrape most value comment (exercise )
01:01

Project 4 scrape recently review for specific product (exercise)
00:36

Project 5 get list name of 100 best seller book (exercise )
01:11
+
Hand on with LINKEDIN projects
6 Lectures 21:08
Project1 part1 get list of people with specific skill, intro
02:23

Project1 part2 get list of people with specific skill, login script
06:16

Project1 part3 get list of people with specific skill, search script
04:35

Project1 part4 get list of people with specific skill, scrape link
06:15

Project 2 expand project 1 in to 10 page search (exercise)
00:37

Project 3 get name and skill on one publish profile (exercise)
01:02
About the Instructor
Tan Pham
4.0 Average rating
490 Reviews
13,622 Students
6 Courses
Software Engineer

I working on field of Data science and DevOpt for 10 years. And I very interest to share with you all of my knowledge combine with skill with you. Nearly 12.000 happy student enroll my courses and continue to increase.

My passion is about sharing what I do know in technology to every people want to learn. With me you will learn technology in new style:

* All courses are hand-on and practical with real life demo project.

* Clear with step by step explanation.