The Complete Web Scraping Course with Projects 2019
4.1 (29 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
9,066 students enrolled

The Complete Web Scraping Course with Projects 2019

Become a Professional Web Scraper | Learn how to scrape websites and obtain useful data by using Selenium and NodeJS
4.1 (29 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
9,066 students enrolled
Created by Jazeb Akram
Last updated 2/2019
English
English [Auto-generated]
Current price: $11.99 Original price: $149.99 Discount: 92% off
1 day left at this price!
30-Day Money-Back Guarantee
This course includes
  • 7.5 hours on-demand video
  • 2 articles
  • 1 downloadable resource
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to Udemy's top 3,000+ courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  •  Understands the basics of NODE JS
  •  Understand the installation and un-installation of node modules

  •  Understand the fundamentals of Web Scrapping

  •  Understand the automation tool Selenium with scrapping
  •  Understand how to locate various elements
  •  Understand how to locate elements with XPATH
  •  Understand the basics of Selenium methods that are necessary for scrapping
  •  Understand different types of Exception in selenium and how to handle them
  •  Store the scrapped data in excel file CSV
  •  Complete Project that will Scrape Google translate website
  •  Complete Project that will Scrape Travel Insurance website
Requirements
  • Basics of HTML
  • Basic Programming Concepts Such as Variable, If Condition, Loop Structure.
  • Basics of JavaScript
  • Node JS version: 10.13.0 (we will install it inside course)
  • Chrome Driver version: 2.43 (we will install it inside course)
Description

Web scraping is the Data Science technique of gathering or storing useful and public information from websites in a suitable format like spreadsheets that can be used later for any purpose. It basically removes the burden of copying the data manually, instead it provides an automated way to do it.

The data extraction is done from websites using some sort of a code written called “scraper” which takes the a Web URL, parses the HTML DOM of that site and then return the result which we can save in some format say CSV for future use. The data that we parse can be in form of texts, images, package names and their corresponding prices, videos and contact information like email, name, phone numbers and so on.

This course is built in NODEJS that is light weight, efficient, and scale-able  due to its non-blocking I/O and event driven. The main advantage of node is that its asynchronous in nature which means that you don’t have to wait for a request to complete before making another one which in turn provides a very high performance. This course is made in so much easy way so that one who doesn’t have any knowledge of NODEJS can easily understand and hence build own scraper in NODEJS.

We are using Selenium which is automation testing tool that provides various elements and methods to interact with HTML DOM in order to parse the website.

This course is divided into 3 parts

  • Setting up the environment

  • Building Blocks and Syntax

  • Projects

In the Project Section course will cover 3 Projects

  1. Google Translate 2018 Project

  2. Google Translate 2019 Project

  3. Travel Insurance Website Project

Bonuses:

  • Reading Data from CSV File

  • How to Save scraped Data into New CSV file

  • How to apply Validations

This course offers you a 30 Days Money Back Guarantee, in case if the course does not meet your expectations you can get a full re-fund immediately . Also i will answer all of your questions on top priority. 

Now if you want to learn Web Scraping by building projects and start your professional career, Take this course now

Note :

  • Basic HTML Knowledge required.

  • Basic Programming Knowledge required.

  • No Knowledge of NodeJS required.

Who this course is for:
  • Data Scientists who want to create their own real world Data Set
  • Anyone who wants to be a professional Web scrapper
  • Anyone who wants to scrape data from any website
  • Anyone who wants to understand the basics of node
  • Anyone who wants to understand how to write XPATH
  • Anyone who wants to interact with HTML DOM
Course content
Expand all 61 lectures 07:29:12
+ Basics of Scraping
11 lectures 01:08:16
Exercise Files | Project Files
00:03
Quitting Browser
03:51
Writing Method
16:11
Exception Handling
14:01
Taking a Live Screen Shot
09:51
Basic Test
3 questions
+ Project (Google Translate 2018)
14 lectures 01:38:47
Getting Language id GT2K18
15:30
Getting Language Related to Array GT2K18
07:00
Creating Language File GT2K18
07:29
Deleting Existing File GT2K18
05:07
Removing Bug and Running the Process in Background GT2K18
06:56
Building Scrape File GT2K18
09:36
Scrape Google Translate Function Part 1 GT2K18
06:50
Scrape Google Translate Function Part 2 GT2K18
14:50
Adding Data to CSV File GT2K18
05:33
Limiting the Characters according to Google GT2K18
05:54
Adding Delays GT2K18
05:34
Final Testing GT2K18
03:41
+ Project (Google Translate 2019)
14 lectures 02:20:41
Google Translate 2019 Preview GT2K19
02:10
Opening Language Box GT2K19
08:02
Getting Class GT2K19
14:40
Getting Language Id GT2K19
10:57
Getting Name GT2K19
18:32
Creating File GT2K19
09:25
Deleting Existing File GT2K19
07:47
Reading Client CSV File GT2K19
09:37
Starting Scrape function GT2K19
07:29
Running Script GT2K19
16:32
Exception Handling GT2K19
10:08
Limiting Translation Content
03:56
Saving Output Data for Client GT2K19
10:06
Adding Delay Factor and Testing GT2K19
11:20
+ Project | Scraping Travel Insurance Website
16 lectures 02:00:31
Understanding Test Cases
05:41
Adding Const and Variables
06:22
Looping Params
04:47
Executing Test Case and Sending it to Index.JS file
11:00
Starting Index File
13:10
Convert Date Function
07:17
Selecting 1st Two Fields
06:05
Trip Duration
09:23
Finishing Current Page
09:19
Compiling Results
13:14
Appending to CSV File
04:36
Debugging
16:42
Final Testing Travel Pro
07:33
Good Bye
00:48
For More
00:38