Learn Web Scraping with Node.js
3.8 (144 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
16,782 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Learn Web Scraping with Node.js to your Wishlist.

Add to Wishlist

Learn Web Scraping with Node.js

Use the Node modules Request and Cheerio to scrape data and display on a web page.
3.8 (144 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
16,782 students enrolled
Created by Patrick Schroeder
Last updated 5/2017
English
Curiosity Sale
Current price: $10 Original price: $75 Discount: 87% off
30-Day Money-Back Guarantee
Includes:
  • 1 hour on-demand video
  • 6 Supplemental Resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • Scrape Data from Web Pages
  • Display Data using Swig and Angular
  • Use Request and Cheerio
View Curriculum
Requirements
  • Basics of Node.js
Description
In this course you will learn how to scrape data from web pages using the Request and Cheerio node modules.
  • We'll begin with an overview of how Request works to download pages and pipe out data.
  • Next, we'll look at the Cheerio and how we can use jQuery-like syntax to retrieve elements off a page.
  • Then we'll take what you've learned to create 2 sample web apps to scrape and display data first to our console then to a web page.


What You Will Learn:

- How to download web pages using Request.

- How to then grab elements from the page using Cheerio

- Display the data on a web page. First, we'll use Express and Swig to display Indeed job search data. Then we'll use Angular to show an image and other details after a user inputs a URL.


Who This Course is For:

- Anyone with an interest in web scraping using Node. This is a beginner level course, so the only requirement is that you already have node.js installed.

Who is the target audience?
  • You should already somewhat familiar with Node.js. We're using express.js to set up our server and create a few routes. So some prior in experience is helpful.
Students Who Viewed This Course Also Viewed
Curriculum For This Course
10 Lectures
01:07:53
+
Introduction
1 Lecture 01:08
+
Request
2 Lectures 07:10

Learn what Request is and setup our Express.js server.

Preview 03:01

Work through 3 examples using google.com to better understand Request. We'll use the fs module along with request to download and save webpages.

Preview 04:09
+
Cheerio
4 Lectures 24:16

An introduction to the Cheerio NPM module.

Cheerio Intro
00:43

In this video we’ll see how we can use to cheerio to grab elements off a webpage and then display them in our console.  We'll be using indeed.com and selecting job results.

Preview 08:46

In this video we'll scrape an Imgur image. We will do our scraping in a separate scraper.js file and see how to access the scraped data using a callback. 

Cheerio with Imgur - Part 1
07:59

Finish our scraping example then refactor this code from a callback into a Promise.

Cheerio with Imgur - Part 2
06:48
+
Examples
3 Lectures 35:19

Scrape Indeed data + Display on a web page. We'll be using Express and Swig in addition to request and cheerio in this project.

Indeed
08:16

Submit a URL and scrape Pinterest to display desired data to web page.

Angular App Part 1
10:10

Finishing up our example app.

Angular App Part 2
16:53
About the Instructor
Patrick Schroeder
4.2 Average rating
6,513 Reviews
99,410 Students
9 Courses
Software Developer

Patrick Schroeder is a self-taught full stack JavaScript developer. He enjoys working with Angular, Node.js, Mongodb, React.js, Firebase, and anything else javascript related. Patrick is passionate about teaching Javascript. He loves to help others understand difficult concepts by creating clear presentations that gradually builds to full comprehension of a given topic. He is very interested in furthering his knowledge of IOT and wearable products with the intention of teaching cutting edge technologies and collaborating to bring new products to life.