Web Crawling with Nodejs (H&M, Amazon, LinkedIn, AliExpress)
What you'll learn
- Differences between web crawling and web scraping in Nodejs
- The 3 main methods to use in web crawling, and when to use what method!
- How to get data from sites like H&M and AliExpress easily and fast using their hidden API's
- How to build a web crawler for server rendered sites like Amazon to crawl all their products
Do you want to build a webcrawler in Nodejs?
You'll learn how to find hidden API's on sites like H&M and AliExpress and see how you can even avoid building a web crawler in the first place, you can save a lot of time this way!
Then I show how to build a web crawler for Amazon the test-driven way, by building out tests for the various product page layouts there is on Amazon.
After that we'll take a look at how to automate login and scraping profiles from LinkedIn using Puppeteer, the automated Chromium browser!
Who this course is for:
- Students looking to learn web crawling with Nodejs
- Students looking to learn web scraping with Nodejs