Your cart is empty.
Keep shoppingWeb Scraping in Python Selenium, Scrapy + ChatGPT Prize
Bestseller
Highest Rated
16,541 students
Web Scraping in Python Selenium, Scrapy + ChatGPT Prize
4 projects with Beautiful Soup, Selenium and Scrapy | ChatGPT for web scraping
Created byFrank Andrade
Last updated 11/2025
English
What you'll learn
- Learn to scrape website from scratch with Beautiful Soup
- Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)
- How to use ChatGPT for web scraping
- 4 web scraping projects (from beginner to advanced projects)
- Handle pagination with any scraping tool
- Learn to scrape JavaScript website with Selenium and Scrapy-Splash
- Store the extracted Data in MongoDb & SQLite3
- Scrape infinite scroll websites
- Login to websites using Selenium & Scrapy
Explore related topics
Course content
17 sections • 95 lectures • 10h 47m total length
Requirements
- Basic knowledge in Python
- Internet Access
Description
Have you ever thought about how important is data in our everyday life?
It doesn't matter if you're a data scientist, data analyst, or programmer, getting access to the data you need is important! This is why some of the top Fortune 500 companies such as Walmart, Target, and CNN use web scraping to stay ahead with data. We can say this is one of their best secret weapons.
Welcome to Web Scraping in Python with BeautiuflSoup, Selenium, and Scrapy!
The most complete and project-oriented course. In this course, we're going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. To name a few:
Amazon Audible
Twitter
Google
Football Stats
Worldometers
Movie pages
This is the most complete web scraping course in Python and is split into 3 parts: BeautiuflSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.
Why I built the course this way?
Beautiful Soup has a lot of limitations, but it's still useful for a gentle introduction to web scraping. In contrast, if you learn Selenium you will be able to scrape any website. and if you add Scrapy to your toolkit you will be able to scrape any website faster than with any other web scraping library. Throughout this course, you will see the power of web scraping with each Python library.
What makes this course different from the others, and why you should enroll?
This is the most updated and complete web scraping course in Python. You will be using Python 3.7, Scrapy 2.4, Selenium 3.141.0 and BS4
This is the most project-based course you will find. We will scrape many of the most well-known websites
You will have an in-depth step by step guide on how to become a professional web scraper.
You will learn how to use Selenium, Scrapy, and Splash to scrape JavaScript-driven websites. You won't find any tutorials out there that teach how to use these web scraping tools the way I do in this course.
You will learn how to use ChatGPT for web scraping
30 days money back guarantee by Udemy
At the end of the course, you'll know how to build your own web scraper to obtain new data, learn the best techniques for web scraping and more.
Join me now and let's start scraping the web together!
Who this course is for:
- Anyone who wants to scrape data from any website with Beautiful Soup, Selenium, and Scrapy
- Data Scientists who want to take their skills to the next level
- Web developers looking to obtain new information or automate tasks
- Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task