Web Scraping Course in Python: BS4, Selenium and Scrapy
What you'll learn
- Learn to scrape website from scratch with Beautiful Soup
- Learn to scrape JavaScript website with Selenium and Scrapy-Splash
- Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)
- Handle pagination with any scraping tool
- 4 web scraping projects (from beginner to advanced projects)
- Store the extracted Data in MongoDb & SQLite3
- Scrape APIs
- Web Scraping best practices
- Scrape infinite scroll websites
- Login to websites using Selenium & Scrapy
Course content
- Preview03:30
- 04:57Installing Python and PyCharm
- 30:31Python Basics for Web Scraping
- 00:16Web Scraping Cheat Sheet for The Course (Don't skip it)
- Preview07:49
- 03:52HTML for Web Scraping: Tree Structure
Requirements
- Basic knowledge in Python
- Internet Access
Description
Have you ever thought about how important is data in our everyday life?
It doesn't matter if you're a data scientist, data analyst, or programmer, getting access to the data you need is important! This is why some of the top Fortune 500 companies such as Walmart, Target, and CNN use web scraping to stay ahead with data. We can say this is one of their best secret weapons.
Welcome to Web Scraping in Python with BeautiuflSoup, Selenium, and Scrapy!
The most complete and project-oriented course. In this course, we're going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. To name a few:
Amazon Audible
Twitter
Google
Football Stats
Worldometers
Movie pages
This is the most complete web scraping course in Python and is split into 3 parts: BeautiuflSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.
Why I built the course this way?
Beautiful Soup has a lot of limitations, but it's still useful for a gentle introduction to web scraping. In contrast, if you learn Selenium you will be able to scrape any website. and if you add Scrapy to your toolkit you will be able to scrape any website faster than with any other web scraping library. Throughout this course, you will see the power of web scraping with each Python library.
What makes this course different from the others, and why you should enroll?
This is the most updated and complete web scraping course in Python. You will be using Python 3.7, Scrapy 2.4, Selenium 3.1 and BS4
This is the most project-based course you will find. We will scrape many of the most well-known websites
You will have an in-depth step by step guide on how to become a professional web scraper.
You will learn how to use Selenium, Scrapy, and Splash to scrape JavaScript-driven websites. You won't find any tutorials out there that teach how to use these web scraping tools the way I do in this course.
30 days money back guarantee by Udemy
At the end of the course, you'll know how to build your own web scraper to obtain new data, learn the best techniques for web scraping and more.
Join me now and let's start scraping the web together!
Who this course is for:
- Anyone who wants to scrape data from any website with Beautiful Soup, Selenium, and Scrapy
- Data Scientists who want to take their skills to the next level
- Web developers looking to obtain new information or automate tasks
- Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task
Instructor
![Frank Andrade](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
- 4.7 Instructor Rating
- 35 Reviews
- 228 Students
- 2 Courses
I'm a data analyst and my passion is teaching. I have done it for many years. I have taught the fundamentals of programming and web scraping to hundreds of people including undergraduates and professionals. Also, I share my knowledge on YouTube and Medium to thousands of people every day.
I'm looking forward to seeing you in my course. I'll be there for you on every step you make and answer any questions you have!