
Here's how to install Python
Learn to fetch a web page's HTML in Python using requests and BeautifulSoup, inspect the page, and parse with lxml to prepare data for scraping.
Learn to use BeautifulSoup's find function for web scraping to filter HTML by tag and attributes, extract headers and prices, and understand when to use find_all for multiple matches.
Master web scraping in Python with BeautifulSoup and Selenium to extract stock data—price, closing price, 52-week range, and analyst rating—using nested HTML techniques in hands-on coding exercises.
Learn how to locate a specific table in a web page’s HTML using BeautifulSoup, extract column headers from th tags, and create a data frame using those headers.
Learn to scrape a web page with Python using requests and BeautifulSoup to extract a table by its summary attribute, parse headers and rows, and build a pandas dataframe.
Learn to scrape airbnb.com using Python with BeautifulSoup and Selenium, analyzing code to extract title, price, and description while adapting to site updates and avoiding copied code.
Learn how JavaScript driven websites defy simple scraping with requests and BeautifulSoup and why Selenium is needed to load dynamic content, click buttons, and extract shoe names and prices.
Discover how to use selenium's web driver to load pages, view html, and locate elements by id, name, tag, and xpath, enabling visual web scraping with driver.get and chrome driver.
Learn how to use XPath to locate web elements with Selenium, extract prices and titles, and click the see more button by building robust path expressions.
Learn to use selenium to click buttons on web pages for web scraping by locating elements with XPath, then drive navigation from a Google search to Wikipedia pages.
Demonstrates building a Selenium web scraping workflow to search Google, open IMDb, and capture page and poster screenshots. Applies input handling, XPath selection, waits, and scrolling.
Combine selenium-driven infinite scrolling with BeautifulSoup to extract product details from a page. Build a dataframe of links, names, subtitles, full price, and sale price with basic error handling.
Master scraping all outerwear products from Union Los Angeles using infinite scrolling, extract link, name, and price, then compile a table and identify the most expensive item.
Leverage selenium to search Twitter by locating the search box with xpath, sending keys the celebrity name, and pressing enter, then navigate to the people tab and open the profile.
Practice a web scraping exercise on Indeed with Python, BeautifulSoup, and Selenium to input a job title and location, then extract links, titles, companies, locations, salaries, and dates across pages.
Learn to scrape job postings from Indeed using Python with Selenium and BeautifulSoup, extract title, company, location, salary, and date into a pandas DataFrame across multiple pages.
Web Scraping has become one of the hottest topics in the data science world, for getting access to data can make or break you.
This is why Fortune 500 companies like Walmart, CNN, Target, and Amazon use web scraping to get ahead and stay ahead with data.
It’s the original growth tool and one of their best-kept secrets
…And it can easily be yours too.
Welcome to Web Scraping in Python with BeautiuflSoup and Selenium!
The most up to date and project-oriented course out there currently.
In this course, you're going to learn how to scrape data off some of the most well-known websites which include:
Airbnb
Nike
Indeed
NFL
MarketWatch
Worldometers
IMDb
Carpages
At the end of this course, you will understand the most important components of web scraping and be able to build your own web scrapers to obtain new data from any website, automate any task using web scraping, and more.
Plus, familiarize yourself with some of the most common scraping techniques and sharpen your Python programming skills while you’re at it!
First, learn the essentials of web scraping, explore the framework of a website, and get your local environment ready to take on scraping challenges with BeautifulSoup, and Selenium.
Next, cover the basics of BeautifulSoup, utilize the requests library and LXML parser, and scale up to deploy a new scraping algorithm to scrape data from any table online, and from multiple pages.
Third, set up Selenium to deal with JavaScript-driven webpages, and use the unique functions of Selenium to interact with pages.
Combine the concepts of BeautifulSoup and Selenium to create the most effective scrapers to deal with some of the most challenging websites.
Finally, learn how to make web scraping fully automatic by running your scraper at a specific time each day.
What makes this course different from the others, and why you should enroll?
First, this is the most updated course currently out
Second, this is the most project-based course you will find, where we will scrape many of the internets most well-known websites
You will have an in-depth step by step guide on how to become a professional web scraper.
You will learn how to use Selenium to scrape JavaScript websites and I can assure you, you won't find any tutorials out there that teach you how to really use Selenium like I'll be doing in this course.
You will learn how to create a fully automated web scraping script that runs periodically without any intervention from you.
30 days money-back guarantee by Udemy
So whether you’re a data scientist, machine learning, or AI engineer who wants to access more data sources; a web developer looking to automate tasks, or a data buff with a general interest in data science and web scraping…
This course delivers an in-depth presentation of web scraping basics, methodologies, and approaches that you can easily apply to your own personal projects, or out there in the real world of business.
Join me now and let’s start scraping the web together. Enroll today.