Web Scraping for Data Science - Python & Selenium - Basics

Name: Web Scraping for Data Science - Python & Selenium - Basics
Rating: 4.6 (274 reviews)

Learn the Fundamentals of XPath and Selenium to Scrape the Data from the Web

Highest Rated

Created byDr. Alexander Schlee

Last updated 11/2021

English

What you'll learn

Web Scraping with Selenium
Most Important Concepts of XPath
Scraping Tables
Data Extraction for Data Science
Combination of Python, Selenium, Pandas

Course content

6 sections • 29 lectures • 3h 21m total length

Course Introduction4:05
Before you start0:33

Basics of XPath - Topic Overview2:05
Master the basics of XPath, including syntax and building XPath expressions for web scraping. Compare relative and absolute XPath, single and double slashes, and understand parents and siblings logic.
Importance of XPath1:58
XPath - Syntax9:16
Absolute and Relative XPath7:23
Difference between Single Slash and Double Slash3:24
Parents and Siblings11:34
Master XPath techniques by starting from a child element and navigating to its parent or to preceding and following siblings, using index-based selection and the parent, preceding-sibling, and following-sibling axes.

Set Up9:10
Overview4:10
Discover selenium basics, its use cases for testing automation and web scraping, after setting up chrome driver and jupiter notebook, with locator strategies like XPath, class name, and id.
Initialization9:20
Install and import Selenium packages, including WebDriver, Keys, By, and Options, to initialize the Chrome driver, store URLs in variables, and open them for web scraping practice.
XPath - Locator11:10
Class Name - Locator5:02
ID - Locator6:42
Name - Locator3:44
(Partial)- Link Text - Locator7:07
Alternative XPath - Syntax5:23
Selenium in Action3:57
Explore Selenium in action to automate web interactions for data scraping, including launching the driver, navigating pages, performing searches, clicking links, and closing the browser, with an optional headless mode.
(Optional) - Selenium in Headless Mode6:10

Requirements

Basic Understanding of Python

Description

In this Course you will learn the Fundamentals of XPath, Selenium and the Web Scraping Process. We will cover the Fundamentals and afterwards we are going to scrape Data from real Websites. The first Real Life Project will be the extraction of Data from Yelp and the next Project will cover the scraping process of tables. But before we start with this Real Life Projects, you will get familiar to all the basic knowledge which is required to complete it. Whenever you have a question, don't hesitate to ask in the forum section. Either me or the other students will reply to your question as soon as possbile.

After completing this course you will be confident using Selenium for Web Scraping in your personal Projects. Especially for Data Scientists it is important to be able to extract the data they need to analyze and work with. You will get downloadable files so that you can refer to all topics which we have covered through this course. This course will be updated on a reglular basis. My goal is that all my students understand the Concepts of Selenium, XPath and the whole Web Scraping Process. For this course it's good to know the very basics of Python Programming.

Disclaimer : I teach web scraping as a tutor for educational purposes. That's it.

The first rule of scraping the web is: do not harm a certain website. The second rule of web crawling is: do NOT harm a certain website.

Who this course is for:

People who want to learn the Fundamentals of Web Scraping with Python and apply the knowledge to Real Life Projects;
Data Enthusiasts
People who want to learn how to collect Data with Selenium & Python

Web Scraping for Data Science - Python & Selenium - Basics

What you'll learn

Explore related topics

Course content

Course Overview and Goals2 lectures • 5min

Basics of XPath Expressions6 lectures • 36min

Basics of Selenium for Web Scraping11 lectures • 1hr 12min

Real Life Project No.1 - Scrape Yelp.com4 lectures • 49min

Real Life Project #2 - Scrape Pokemon Table5 lectures • 40min

Next Steps1 lecture • 1min

Requirements

Description

Who this course is for: