
Combine selenium for browser automation with beautiful soup for data extraction to scrape the imdb movie database. Apply advanced search filters: 1990–2020, rating 1–10, Oscar nominees, English, and output JSON.
Learn to build a selenium automation workflow that opens imdb, navigates to advanced search, and applies filters like feature film, tv movie, release dates, user rating, and Oscar nominations.
Learn selenium part 2 by automating dropdown interactions, language selection, and form submission; navigate pages, capture current URL, and prepare data extraction with beautiful soup.
Learn to combine Selenium and Beautiful Soup to scrape IMDb movie data, extracting title, year, duration, genre, and rating from a structured results page.
Use selenium to fetch 250 movie pages, then apply Beautiful Soup with list comprehension to extract title, year, duration, genre, and rating into a pandas data frame. Export to Excel.
Intersection between the Browser Automation (Selenium Web Driver) and Web Scraping (Beautiful Soup)
In this tutorial we will focus on the combination of 2 powerful libraries: Selenium & Beautiful Soup. The requirement is to navigate with Selenium Web Driver to the result page where the data is strored. In the next step we have to extrct our required data with Beautiful Soup and Requests. We will use the IMDB Movie Database for this particular project.
Especially for people who work with data it is important to be able to create own datasets. Often we rely on datasets from someone else. This course should show all data enthusiasts how to scrape and store data in Excel Files.
After this course you will have the knowledge and the experience to scrape your own data and create your own dataset. With the help of the course resources you will always have documents you can refer to. If you have a question or if a concept just does not make sense to you, you can ask your questions anytime inside the Q&A - Forum. Either the instructor or other students will answer your question. Thanks to the community you will never have the feeling to learn alone by yourself.
What you’ll learn
Web Scraping
Beautiful Soup
Data Extraction
Web Scraping for Data Science
Data Mining
Data Scraping & Data Cleaning
Selenium Web Driver
Browser Automation
Are there any course requirements or prerequisites?
Basic understanding of Python Programming
Basic Unterstanding of Beautiful Soup
Basic understanding of Selenium Web Driver
Who this course is for:
Everybody who is interested in Web Scraping, for example Data Scientists
Professionals who want to create their own dataset without being dependent on some else
People who want to understand how to combine Selenium & Beautiful Soup in one project
Disclaimer : I teach web scraping as a tutor for educational purposes. That's it.
The first rule of scraping the web is: do not harm a certain website. The second rule of web crawling is: do NOT harm a certain website.