Web Scraping, API ,Beautiful Soup and Pandas using Python

Name: Web Scraping, API ,Beautiful Soup and Pandas using Python
Rating: 4.3 (12 reviews)

Scrape your first web page using Python API ,Beautiful soup and structure the data using Pandas

Last updated 3/2021

English

What you'll learn

3 sections • 39 lectures • 4h 3m total length

Introduction to API3:29
Introduction to HTTP4:18
Introduction to JSON2:21
Installation of Python and Jupyter Notebook2:43
Installation of HTML request in Python Anaconda prompt1:11
Get a response from API6:30
Get JSON Response - API2:20
Historical data from API5:42
Wrong request in API1:23
Website 2: iTunes API and reading the values9:06
iTunes and Pandas4:37
Website 3: Edamam Registration3:14
Fetch API data from Edamam13:50
Project: Create a currency calculator application.9:17
Create a currency calculator by fetching exchange rates from an application programming interface, inputting base and target currencies and a quantity, then compute and display the converted amount.

Introduction to HTML and JavaScript2:39
Introduction to web scraping2:41
Beautiful Soup and Workflow of Web scraping5:42
Learn how to use Beautiful Soup to extract data from html with Python, by inspecting page structure, sending requests, and parsing data for local analysis.
Website 4: Implementation of Scraping in Wikipedia - part 16:39
Implementation of Scraping in Wikipedia - part 29:45
Implementation of Scraping in Wikipedia - part 35:27
Website 5: Implementation of Scraping in Rotten Tomatos - part 112:24
Learn how to scrape rotten tomatoes top action movie data using beautiful soup to extract ratings, critics' consensus, synopsis, and other details.
Implementation of Scraping in Rotten Tomatoes - Part 211:06
Implementation of Scraping in Rotten Tomatoes - Part 39:21
Implementation of Scraping in Rotten Tomatoes - Part 410:51
Practice web scraping with Python to extract movie cast lists and synopses, build structured data with for loops, and merge details into a cohesive dataset.
Implementation of Scraping in Rotten Tomatoes - part 56:44

Introduction to Scrapy4:38
Installation of Scrapy3:38
Components of Scrapy - Part 18:15
Components of Scrapy - Part 24:13
Explore Scrapy's core components: define items with fields like name and price, build spiders to scrape data, and use pipelines to store and format results.
First Spider for scraping6:29
CSS selector8:26
Xpath Selector8:38
Quotes for scraping - Part 19:13
Practice building a Scrapy spider to extract title, author, and tags from a web page, inspect the HTML, map values to variables, and print structured results.
Quotes for scraping - Part 25:05
Saving the scraped data in JSON, XMl, CSV2:59
Item container5:16
Pipelines in Scrapy4:03
SQLite3 Basics6:53
Storing the scraped value in DB12:05
Learn to store scraped values in a database using Python. Create a database, define tables, and insert scraped items into columns with proper commits.

Scrape your first web page using Python API ,Beautiful soup and structure the data using Pandas

API Python:

This section help you understand the working on API and how to implement the same using Python.
Here we will learn how to get and post the request using API and implement the same.
Will create a simple currency conversion calculator using JSON.
We will also cover API for website which we need to sign in. We will be using the API keys and ID to login and fetch the details.
We will explain how to structure and export the data in CSV using Pandas.

Web Scraping:

This Section helps you to learn Scraping the data and storing the data in our desired Format.
Here we will have the data scraped and use parsing of data and store it in Pandas for reference.
Helps in Understanding the structure of HTML and Javascript file to parse the data.
2 Projects to Scrape the data and parse them as our wish.

Beautiful Soup:

It is easy to learn and master. for example, if we want to extract all the links from the webpage
It has good comprehensive documentation which helps us to learn the things quickly.
It has good community support to figure out the issues that arise while we are working with this library.