REST API: Data Extraction with Python - without Web Scraping
3.9 (30 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
232 students enrolled

REST API: Data Extraction with Python - without Web Scraping

Use REST APIs to exctract the data you need from websites - no need for web scraping
3.9 (30 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
232 students enrolled
Created by GoTrained Academy
Last updated 8/2019
English
English [Auto-generated]
Current price: $69.99 Original price: $99.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 2 hours on-demand video
  • 6 articles
  • 3 downloadable resources
  • 1 coding exercise
  • Full lifetime access
  • Access on mobile and TV
  • Assignments
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • Data Extraction with REST APIs and Python - no need for Web Scraping
  • Using Postman to test API requests before writing your code
  • Handling different types of authentication required by APIs
  • Completing practical projects to extract currency exchange rates and business details and reviews using popular APIs
  • Source codes (*.py files) for all Exercises can be downloaded
  • Q&A board to send your questions and get them answered quickly
Course content
Expand all 21 lectures 02:04:14
+ Currency Exchange API - Extract Rates
7 lectures 30:24
Extract Data from JSON
1 question
Using API Parameters
09:07
Simple Currency Converter with Python
06:13
API with Access Key - Fixer.io
04:38

How to save the extracted data into a text file.

Tip: Saving Data to a File
00:23
Source Code: Currency Exchange REST APIs
00:02
Practice what you learned in the first section.
Optional: More REST APIs for Practice
3 questions
+ Postman REST API Client
1 lecture 09:52

There are so many REST clients available that can be used to interact with REST APIs and test requests before writing your code. Postman, is one of the world’s leading API Development Environment (ADE) with so many features baked in. In this tutorial, you are going to learn how to use Postman to make API calls with and without authorization.

Test REST API Requests with Postman
09:52
By the end of this assignment, you should be able to: figure out instructions of using relatively simple, yet powerful, REST APIs; and use Postman to test REST APIs with authentication.
Practice Using Postman
1 question
+ Yelp API - Extract Business Details & Reviews
5 lectures 43:56

Searching for businesses using a search term (e.g. “seafood”) with Yelp API.


Business Search with Yelp API
10:20

Extracting business reviews and details for a specific business.

Business Reviews, Phone Search & Business Match with Yelp API
11:51

Extracting Bookstores in New York City, Details and Reviews using Yelp API.


Project, p1: Extract Details of Bookstores in New York City with Yelp API
13:29
Project, p1: Extract Reviews of Bookstores in New York City with Yelp API
08:14
Source Code: Yelp API
00:02
+ Try it Yourself!
0 lectures 00:00
By the end of this assignment, you should be able to write your own Python code to connect to a REST API with authorization and extract the information you need.
Extract Word Definitions from REST API
1 question
+ Google Places API - Extract Business Details & Reviews
8 lectures 40:01

Getting a Google API key and creating a function search for places with Google Places API.


Get Google Places API Key & Create a Search Places by Coordinate Function
15:55
Google Places Types
00:54

Creating a function to get the details of the retrieved places with Google Places API.

Create a Get Place Details Function
05:22

In this Google Places API project, you will learn how to retrieve some information about places including place name, user reviews and ratings, address, phone number and website.

First, you need to search for places as stated before. So go to Google Maps and search for the area you are interested in and get the GPS coordinates that you will use in Google Places API to search the area for places of a specific type and retrieve their details and reviews.



Project: Extract Place Details & Reviews - Search with GPS Coordinates & Type
06:17

Extracting place details and list of reviews with Google Places API.

Project, p2: Extract Place Details with Google Places API
05:11

Iterating place reviews and extract them.

Project, p3: Extract Place Reviews with Google Places API
05:51

Google Places API returns only 5 last reviews per place. If you are the business owner, use Google My Business API instead.

Google Places Limitations
00:28
Source Code: Google Places API
00:02
Requirements
  • Some prior programming experience in Python (e.g. Data Structures and File Handling) will help.
  • This course adopts a step-by-step approach and requires you to open a Python editor, download available *.py code files, and start applying the provided examples and exercises.
  • Python 3: Codes of this course are tested on Python 3. It is up to you to adapt them if you want to run them in Python 2.
Description

Do you want to extract data from a website? Before using web scraping, you have to check first if this website has an API that gives you access to the data you need. There are several popular platforms that give developers access to their “web services”, also known as “APIs”. So using APIs is the official way for data extraction and doing other automation stuff allowed by such applications. You can even benefit from some APIs to build your own applications. If an API allows you to get the data you want to extract from a website, then you do not need regular web scraping.


REST APIs usually generate output in JSON or XML format because most of programming languages can handle these formats easily. In fact, JSON is very similar to data types in programming languages; for example, it is very similar to Python dictionaries.


Some APIs require authentication to control their usage, using an API Key or Client ID and Client Secret, similar to a username and password, so to speak.


In this course, you will start by learning how to extract data using a very simple currency rate conversion API that does not require any authentication but it will teach you the fundamentals of using REST APIs. After that, you will study more advanced video tutorials on sophisticated APIs such as Yelp and Google Places. You will also learn how to use the REST API client, Postman, to test an API before writing your code.


By the end of this course, you will not only be able to apply the given practical examples, but you will also be able to apply the same fundamentals you learned to any other REST API to extract the data you need from popular websites. So let’s start.


Course Contributors, special thanks to:

  • Majid Alizadeh (Coding & Instructions)

  • Michael Bukachi (Coding & Instructions)

  • Yasmin Moslem (Coding & Instructions)

  • Yusuf Yurtsever (Video Creation & Narration)



Who this course is for:
  • Those who want to learn how to use REST APIs and Python for data extraction and automation.