Scraping data from Google search results
4.5 (10 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
89 students enrolled

Scraping data from Google search results

URLs, Facebook pages, and Images
4.5 (10 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
90 students enrolled
Created by Nikki Luzader
Last updated 6/2018
English
English [Auto]
Current price: $104.99 Original price: $149.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 1 hour on-demand video
  • 1 downloadable resource
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • How to scrape Google search results using Python to collect three types of data: URLs, Facebook pages, and images.
  • A basic understanding of utilizing Google's cloud platform and developer API to scrape data legitimately
Course content
Expand all 10 lectures 01:13:03
+ Getting what you need
5 lectures 17:42
Creating a cloud project and getting API key
04:12
Custom search engine setup and getting CSE ID
03:27
+ Bringing your program to life
5 lectures 55:21
Demonstration and getting your first results
07:57
Housekeeping - Being organized
02:37
Writing the code
32:16
Customizing your results
07:52
Increasing your daily limit and some extra scraping advice
04:39
Requirements
  • A Gmail account (free)
  • Python 3.6
  • Basic programming knowledge recommended but not required.
  • Some python experience recommended but not required
Description

Hello everyone!

If you came here looking for a fast and efficient solution to collecting data from a Google search, then you came to the right place. In this course, I will show you how to use Python and Google Cloud Platform(GCP) to grab web URLs from Google search results. By utilizing the GCP, you are given a robust set of tools  to customize your collection.


This is guaranteed to be the fastest and most fruitful way to collect data from your searches. This will also open up the door for many other opportunities to explore Python and GCP to take on future projects, such as scraping and collecting images.


The code in this course can be expanded  upon, and I have uploaded it to gitHub as well, and will continue to update it in the future. 


Now.. if you search the internet for "how to scrape google search results", it is unlikely that you will find a guide like this one, or even a method utilizing the same approach. This was something that I personally has been trying to figure out for a long time, and I have been unable to find any straightforward guides on this method, so I hope you came here and finally found what you are looking for.


The applications for this are limitless, but most people will probably be doing this because they want to save time by automating this process. Essentially, that is what we are doing here: we are automating the process of going to the Google search engine, typing in a search term, finding the most relevant URL, and saving that to a file. This is a process that can do all of that in less that a second. We can utilize Python's ability to read and write to CSV files in order to 'feed' Google a CSV with our search terms, get the most relevant result, and  then append the results to a new CSV file. 


Logo created with LogoMakr

Who this course is for:
  • Beginners who want to scrape Google search results. No experience necessary
  • People who want to save time collecting business/organization/facebook URLs