Scraping and Data Mining from Websites

Learn how to scrape any website. We will show you everything you need to scrape Websites.
3.7 (132 ratings) Instead of using a simple lifetime average, Udemy calculates a
course's star rating by considering a number of different factors
such as the number of ratings, the age of ratings, and the
likelihood of fraudulent ratings.
12,520 students enrolled
Free
Start Learning Now
  • Lectures 39
  • Contents Video: 5 hours
    Other: 1 hour
  • Skill Level All Levels
  • Languages English
  • Includes Lifetime access
    30 day money back guarantee!
    Available on iOS and Android
    Certificate of Completion
Wishlisted Wishlist

How taking a course works

Discover

Find online courses made by experts from around the world.

Learn

Take your courses with you and learn anywhere, anytime.

Master

Learn and practice real-world skills and achieve your goals.

About This Course

Published 4/2015 English

Course Description

Welcome to Scraping and Datamining from Websites.

This course is focused on show you how you can scrape information from websites.
Then we will create tables with the information that we scrape and finally we will export the information to Excel so you can share it with other people.

You will have access to The most Advanced API created for Scraping. It will increase the speed of your scrapping projects. We already did the hard work for you .

Trough comprenhensive videos you will discover how easy is to scrape websites with the API. We will use Visual Studio to Create applications that include the scrapping features.

What are the requirements?

  • You should be familiar with HTML and VB.Net (Not necesary but recommended)
  • You need to install Visual Studio (We cover it on the Curse)
  • You need Mozilla Firefox (You can use other browser but in the curse we will use Firefox)

What am I going to get from this course?

  • Download the HTML Source Code of any Website
  • Create an Application ussing the Scraped Content
  • Create tables with the scraped content
  • Save the tables to Excel so you can Export the information
  • Learn to scrape Emails from multiple sites and Create an Email Sender

What is the target audience?

  • This course is meant for any person who wants to learn web scraping
  • This course is for software developers who want to get more skills on scraping

What you get with this course?

Not for you? No problem.
30 day money back guarantee.

Forever yours.
Lifetime access.

Learn on the go.
Desktop, iOS and Android.

Get rewarded.
Certificate of completion.

Curriculum

Section 1: Course Overview
15:14

This lecture will show you some of the projects that you can do when you learn web scrapping


Section 2: Adding the Class to your Visual Studio Project
How to add your scrapping class
05:04
Scrapping Class File
Article
Section 3: How to Download the HTML code of any website
How to Download the HTML code of any website
09:18
Source Code for this section
Article
19:13

Awensome Lecture to scrape the html source code of any site, even password protected sites.

We will use the webbrowser control and then transfer the html source code to a textbox.

We show some examples with sites like Facebook, Ebay, Twitter and Google

Section 4: How to find Text Between TAGS - Extract specific Text from HTML Source Code
17:03

How to finf text between html tags

Source Code for this section
Article
Section 5: Get Multiple Items From a website Into a Table
19:46

Create a table from scrapped data

10:24

Create a table from scrapped data

Article

Here you will learn to create a table from the data that you scrapped

Section 6: Export the Table to Excel so you can share the scrapped Data
14:10

Export the table to Excel so you can share the scrapped Data

Add this to your scraping Class API
Article
Article

Here you will find the code that you will usefor this section

Section 7: Review of everything that we have learn
05:31

Small talk about all the topics covered in this curse.

Section 8: Project - Email Extractor and Email Sender
17:24

In this lecture i will show you how you can scrape the emails from any site.

I will use google for example and i will show you how i would go about it.

Enjoy this lecture.

I will show you how to do it but i do not endorse spam so please do not spam other people.

05:25

In this lecture i will show you how you can scrape the emails from any site.

I will use google for example and i will show you how i would go about it.

Enjoy this lecture.

I will show you how to do it but i do not endorse spam so please do not spam other people.
Article

This contains the source code of the email extractor form.

However it need the scraping class section to be created in your project. You can find it on section 2.

Note: If you are new to the course you should already have it on one of our previous projects.

If already took the course before please note that the scraping class file has been updated so you need to go and replace your previous code with the new code.

19:58

In this lecture i will explain to you how you can send emails to other people

Your Mailing list will be the one we extracted from the previous section

I do not encourage to spam other people but i will show you how to do it in case you wanted to email your own list.

Article

This lecture will show you the source code i use to send mass emails. It includes everything that you need to send mass emails. This in combination with the video is all that you need to mass email.

Do no use this for spam.

Also remember to allow POP3 emails in your gmail account, so the emails will be sent.

Section 9: Facebook Groups Scraping and Facebook Group Commentor
19:52

I show you step by step how i created this software

you will be able to scrape the groups and then comment on the group list.

This will automate the time that you invest on your facebook marketing

Article

This is the code that you need to scrape and comment on facebook groups.

Section 10: Youtube Comment Extractor
17:52

This video explains you how you can extract youtube comments from any video.

It also include the source code and a step by step video expalining you how to do it

Article

Here you can find the source code for the youtube comment extractor

It includes everything that you need

Youtube Video List Scraper
14:46
Youtube Video List Scraper Part 2
18:41
Article

Here is the source code that will allow you to extract YouTube video search

this will help you to analize youtube data faster


Section 11: Extract Companies From Yelp Based On Keywords
15:05

In this lecture we learn about how to scrape the companies on yelp and how we can save the information into excel.

15:10
In this lecture we learn about how to scrape the companies on yelp and how we can save the information into excel.
Article

This is the source code that you need to scrape companies from yelp based on keyword


Section 12: Extract All Images from Any Website
12:04

Extract all images from a website

12:04

Extract all images from website

Article

Learn to Download all images from a website

Section 13: Twitter Twitts Extractor
13:43

In this project i will guide you step by step on how you can extract twetts from twitter

Source Code for Twitter Tweets Extractor
Article
Section 14: New Scrapping Class Version 2. 0 May 31, 2015
Article

Scraping made easier. This class is the most awensome class you will ever see for scraping and working with datagridviews. It has some awensome features like

Downloading the html source code of a page

get text between tags

Spin articles

Addition on datagridviews

Screenshots of screen and forms

Filling forms on webbrowser controls

uploading files to ftp

sending emails

And much more. Seriously this is like more than 5 years of experience combined into the most powerful class that i ahve ever seen so far.

So enjoy and please leave a review.

Section 15: Ebay Scraping
Article

This will download information from ebay

Section 16: REDDIT scraping
Article

This is the source code for scrapping Reddit

It contains all the information that you need to do it yourself

Section 17: Learn to use proxies in your projects. Dont let sites block your scraping.
Learn to use proxies in your projects. Dont let sites block your scraping.
Article
Section 18: Scraping Amazon Products
Section 19: Newzeland Hotel Information Extraction
Section 20: Scraping Stock Screener Information
Section 21: Facebook Fan pages Scraper
Section 22: Dominate The REGEX (Regular Expressions)
Section 23: Scrape Inbound Member
Section 24: Create a Movie Series and Anime website, Scrape the content
Section 25: Scraping Classified Sites
Section 26: Scraping The Google Results, Get URLs, Title, Description, Keywords from sites
Section 27: Scraping Clickbank Products, Make Money Promoting the right Products
Section 28: Scraping Fiverr
Section 29: Scraping The Pirate Bay
Section 30: Scraping DailyMotion Videos
Section 31: Processing

Students Who Viewed This Course Also Viewed

  • Loading
  • Loading
  • Loading

Instructor Biography

Juan Jose Garcia, Software Development, Technical Support, Website Designer

5 Years working as software developer at Mediagraph creating simple and complex applications. I am currently studying Mechanical Engineering. More than 6 Years of experience working on Technical support. Developing Engineering Projects. Website Development, Html, PHP, VB net. Using autocad, inventor and Solidworks for technical drawing and complete understanding of CNC machining and 3D Printing.

Worked withdatabases like mysql and filemaker to save information online that you can retrieve afterwards in your application. Created applications that are being used in the lighting industry and retail industry. I created POS system for multiple companies that neededto keep track of their sales, their inventory and their current suppliers.

I really love to help people as much as i can, i am currently working on a compitia a+ certification. In Technical Support.

Ready to start learning?
Start Learning Now