Scraping and Data Mining from Websites
3.5 (192 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
16,327 students enrolled
Wishlisted Wishlist

Please confirm that you want to add Scraping and Data Mining from Websites to your Wishlist.

Add to Wishlist

Scraping and Data Mining from Websites

Learn how to scrape any website. We will show you everything you need to scrape Websites.
3.5 (192 ratings)
Instead of using a simple lifetime average, Udemy calculates a course's star rating by considering a number of different factors such as the number of ratings, the age of ratings, and the likelihood of fraudulent ratings.
16,327 students enrolled
Created by Juan Jose Garcia
Last updated 6/2015
English
Price: Free
Includes:
  • 5 hours on-demand video
  • 18 Articles
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
What Will I Learn?
  • Download the HTML Source Code of any Website
  • Create an Application ussing the Scraped Content
  • Create tables with the scraped content
  • Save the tables to Excel so you can Export the information
  • Learn to scrape Emails from multiple sites and Create an Email Sender
View Curriculum
Requirements
  • You should be familiar with HTML and VB.Net (Not necesary but recommended)
  • You need to install Visual Studio (We cover it on the Curse)
  • You need Mozilla Firefox (You can use other browser but in the curse we will use Firefox)
Description

Welcome to Scraping and Datamining from Websites.

This course is focused on show you how you can scrape information from websites.
Then we will create tables with the information that we scrape and finally we will export the information to Excel so you can share it with other people.

You will have access to The most Advanced API created for Scraping. It will increase the speed of your scrapping projects. We already did the hard work for you .

Trough comprenhensive videos you will discover how easy is to scrape websites with the API. We will use Visual Studio to Create applications that include the scrapping features.

Who is the target audience?
  • This course is meant for any person who wants to learn web scraping
  • This course is for software developers who want to get more skills on scraping
Students Who Viewed This Course Also Viewed
Curriculum For This Course
39 Lectures
05:56:49
+
Course Overview
1 Lecture 15:14

This lecture will show you some of the projects that you can do when you learn web scrapping


Course Overview. See whats possible if you learn web scrapping
15:14
+
Adding the Class to your Visual Studio Project
2 Lectures 12:58
How to add your scrapping class
05:04

Scrapping Class File
07:54
+
How to Download the HTML code of any website
3 Lectures 28:49
How to Download the HTML code of any website
09:18

Source Code for this section
00:18

Awensome Lecture to scrape the html source code of any site, even password protected sites.

We will use the webbrowser control and then transfer the html source code to a textbox.

We show some examples with sites like Facebook, Ebay, Twitter and Google

HTML code for any site & from Password Protected sites (Facebook, Twitter, Ebay)
19:13
+
How to find Text Between TAGS - Extract specific Text from HTML Source Code
2 Lectures 17:26

How to finf text between html tags

How to find text Between TAGS
17:03

Source Code for this section
00:23
+
Get Multiple Items From a website Into a Table
3 Lectures 32:07

Create a table from scrapped data

Create a Table from Scrapped Data Part 1
19:46

Create a table from scrapped data

Create a Table from Scrapped Data Part 2
10:24

Here you will learn to create a table from the data that you scrapped

Source Code for this section
01:57
+
Export the Table to Excel so you can share the scrapped Data
3 Lectures 15:45

Export the table to Excel so you can share the scrapped Data

Export the Table to Excel so you can share the scrapped Data
14:10

Add this to your scraping Class API
01:19

Here you will find the code that you will usefor this section

Source Code for this section
00:15
+
Review of everything that we have learn
1 Lecture 05:31

Small talk about all the topics covered in this curse.

Review of everything that we have learn
05:31
+
Project - Email Extractor and Email Sender
5 Lectures 47:14

In this lecture i will show you how you can scrape the emails from any site.

I will use google for example and i will show you how i would go about it.

Enjoy this lecture.

I will show you how to do it but i do not endorse spam so please do not spam other people.

Email Extraction - How to Extract Emails from Any site (Google)
17:24

In this lecture i will show you how you can scrape the emails from any site.

I will use google for example and i will show you how i would go about it.

Enjoy this lecture.

I will show you how to do it but i do not endorse spam so please do not spam other people.
Email Extraction - How to Extract Emails from Any site (Google) Part 2
05:25

This contains the source code of the email extractor form.

However it need the scraping class section to be created in your project. You can find it on section 2.

Note: If you are new to the course you should already have it on one of our previous projects.

If already took the course before please note that the scraping class file has been updated so you need to go and replace your previous code with the new code.

Source code Email Extractor Form
01:28

In this lecture i will explain to you how you can send emails to other people

Your Mailing list will be the one we extracted from the previous section

I do not encourage to spam other people but i will show you how to do it in case you wanted to email your own list.

Create an Email Sender with Gmail Accounts
19:58

This lecture will show you the source code i use to send mass emails. It includes everything that you need to send mass emails. This in combination with the video is all that you need to mass email.

Do no use this for spam.

Also remember to allow POP3 emails in your gmail account, so the emails will be sent.

Source Code for Email Sender
02:58
+
Facebook Groups Scraping and Facebook Group Commentor
2 Lectures 24:31

I show you step by step how i created this software

you will be able to scrape the groups and then comment on the group list.

This will automate the time that you invest on your facebook marketing

Facebook Group Scraping and Commentor
19:52

This is the code that you need to scrape and comment on facebook groups.

Source Code for this section
04:39
+
Youtube Comment Extractor
5 Lectures 58:05

This video explains you how you can extract youtube comments from any video.

It also include the source code and a step by step video expalining you how to do it

Youtube Comment Extractor
17:52

Here you can find the source code for the youtube comment extractor

It includes everything that you need

Source Code for Youtube Comment Extractor
02:53

Youtube Video List Scraper
14:46

Youtube Video List Scraper Part 2
18:41

Here is the source code that will allow you to extract YouTube video search

this will help you to analize youtube data faster


Source Code for this section
03:52
21 More Sections
About the Instructor
Juan Jose Garcia
3.5 Average rating
191 Reviews
16,339 Students
2 Courses
Software Development, Technical Support, Website Designer

5 Years working as software developer at Mediagraph creating simple and complex applications. I am currently studying Mechanical Engineering. More than 6 Years of experience working on Technical support. Developing Engineering Projects. Website Development, Html, PHP, VB net. Using autocad, inventor and Solidworks for technical drawing and complete understanding of CNC machining and 3D Printing.

Worked withdatabases like mysql and filemaker to save information online that you can retrieve afterwards in your application. Created applications that are being used in the lighting industry and retail industry. I created POS system for multiple companies that neededto keep track of their sales, their inventory and their current suppliers.

I really love to help people as much as i can, i am currently working on a compitia a+ certification. In Technical Support.