Powerful Web Scraping/Crawling||Scrapy and BS4||Hindi|Urdu||
4.6 (43 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
4,852 students enrolled

Powerful Web Scraping/Crawling||Scrapy and BS4||Hindi|Urdu||

One and Only Course in Web Scraping and Web Crawling Using Scrapy and Beautiful Soup ||Hindi|Urdu||
4.6 (43 ratings)
Course Ratings are calculated from individual students’ ratings and a variety of other signals, like age of rating and reliability, to ensure that they reflect course quality fairly and accurately.
4,852 students enrolled
Created by Ahmad Mohsin
Last updated 4/2020
English
Current price: $13.99 Original price: $19.99 Discount: 30% off
5 hours left at this price!
30-Day Money-Back Guarantee
This course includes
  • 5.5 hours on-demand video
  • 1 article
  • 2 downloadable resources
  • Full lifetime access
  • Access on mobile and TV
  • Certificate of Completion
Training 5 or more people?

Get your team access to 4,000+ top Udemy courses anytime, anywhere.

Try Udemy for Business
What you'll learn
  • Web Scraping using Scrapy Frame work
  • Building a Spiders or Web Crawlers
  • Writing and Execute Web Scraping Script
  • Source Code for all Spiders or web crawlers
  • Exporting data extracted by Scrapy into Excel or CSV files
  • Fine tuning Your Spiders using Scraping Build in Settings
Requirements
  • No Programming Required, Python Refresher is Provided with this course.
  • A laptop with Internet Connection
  • Attitude to Learn Web Scraping
  • A Smile....:)
Description

I will share my experience , how did i came up to develop this course.When i started out, My problem was not that i don't know that what i want to learn but my problem was following.

1- Which tools are the best

2- Which techniques are the Best

3- Will this Course Make me find my way or Make me more Confuse because there is too much Information out there.

4- Then i found The course but that was in English. and All above went into the Drain.

But Don't worry, amigo, Very First time you are going to get all your needs satisfied, plus in your mother tongue. Its so easy to grab concepts in your mother tongue, that programming language seems natural and learning comes easy.

Above all, I have distilled my six years of University Teaching Experience in this course to make it One of the Best Course you will ever take.

In this Course, We will start from Zero. This Course is divided into three sections


1- Python Refresher

Here You will learn all the Python Concepts needed to get started with Web Scraping Frame Work

2- Beautiful Soup BS4

In this Section, You will do your First Project of Scraping a real website, using BS4, One the most Famous Web-scraping Python Library

3- Scrapy

In this Section, You will learn Scrapy, An Asynchronous Web Scraping Framer Work Build on Twisted. You will build a Scrapy Spider, and Learn how to use Scrapy Shell.

  • 'Great Teacher So Far    (5 Stars)'           Saqib Munir

Last but not the least if you have any Question don't hesitate to ask question.

Good luck and Enjoy.


Who this course is for:
  • Python Programmers
  • Web Developers
  • Data-mining or Machine Learning Students
  • Students who want to built web Crawlers.
  • Students who want to extract data from web sites efficiently
Course content
Expand all 33 lectures 05:18:43
+ Python Refresher
12 lectures 02:16:03
Variable_Part2_Operations
11:42
Please Don't Skip this
00:22
Conditional Operators
10:00
Collections
15:14
Operations_on_Collections
13:21
Conditionals_or_Program_Flow_Control_Part2
12:25
Functions
11:21
Classes
09:25
Classes_Part2
11:20
+ Beautiful Soup BS4
8 lectures 01:04:58
Web_Scraping_Tools and Rules
03:55
Which_Editor_to_Chose
05:28
Learning_to_Install_Required_Tools
15:03
Installing_BS4_and_Scrapy
06:48
Solving_Scrapy_Installing_Error
05:58
First_Web_Scraping_Project_Using_BS4
18:44
+ Scrapy
5 lectures 40:28
Creating_Scrapy_Spider_Script
09:35
Creating_Spider_Using_Scrapy
08:37
Using_Scrapy_Shell_Removing_Any_Errors
06:43
Extracting_Data_Using_Scrapy_Shell
09:32
+ Advanced Spider
8 lectures 01:17:14
Building-Advanced-Spider-Part1
06:57
Building-Advanced-Spider-Part2
09:58
Building Advanced Spider_Part3
10:26

# -*- coding: utf-8 -*-

import scrapy



class QuotesSpider(scrapy.Spider):

    name = 'quotes'

    allowed_domains = ['quotes.toscrape.com']

    start_urls = ['http://quotes.toscrape.com/']

   

    def parse(self, response):

        # h1_tag = response.xpath('//*[@class="tag-item"]/a/text()').extract()

        # tags = response.xpath("//h1/a/text()").extract_first()

        # yield {'H1_Tag':h1_tag, 'Tags':tags}


        container = response.xpath('//*[@class="quote"]')

        for quote in container:

           text =  quote.xpath('.//*[@class="text"]/text()').extract_first()

           author =  quote.xpath('.//*[@class="author"]/text()').extract_first()

           keywords = quote.xpath('.//*[@class="keywords"]/@content').extract_first()

           

           yield {

                'Text':text,

                'Author':author,

                'Key':keywords

           }


           next_url = response.xpath('//*[@class="next"]/a/@href').extract_first()

           abs_next_url = response.urljoin(next_url)

           yield scrapy.Request(abs_next_url)

Saving_scrapy_data
05:04
Deploying-Spider-in-Cloud-Part-1
08:44
Deploying-Spider-in-Cloud-Part-2
06:03
Login-Using-Scrapy
14:41
Building-Link-Extractor
15:21