Package Overview: Web Technologies and Services in R

R-Tutorials Training
A free video tutorial from R-Tutorials Training
Data Science Education
4.4 instructor rating • 23 courses • 210,787 students

Lecture description

Packages for web related tasks like scraping.

Learn more from the full course

Text Mining, Scraping and Sentiment Analysis with R

Learn how to use Twitter social media data for your R text mining work.

02:27:29 of on-demand video • Updated November 2017

  • use R for social media mining
  • get data from Twitter to do text analysis
  • perform web scraping tasks using the twitteR package
  • know which packages to use for web scraping
  • get R and Twitter connected
  • know how to perform a sentiment analysis in R
  • plot text data visualizations
English [Auto] We have another task view which is also very important for this whole topic of social media. Mining and scrapping and this one is called web technologies and service. Again you can find a corresponding link in the link Lakesha. So basically if you want to scrape or fetch some kind of text or documents from the internet you can go to this web technologies and services task's you because there are many many packages which are only specialized and focus on this topic. So for example as you can see here if I would scroll down there are tons and tons of extra packages. And in this video I'm going to explain to you the most important ones for social media mining and also for web scrapping because there is this SNL package conveniently at the head of this whole task view which is called mail. So we're going to take a look at this one we can open the next M-L reference manual the PTF And as you can see first of all it is quite fresh. It was updated in January 2000 and 15. And then there are tons and tons and tons of functions in this small package. So for example if you take a look get the read etched in our table. Those would be perfectly fine functions to actually scrape whole tables from Web sites like let's say Wikipedia and whatnot. And of course there is a ton of other functions in this package which can also be useful. So if you are interested in data from web sites or blogs and whatnot this is actually a package where you can use for that kind of purpose. All right let's go back to the task view because what I now want to show you is the section for social media to go there we need to scroll down quite to the bottom two ads this one over here. Social media and there are approximately 10 packages which focus on social media analysis and social media scrapping in this whole tutorial we are focusing on Twitter data. Therefore we are mainly using the Twitter package. So it is this you know we're here and this is the interface between Twitter and our. And with this package basically does is it provides us a connection between Twitter and our so that we can directly load data into our. That we can also search and filter that kind of Twitter data. There is also a similar tool available for tumblr for LinkedIn for Facebook. And basically by using placers You can also take a look at Google Plus profiles in Google Plus information. So there are basically connections and interfaces to any bigger social media platform. Let's not take a look at the Twitter package since this one is the main package for this whole course. All right so this one is actually version one point one point eight are working with this one and the whole thing is written by Jeff gentry. Let's open the manual. The PDAF down here are right and we are going to take a look at all those functions we have at hand. With this kind of Twitter package. So as you can see there are functions for favorite friendships trends and so on. So all of this is facilitated with this package. But our main function for this course is search Twitter because this is actually the one which we can use to directly scrape the data into our our program and it also facilitates a certain range of filtering so we could filter for example for specific times and dates and we can also filter for geo locations. So basically we can specify word those Twitter feeds should've been written and fed into the Internet again in this PTF you will then find all this in-depth information about all those functions you would find descriptions the arguments and how you can actually use those functions and some of those more useful functions from this Twitter package. I will later on use in the videos and that will also explain them to you in depth how you can actually use them and do filtering and stuff like that. So this Twitter package is one of the key packages for this whole tutorial.