
This is a welcoming message to the course. Students are given an insights of the course and how it will prepare them for landing into the appropriate jobs and embark on the right project with the right skills.
This lecture will give students an insights of the subject matter that is Text Analytics and Natural Language Processing. At the end , students will have to think about a project or a specific applications of Text Analytics and/or NLP they will wish to embark into. They will have an idea of where this course will lead them to in the field of Text analytics and NLP.
Discover how R objects carry attributes such as names, dimensions, and class, and compare data frames with the table data type. Learn to install, convert, view datasets, and write functions.
Master basic text manipulation in R using paste for concatenation with separators or collapse, extract substrings, replace segments, and split strings, with packages like stringr and stringi.
Explore how to use regular expressions in R to detect, extract, and replace matching strings, using grep, escape sequences, and basic regex concepts.
use the pipe operator in r to chain commands for selecting columns and filtering by continent, then mutate and summarize gdp per capita and life expectancy.
Master basic text pre-processing in R, including string manipulation, abbreviation, word and sentence tokenization, word length, stemming with snowball, and frequency analysis to prepare text data for analytics.
Explore tokenization in text analytics using R, creating tokens from words, phrases, or sentences, and generate n-grams such as bi-grams and skip-grams while handling punctuation and stop words from tweets.
Discover stemming, the process of reducing inflected words to their root forms to improve text analytics accuracy. The lecture demonstrates applying R-based stemming with different algorithms and dictionaries.
Learn to scrape Indeed to extract job titles, company names, locations, and descriptions for the City of Toronto, loop through pages, build a data frame, and save and clean results.
Learn to scrape song lyrics from a website with r: load libraries, parse pages, extract titles and links, fetch lyrics, and compile a data frame with title, link, and lyrics.
Discover corpus analytics in r by working with a corpus, performing tokenization, frequency analysis, and n-grams, and exploring sentiment analysis or word clouds with quanteda, text2vec, tidytext, and tm.
Analyze a Gutenberg Project novel with R using the corpus package, load and tokenize text, extract chapters, clean punctuation, and compute chapter-level token, type, and sentence statistics.
Explore corpus analytics of multiple documents in R, computing IDF metrics, extracting key terms, performing sentiment analysis with tidytext lexicons, and visualizing by-grams and word networks.
Learn to use the quanteda package to work with corpora. Explore creating, summarizing, subsetting, and querying corpora with kwic and regular expressions.
Master quanteda part 2: search keywords with wildcards and multiword phrases; build document feature matrices with DSM, apply stop word removal and stemming, and explore word clouds and clustering.
Explore the spacyr wrapper for spaCy in R, enabling non-destructive tokenization, part-of-speech tagging, named-entity recognition, and noun-phrase extraction with multilingual models.
This course is for all who wants to explore and pursue a career in Text Analytics and Natural Language Processing with R. The course will drive you through all the techniques you need to process structured and unstructured text data and corpora. It will also teach you how to deal with multi-lingual text.