Data Science: Natural Language Processing (NLP) in Python
What you'll learn
- Write your own cipher decryption algorithm using genetic algorithms and language modeling with Markov models
- Write your own spam detection code in Python
- Write your own sentiment analysis code in Python
- Perform latent semantic analysis or latent semantic indexing in Python
- Have an idea of how to write your own article spinner in Python
Course content
- Preview07:48
- 05:59Why Learn NLP?
- 08:12The Central Message of this Course (Big Picture Perspective)
Requirements
- Install Python, it's free!
- You should be at least somewhat comfortable writing Python code
- Know how to install numerical libraries for Python such as Numpy, Scipy, Scikit-learn, Matplotlib, and BeautifulSoup
- Take my free Numpy prerequisites course (it's FREE, no excuses!) to learn about Numpy, Matplotlib, Pandas, and Scikit-Learn, as well as Machine Learning basics
- Optional: If you want to understand the math parts, linear algebra and probability are helpful
Description
In this course you will build MULTIPLE practical systems using natural language processing, or NLP - the branch of machine learning and data science that deals with text and speech. This course is not part of my deep learning series, so it doesn't contain any hard math - just straight up coding in Python. All the materials for this course are FREE.
After a brief discussion about what NLP is and what it can do, we will begin building very useful stuff. The first thing we'll build is a cipher decryption algorithm. These have applications in warfare and espionage. We will learn how to build and apply several useful NLP tools in this section, namely, character-level language models (using the Markov principle), and genetic algorithms.
The second project, where we begin to use more traditional "machine learning", is to build a spam detector. You likely get very little spam these days, compared to say, the early 2000s, because of systems like these.
Next we'll build a model for sentiment analysis in Python. This is something that allows us to assign a score to a block of text that tells us how positive or negative it is. People have used sentiment analysis on Twitter to predict the stock market.
We'll go over some practical tools and techniques like the NLTK (natural language toolkit) library and latent semantic analysis or LSA.
Finally, we end the course by building an article spinner. This is a very hard problem and even the most popular products out there these days don't get it right. These lectures are designed to just get you started and to give you ideas for how you might improve on them yourself. Once mastered, you can use it as an SEO, or search engine optimization tool. Internet marketers everywhere will love you if you can do this for them!
This course focuses on "how to build and understand", not just "how to use". Anyone can learn to use an API in 15 minutes after reading some documentation. It's not about "remembering facts", it's about "seeing for yourself" via experimentation. It will teach you how to visualize what's happening in the model internally. If you want more than just a superficial look at machine learning models, this course is for you.
"If you can't implement it, you don't understand it"
Or as the great physicist Richard Feynman said: "What I cannot create, I do not understand".
My courses are the ONLY courses where you will learn how to implement machine learning algorithms from scratch
Other courses will teach you how to plug in your data into a library, but do you really need help with 3 lines of code?
After doing the same thing with 10 datasets, you realize you didn't learn 10 things. You learned 1 thing, and just repeated the same 3 lines of code 10 times...
Suggested Prerequisites:
Python coding: if/else, loops, lists, dicts, sets
Take my free Numpy prerequisites course (it's FREE, no excuses!) to learn about Numpy, Matplotlib, Pandas, and Scikit-Learn, as well as Machine Learning basics
Optional: If you want to understand the math parts, linear algebra and probability are helpful
WHAT ORDER SHOULD I TAKE YOUR COURSES IN?:
Check out the lecture "Machine Learning and AI Prerequisite Roadmap" (available in the FAQ of any of my courses, including the free Numpy course)
Who this course is for:
- Students who are comfortable writing Python code, using loops, lists, dictionaries, etc.
- Students who want to learn more about machine learning but don't want to do a lot of math
- Professionals who are interested in applying machine learning and NLP to practical problems like spam detection, Internet marketing, and sentiment analysis
- This course is NOT for those who find the tasks and methods listed in the curriculum too basic.
- This course is NOT for those who don't already have a basic understanding of machine learning and Python coding (but you can learn these from my FREE Numpy course).
- This course is NOT for those who don't know (given the section titles) what the purpose of each task is. E.g. if you don't know what "spam detection" might be useful for, you are too far behind to take this course.
Featured review
![Andrea Clark-Sevilla](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
Instructor
- 4.6 Instructor Rating
- 108,419 Reviews
- 423,004 Students
- 28 Courses
Today, I spend most of my time as an artificial intelligence and machine learning engineer with a focus on deep learning, although I have also been known as a data scientist, big data engineer, and full stack software engineer.
I received my masters degree in computer engineering with a specialization in machine learning and pattern recognition.
Experience includes online advertising and digital media as both a data scientist (optimizing click and conversion rates) and big data engineer (building data processing pipelines). Some big data technologies I frequently use are Hadoop, Pig, Hive, MapReduce, and Spark.
I've created deep learning models to predict click-through rate and user behavior, as well as for image and signal processing and modeling text.
My work in recommendation systems has applied Reinforcement Learning and Collaborative Filtering, and we validated the results using A/B testing.
I have taught undergraduate and graduate students in data science, statistics, machine learning, algorithms, calculus, computer graphics, and physics for students attending universities such as Columbia University, NYU, Hunter College, and The New School.
Multiple businesses have benefitted from my web programming expertise. I do all the backend (server), frontend (HTML/JS/CSS), and operations/deployment work. Some of the technologies I've used are: Python, Ruby/Rails, PHP, Bootstrap, jQuery (Javascript), Backbone, and Angular. For storage/databases I've used MySQL, Postgres, Redis, MongoDB, and more.