
Learn to send emails with Python using the SMTP library to connect to a mail server and alert yourself about web scraping results.
Learn to scrape information from websites using Selenium, iterate through results, extract names, addresses, and links, handle pagination, and save data to an Excel file with pandas.
Master using selenium to scroll endlessly, executing JavaScript with execute_script and a while loop to load more content from feeds like Twitter, LinkedIn, and Facebook.
Learn python scheduling for web scraping with a blocking scheduler using apscheduler, configuring interval, date, and cron triggers, and passing arguments for automated tasks.
Build your first Flask web app to trigger web scraping and automation scripts, set up routes and forms, and prepare for production and scheduling with a secret key.
Automate web scraping with Selenium by connecting a Flask app, logging into LinkedIn, and searching for people in Paris using location inputs and result scraping.
Note: Be sure to use Ubuntu 20.XX instead of Ubuntu 22.XX as it seems that some commands on Ubuntu 22.XX might not work.
Even though low-code and no-code technologies are becoming more and more popular, scraping any website and automating any task can still be difficult. This course gives you the tools so that you can use Python to automate any task on a browser, like creating a Linkedin or Instagram bot.
This course offers practical solutions to the most challenging problems that you will meet while trying to retrieve data from websites during your growth hacking journey: scraping email addresses, creating an Instagram bot, ... With this course, you will understand how you can automate any Python script to perform actions online. You will learn how to connect your application to databases and how to put it to production. This course is broken into 23 chapters that address all the subjects that you need to understand to build any automation or web scraping tool. You will learn:
- How to modify files with Python
- How to scrap data from any website (Linkedin, Instagram, etc)
- How to send emails & text messages with Python
- How to connect your application to databases (MySQL, PostgreSQL, MongoDB)
- How to automate & schedule Python scripts
- How to put your application to production with different providers
I have intentionally designed this course so that you can come back any time and find what you need in separate videos and course chapters. This course is part on an ongoing Python’s series including:
- Python for web development
- Python for web scrapping, scheduling & automation (this course)
- Python for mobile app backends & APIs