Master Python Web Scraping & Automation using BS4 & Selenium

Create Python project folder and set up Python 3.8 virtual environment with virtualenv to isolate dependencies for web scraping. Activate the environment, use pip freeze for requirements, then deactivate.

Build the first script to fetch a job list from the Remote Ockham api's /api endpoint. Format the extracted data into a spreadsheet and email it for review.

Create a Python API scraping script skeleton for the remote ok API, establish a project folder, test GET requests with Postman, and set up imports and a hello world verification.

Export data from an API to an Excel workbook with Python, creating a jobs sheet, setting headers from the first data item, and writing all job fields for emailing later.

Learn to send emails from Python using smtp with Gmail, including using an Excel file generated from API data and attaching it via a send_email function.

Build a simple scraper that visits a list of URLs on Amazon and extracts data on TVs, saving results to a CSP file for analysis, while avoiding excessive scraping.

Create a skeleton HTML scraping script to extract Amazon product data using BeautifulSoup, requests, and a parsing library, with setup steps for a dedicated project folder and virtual environment.

Learn to extract the product price from HTML using beautiful soup and an XML parser, by building a price function and parsing Amazon pages for accurate values.

Extract the product rating from Amazon HTML by locating the average customer reviews element and converting the displayed 4.4 out of five stars to a numeric value in Python.

Learn to extract product details from an HTML page using web scraping techniques and populate a product info dictionary with fields like brand, weight, dimensions, and country of origin.

Export scraped product data to a date-named csv file, write a header from the first item’s keys, and populate rows with each product’s values for easy Excel viewing.

Learn to add multithreading to a Python Amazon scraper using concurrent.futures with a ten-thread pool to fetch URLs concurrently and speed up scraping, with a progress indicator.

Learn how Selenium enables web automation to log into Trello, navigate boards, and add tasks, with real-world use cases and a focus on ethical use.

Demonstrates a Python web automation script using Selenium to automate Chrome browser actions, including button clicks and data input, with a screenshot saved to PNG and a GitHub repo reference.

Build a python web automation script that opens chrome, performs automated browser tasks, and set up a project folder with Trello_board_py, import selenium components, and download the matching chrome driver.

Learn to automate Trello login by populating form fields with Selenium, using expats and CSA selectors to locate elements, sending credentials with send keys, and clicking the login button.

Automate adding a task to a Trello board by clicking the add card button, entering the to-do text, and confirming the card appears.

Learn to automate adding a task to a to-do list with selenium, selecting the text area via xpath, entering the task, and clicking the add card button.

Automate Trello board task creation and navigation, then capture and save a screenshot of the board page as a dated png in the downloads folder.