
1. This lecture discusses the initial process of creating a Google account. As most Google applications are tied to this account, students will also have access to Google Drive, Gmail, etc.
- Know how to register for a Google account
- Know how to navigate to the Colab application
A hands-on tutorial on how to register for a Google account.
How to navigate to the Google Colab application within the Google workspace.
Exploration of various features in a Google Colab notebook.
Introduction to the concept of a computer notebook.
Executing Python code in a Colab notebook.
Introduction to the markup language Markdown.
How to write Markdown code in a Colab notebook.
How to write LaTeX code in a Colab notebook.
How to install external packages in a Colab notebook.
How to work with files via Google Drive in a Colab notebook.
How to work with files via Python code in a Colab notebook.
How to share files with other users.
Introduction to the concept of version control with Git and GitHub.
How to facilitate version control with a Colab notebooks.
How to create a tensor object in PyTorch.
How to apply operations on tensor objects in PyTorch.
Introduction to Graphical Processing Units and why they can be used in deep learning.
How to utilize the free GPU provided in each Colab notebook.
Various limitations that the free GPU has.
Introduction to neural networks.
Gradients and how neural networks learn.
How to facilitate automatic differentiation in PyTorch.
How to train a PyTorch model from scratch.
How to save a trained model and load it back in a Python program.
Introduction to a sample curve-fitting problem.
Discussion of potential solutions to the curve-fitting problem.
How to download a built-in dataset with PyTorch.
Introduction to API provided by PyTorch datasets.
The procedure of loading a custom dataset into Google Colab.
The procedure of building a custom PyTorch dataset.
Introduction to image augmentation methods.
How to utilize PyTorch’s API to facilitate image augmentation.
How to import in the dataset used for this project.
Exploration of various characteristics of the dataset.
The design of a starting neural network to recognize handwritten digits.
The process of training and evaluating deep learning models.
The intuition behind choosing the size of input and output layers of a neural network.
The intuition behind choosing the size of hidden layers of a neural network.
Discussion regarding and comparisons between loss functions.
Discussion regarding activation functions and weight initialization to avoid the vanishing gradient problem.
Discussion regarding and comparisons between optimizers.
How to import in the dataset used for this project.
Exploration of various characteristics of the dataset.
Explanation of the practice of transfer learning.
Detailed procedure of a transfer learning workflow.
The process of training and evaluating deep learning models.
Discussion regarding and comparisons between pretrained models provided in PyTorch.
How to import in the dataset used for this project.
Exploration of various characteristics of the dataset.
Introduction of convolutional neural networks and the problems they try to address.
The procedure of implementing a convolutional neural network in PyTorch.
Introduction of residual neural networks and the problems they try to address.
Discussions regarding and comparisons between different residual blocks.
The procedure of implementing a residual neural network in PyTorch.
Introduction to the concept of ensembling in general machine learning.
Unique methods of ensembling in deep learning with neural networks.
Introduction to data version in deep learning and why it is important.
Introduction to reproducibility in deep learning and why it is important.
Discussions of various situations where deep learning is not desirable.
This course covers the general workflow of a deep learning project, implemented using PyTorch in Google Colab. At the end of the course, students will be proficient at using Google Colab as well as PyTorch in their own projects. Students will also learn about the theoretical foundations for various deep learning models and techniques, as well as how to implement them using PyTorch. Finally, the course ends by offering an overview on general deep learning and how to think about problems in the field; students will gain a high-level understanding of the role deep learning plays in the field of AI.
Learn how to utilize Google Colab as an online computing platform in deep learning projects, including running Python code, using a free GPU, and working with external files and folders
Understand the general workflow of a deep learning project
Examine the various APIs (datasets, modeling, training) PyTorch offers to facilitate deep learning
Learn about the theoretical basis for various deep learning models such as convolutional networks or residual networks and what problems they address
Gain an overview understanding of deep learning in the context of the artificial intelligence field and its best practices