Hands-On Data Engineering in Google Cloud Platform | Python
What you'll learn
- Extract and load data from local machine to Cloud Storage and Pub/Sub.
- Setup and use database such as Cloud SQL, BigQuery and Bigtable.
- Transform data using Google Cloud Functions, Dataflow and Dataproc.
- Implement real life end-to-end solutions by combining latest available tools in Google Cloud Platform.
Requirements
- Basic Python, docker and bash knowledge. Detailed steps will be provided in both video and self-written articles by author, so no worries if you are a totally beginner!
- Sign up for 90-day $300 Google Cloud Free Trial - credit card/payment method required. Google won't charge you unless you explicitly upgrade from your free trial to a paid account, so no worries!
- Stable internet connection to watch all the non-stop live demos in 1080p!
Description
You are going to learn about how we can create data engineering solutions in Google Cloud Platform (GCP) using different available tools, mainly using Python as our core programming language. We will start from basic introduction of what each component is mainly used for, then dive straight into demos with detailed explanation on the design choice and reasonings behind. I am confident that you will come out of the course with a better understanding on what each component could possibly do and drive data engineering solutions in your team!
There are the list of tech stacks that we will be covering
Integrating with GCP
Google Cloud Platform Console, Cloud SDK and Client Libraries
Data Storage/ Messaging
Google Cloud Storage, Google Pub/Sub
Databases
Cloud SQL, BigQuery, Bigtable
Data Processing
Cloud Functions, Cloud Dataflow, Cloud Dataproc
I have created a few specialised labs to integrate all the tools mentioned above instead of telling you what each component could do! It could help to accelerate your understanding so you can apply on your existing GCP workflow immediately. Detailed code and steps will also be shared in the video as well as self-written articles, so just sit back, relax and enjoy all the demos!
Let's get onboard on the cloud journey now!
Who this course is for:
- Python developers curious about quick overview and offerings of data engineering solutions in Google Cloud Platform.
- Individuals who prefer step-by-step hands-on experience instead of dry knowledge classes.
- Existing data engineers who are interested to migrate on-premise solutions to Google Cloud Platform.
- People who just started to adopt Google Cloud Platform in their existing workflows and want to get a quick head-start on where to begin.
Instructor
- 4.2 Instructor Rating
- 137 Reviews
- 1,416 Students
- 1 Course
Hello,
I'm Chenming Yong and currently working as a Senior Engineer for the biggest semiconductor manufacturing company in Singapore. I specialise in building big data pipeline architecture and productionizing data science use cases. Currently actively involved in migration and integration of on premise solutions (Hadoop) with cloud infrastructures (GCP, AWS, Azure, Openshift). I lead various technical projects and am involved in actual development as well as reviewing overall technical architecture developed by my team members. Besides that, I also conduct a lot of coaching sessions for new hires and worldwide team members (e.g. US, India, China, Taiwan, Singapore and Japan) on various job-related technical topics such as development, integration, monitoring, deployment and support.
I also hold professional certificates such as Google Cloud Certified Professional Cloud Architect, Google Cloud Certified Professional Data Engineer and AWS Certified Cloud Practitioner to further improve my skillsets.
I hope my professional work experience as well my passion in cloud engineering will be able to solve some of the issues you are facing!
Have a great one!