Data Engineering with Google BigQuery & Google Cloud
What you'll learn
- Google BigQuery Introduction
- Building data pipeline using Google BigQuery from various sources (file, database, API, message broker)
- Various techniques & tools for loading data into Google BigQuery
- Overview of data cleansing & preparation
- Overview of data visualization using Google Sheets & Data Studio
Requirements
- Familiar with basic SQL (e.g. SELECT, FROM, WHERE, GROUP BY, HAVING, ORDER BY)
- Have a Google account
Description
A data warehouse is a repository of historical data that is queried to answer questions, gain insight from data, and make business decisions. BigQuery is Google’s product for data warehouse. It is designed to store and query terabytes, even petabytes of data without we need to setup and manage any infrastructure. It is not a transactional database for day-to-day operation.
BigQuery supports standard SQL, so if you ever develop with relational database like Oracle, PostgreSQL, MySQL, Microsoft SQL Server, etc, it is easy to familiarize yourself with BigQuery. There are a few BigQuery functions to support modern-day requirements, and learning about them will make your job easier.
There is no infrastructure required. We don’t need to worry about the size of storage, number of processors, or memory allocation for processing query. BigQuery scales automatically to run query, and then release the resource when it is done. We don't even charged for memory or processor allocation.
Google provides sample database for practice and trial.
This course has several topics:
an introduction, where we will see what this course about
what is data warehouse and in which part BigQuery take roles
how we can create a simple data pipeline, including data input, data cleansing, and data visualization
tools and methods that can be used for data engineering, particularly on data ingestion from various sources to BigQuery
data visualization using Google Sheets & Data Studio
This course is for people with basic technical knowledge on SQL.
This course is not basic SQL course, so we will not learn the meaning of basic sql such as SELECT, FROM, WHERE, GROUP BY, ORDER BY
See the preview video Technology in This Course for SQL keyword that we will not discuss on detail
However, we will still learn some of modern SQL syntax that can be used in BigQuery
In this course we will also learn how to fetch data from several sources, so this is a good course if you are an engineer that responsible for creating data pipeline.
Who this course is for:
- Software engineers, data analyst, everyone who interested on data engineering
- Technical architect that want to know how Google platform can fit into overall data & application architecture
Instructor
![Timotius Pamungkas](data:image/svg+xml,%3Csvg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64"%3E%3C/svg%3E){kind=avatar}
- 4.4 Instructor Rating
- 1,813 Reviews
- 15,038 Students
- 10 Courses
Timotius Pamungkas came from small Indonesian city but now working on it's capital : Jakarta. He's been in software engineering job for years. His first job was in the large consumer finance in Indonesia. Then he took a role as Engineering Manager on Indonesian unicorn. Few moments after, he moved back to another large Indonesian consumer finance and take a role on Engineering & Architect Head.
Taking the role as Head, he get more time to coach his team members about software engineering practice.
With more than 5 years experience as Java developer, and for the last few years handle enterprise complexity as Engineering Manager & Enterprise Architect, he will be glad to deliver high quality courses containing information of various technologies and software architecture design skills that he has acquired through his professional experience.
His goal is to deliver courses that not only good in theory, but also applicable in real-life use cases. His courses give the concept, and the hand-coding experience. He will also provide various resources, including source code to hands-on coding.
Other than his daily job, I also like researching new tech and get his hands into keyboard for writing codes. But he does like share what he learnt. His first teaching experience was back years ago when he was still in the college and teach juniors about algorithm. Some says he is a natural teacher, and he hope that he can share his knowledge by publishing courses into Udemy.