
Explore a two-table NYC city bike trips and stations dataset in BigQuery, preview schemas, join on station id, and use saved queries to re-run analyses.
Export query results from BigQuery by saving to csv, adjacent file, BigQuery table, Google Sheets, or the clipboard, then tailor data size to storage needs.
Explore how to use the group by clause in BigQuery to count rows by groups, such as is renting true and is renting false, and by is returning and capacity.
Explore joining Citibank stations with Citibank trips in BigQuery, selecting station id, name, capacity, and trip attributes like user type and start and stop times.
Round the average capacity to two decimal places in a select statement using the round function, illustrating nested functions on capacity calculations.
Master date and time functions in BigQuery by extracting year, month, and day, using order by last reported dates, and adding or subtracting days from date time values.
Learn to manipulate strings in Google Cloud BigQuery using the contains substring function, the substring function, and the concatenate operator to derive booleans, create derived names, and format station IDs.
Install and configure the Google Cloud SDK from the command line to access gcloud and bq commands for BigQuery, and use chips util for data transfer.
Learn to upload data to Google Cloud Storage using gsutil: copy single files or recursive directories, authenticate with gcloud init, and verify uploads with gsutil ls or the cloud console.
BigQuery uses a decoupled storage and compute architecture, built on Colossus and Spanner, with Dremel executing SQL via Borg across a multitenant cluster on a fast Jupiter network.
Explore BigQuery's capacitor columnar storage, which efficiently handles semi-structured data with nested and repeated fields and low cardinality, delivering fast reads and strong compression for analytics.
Partitioning splits large BigQuery tables into partitions to boost performance and lower scan costs; explore ingestion time, date timestamp, and integer range partitioning, plus partition filters.
Leverage clustering in BigQuery to sort data by one or more columns, speeding up aggregate queries and reducing the data scanned as new data is automatically reclustered.
BigQuery is a popular data warehouse service that allows you to easily work with petabytes of data. Learn how to quickly get up to speed with BigQuery and start querying and analyzing data efficiently using the BigQuery graphical user interface, command line utilities, and even programming languages. If you are familiar with basic database concepts, like tables, you are ready to start learning one of the most important data analytics platforms available.
While some courses will focus just on using SQL with BigQuery, this course starts with the basics of signing up for Google Cloud and working the BigQuery graphical user interface (GUI), introduces SQL for BigQuery, and then moves to loading data and working with BigQuery using the command line and Python. Perhaps most importantly, you will learn how BigQuery is different from other databases and how to use that knowledge to use BigQuery efficiently and cost effectively.
You will learn how to explore data, tables, and datasets. Write queries efficiently using BigQuery hints and formatting helps. Work with SELECT statements, including creating FROM, WHERE, GROUP BY, HAVING, and ORDER BY clauses to create queries that answer driving questions you have about your data. If you are not familiar with working with multiple tables and using joins, that's no problem, you will learn that in this course.
Use features of BigQuery designed to make you more productive, like Saved Queries, Exporting Data, and Execution Details that help you improve the performance of your queries.
Learn how to create tables and data sets and load data into BigQuery directly and by using Cloud Storage, Google Cloud's large scale object storage system.
While the graphical user interface, known as the BigQuery console, is an excellent tool for interactive work with BigQuery, sometimes we need to run the same queries or operations repeatedly to generate reports or download data. In this course you will learn about the bq command line utility that lets you query data and work with datasets from the command line. If you prefer to work with Python or other programming languages, you can use the BigQuery client libraries for running queries and other jobs right from your programs and scripts. You don't even need to have Python installed on your device because we'll use CoLab, a free Google service for working with Python notebooks.
Quizzes and assignments in this course allow you to check your understanding as you progress through the course by answering questions and writing queries.
To use BigQuery effectively though, you need to understand how BigQuery is designed. Building a data warehouse and designing data models in BigQuery is fundamentally different than building and modeling in relational databases like Oracle, SQL Server and PostgreSQL. In this course, you will learn about BigQuery's architecture and how it influences how we structure and query data.
Learn insights from an instructor with decades of experience in working with data. Dan Sullivan is a Principal Data Architect and author of books and numerous articles on databases and Google Cloud. Dan is the author the Official Google Cloud Professional Data Engineer Study Guide as well as study guides for the Google Cloud Professional Cloud Architect and Associate Cloud Engineer certifications. He has developed courses for Google Cloud, data modeling, data science, exploratory data analysis, machine learning, DevOps, and more. His courses can be found on Udemy and LinkedIn Learning.