
Prepare for the Databricks associate developer certification exam on Spark 3.0 by exploring architectural concepts and dataframe API methods using two live datasets, with end-of-module practice sessions.
Learn to create and use a spark session as the unified entry point, access spark APIs, and build dataframes and tables in a local cluster notebook environment.
Explore reading csv data into a Spark dataframe with a Spark session, using schema inference, header options, and programmatic schema via a Row object, to compare load times and schemas.
Learn to manipulate Spark data frames using select, filter, withColumn, and selectExpr, computing metrics like author’s percentage, and understand lazy transformations with show, collect, head, take, and first.
Explore core aggregations in Spark DataFrames, including count, avg, mean, max, and sum, and learn grouping, distinct counts, and advanced functions like approx_count_distinct, describe, and drop.
Explore string processing with Spark: use split to divide strings by a slash or other delimiters, apply regex_replace to substitute patterns, and explode to turn arrays into separate rows.
Master sorting in spark by using order by and its variants, including ascending or descending, drop duplicates and distinct, and manage nulls with nulls first, selecting publisher name for statistics.
Join two dataframes on flow numbers to map flow names, using inner, outer, cross joins, and union, then populate a new column with a constant value using lit.
Learn to create and register Spark UDFs, including double sale price and lambda functions, and use them with dataframe and SQL to transform publisher data.
Databricks Certified Associate Developer Training course.
The Databricks certified associate developer for Apache Spark certification exam needs plenty of practice.This course has
Practice exercises on the go- A course laden with writing practice ,which can then be executed on the Databricks community edition.(over 60 coding questions)
Datasets on realtime events-Learning(Understand ) and practicing(Apply) the DataFrame APIs in python using two real time datasets.
All the DataFrame APIs most commonly tested in the Databricks certified associate developer exam are taught and explained with sample code which can be tried on Databricks Community Edition.
Architecture modules( commonly tested in the Databricks certified associate developer exam) have quiz that you can partake at the end of every module to reinforce the concepts learnt, on time, every time and anytime!!
Spark Architecture is taught with creative Visualisation for better retention.
What you will cherish in this course:
-interactive, as you write on the go,
-creative, to understand better the concepts of architecture.
-over 120 minutes of practice code.
-over 200 minutes of video lessions.
All this as a ready reckoner for all your learning needs for the Databricks Associate Developer Certification on spark 3.0 in python.
DataFrame API sessions on python on the following topic modules
SparkSession.
Dataframe writer,reader.
Select,filter,where,drop,dropduplicates.
SelectExpr,withColumn,take,first.
Aggregations ,Sort,groupby,orderby.
Date and time.
UDF including lambda.
Explode,split.
Persist,Cache,Unpersist.
Architecture concepts on
Modes of deployment -visual
Partition-visual
Spark UI
-Jobs,stage,tasks.
-wide and narrow transformations.
-physical logical plans,AQE,DPP.
-Data locality.
It's an honour to help you learn spark 3.0 specific to Databricks Associate Developer Certification exam.
Disclaimer: This course is created by Kanchana Selvakumar.This is not associated or affiliated with Databricks.