Databricks Essentials for Spark Developers (Azure and AWS)
What you'll learn
- Using Community Edition of Databricks to explore the platform
- Signing up for Full Trial using Azure Databricks
- Signing up for Full Trial using Databricks on AWS
- Develop and Deploy Notebooks using Scala, Python as well as SQL using Databricks Platform
- Understand the difference between interactive and job clusters
- Formal Development and Deployment Life Cycle
- Run jobs by attaching application as jar along with libraries
- Overview of Cluster Pools
- Installing and using databricks-cli
Requirements
- Laptop with decent configuration
- Knowledge of Apache Spark is highly desired
Description
Are you an experienced Spark Developer and want to understand about Databricks platform?
Conventionally we used to work on Data Engineering with clusters built using distributions. However, with cloud if we can separate storage from compute and leverage pay as you go model, the costs of infrastructure for Big Data Clusters can go down significantly.
Databricks is one such Cloud Choice!!!
As part of this course, you will be learning the essentials of Databricks Essentials.
Understand different editions such as Community, Databricks (AWS) and Azure Databricks
Signing up for community edition
Uploading data to DBFS
Developing using Databricks Notebook with Scala, Python as well as Spark SQL
Development Life Cycle using Scala with IntelliJ as IDE
Configuring jobs using Jar files
and many more
Who this course is for:
- Data Engineers who have good knowledge of Apache Spark using Scala or Python or Spark SQL
- Data Scientists with working knowledge of Apache Spark
- IT Aspirants who want to get started with Apache Spark on Cloud
Instructors
- 4.4 Instructor Rating
- 9,712 Reviews
- 233,168 Students
- 14 Courses
13+ years of experience in executing complex projects using vast array of technologies including Big Data and Cloud.
ITVersity, Inc. - a US based organization to provide quality training for IT professionals and we have the track record of training hundreds of thousands of professionals globally.
Building IT career for people with required tools such as high quality material, labs, live support etc to upskill and cross skill is paramount for our organization.
At this time our training offerings are focused on following areas:
* Application Development using Python and SQL
* Big Data and Business Intelligence
* Cloud
* Datawarehousing, Databases
- 4.4 Instructor Rating
- 6,104 Reviews
- 43,119 Students
- 7 Courses