DevOps: CI/CD using Jenkins, Maven, Git, Sonar, OWASP, Trivy

Disclaimer

This course requires you to download and install the following software and tools before starting:

Prerequisites

1. AWS Account – A valid AWS account is required.

2. Java Development Kit (JDK)

   • Headless Amazon Corretto 11 (java-11-amazon-corretto-headless)

   • OpenJDK 11 (openjdk-11-jre-headless, openjdk-11-jdk-headless)

3. Apache Maven – Version 3.8.5 or the latest.

4. Git – Required for version control.

5. SonarQube – Version 9.3 or the latest.

6. Maven Repository Access – Must have access to maven repo website to build packages.

Additional Requirements for Amazon Linux (AWS)

If using an Amazon Linux machine on AWS, install the following packages:

• PostgreSQL 13

• Vim

• EPEL (Extra Packages for Enterprise Linux)

Other Required Tools

• Nexus Server

• Gradle Server

• Jenkins

• Ansible

Ensure all dependencies are installed before proceeding with the course for a smooth learning experience.

The entire DevOps course is based on AWS Environment.

In this course module, you will learn in addition to Jenkins, crossing technologies that go hand in hand with this service, such as Docker, AWS, Ansible, Git, Maven, Gradle, Pipelines, and many more!

Every section of this course has a different set of quizzes, and there is also many project lab assignment that will help you demonstrate what you have learned.

Project: Integration of Jenkins with Maven Tool

Project: CICD Process - Manual Approach Using Maven, SonarQube, Docker, AWS ECR.

Project: CI/CD Process Using Jenkins

Project: Continuous Deployment using Ansible Playbook

Project: Jenkins Master and Slave Server Configuration

Project: Hands-On DevOps Project: Deploy a Node.js Web App with Jenkins CI/CD

Introduction

• What are DevOps & benefits?

• DevOps LifeCycle :

  — Continuous Development

  — Continuous Integration

  — Continuous Testing

  — Continuous Feedback

  — Continuous Deployment

  — Continuous Monitoring

Linux for DevOps

• Create an AWS Account

• Create an EC2 Instance - Amazon Linux

• Create a key pair - Public & Private Key

• MobaXterm - Connect EC2 Instance

• Putty - Connect EC2 Instance

• Gitbash - Connect to EC2 Instance

• Create an EC2 Instance - Ubuntu

• Filter Instances

• Access Instance using User Name & Password (Without using Private key)

• More about private & public key

• Passwordless authentication from Linux to Ubuntu Server

• Lab - Access the Amazon Linux Instance other than the default user

• Lab - Access the Ubuntu Linux Instance other than the default user

• Lab - Passwordless Authentication between Amazon Linux & Ubuntu and Vice versa

Maven Tool

• Overview of Maven Tool

• Maven Lifecycle: Default, Clean & Site

• Repositories used in Maven

• Lab - Build the Springboot package in AWS Environment

• Lab: Location of Artifacts & built package dependencies

• Lab: Exploring pom.xml file

• Lab: Execute & access the package application

• Lab: Exploring dependencies of a built package

• Lab: Build Lifecycle

• Lab: Build a Web Application project using maven

• Lab: Build a Web Application project using maven

SonarQube tool in Continuous Integration

• About SonarQube tool & its features

• Installation of SonarQube

• Check SonarQube logs & configuration

• SonarQube Service & port

• Access SonarQube via URL

• Configure Maven (CI Server)

• Checkout & build the project using Maven

• Integrate Maven with SonarQube to check the code quality

• Add Sonar-maven-plugin

• Lab - Bad code detected by SonarQube

• Lab - Rectified the code & re-check by SonarQube

PostgreSQL Database for SonarQube

• About PostgreSQL Database

• Setup PostgreSQL Database with SonarQube

• Create Database, User, and Grant Privileges

• Sonarqube Configuration file sonar properties

• Troubleshooting PostgreSQL Database for SonarQube

Integration of Maven with Nexus Repositories

• Install & configure Nexus Server

• Configure Sonatype Nexus Repository Manager

• Configure CI Server to check out the project & Build the package

• Configure springboot maven nexus deploy

• Nexus Requirements in the pom.xml

• Define Nexus login credentials

• Deploy the Artifacts to Nexus Repository

Integration of Gradle with Nexus Repositories

• Installation of Nexus server

• Configuration of Gradle Server as CI

• Build the springboot tomcat project using gradle tool

• Add plugin in build.gradle

• Add Nexus repositories details in build.gradle

• Use if-else condition in build.gradle

• Add credentials in gradle properties

• Publish the project artifacts into Nexus Server

• Download the Artifacts using Continuous Deployment

Integrate Jenkins with Git & Maven project

• About Jenkins

• Overview of Jenkins integration with GitHub & how to build a java based project

• Installation of Jenkins, Java, Maven & Git on EC2 Instance

• Configure Jenkins on EC2 Instance

• Configure GitHub Credentials & Maven Location on Jenkins

• Create & Build the Java-based project using Maven Tool

• Add Maven Plugins in Jenkins

CI/CD Pipeline – Manual Implementation with Maven, SonarQube, Docker & AWS ECR

• CI/CD Process Explained: An Overview

• Setting Up a Build Server with Java, Git, Maven, and Docker

• Installing SonarQube on an Ubuntu Server

• Configure Sonar-Maven-Plugin

• Starting the SonarQube Service on Ubuntu

• Analyzing Code Quality with SonarQube

• Dockerfile Overview: Build Docker Images

• AWS ECR: Create a New Repo

• Create IAM Role to Allow CI Server Access to AWS ECR

• Build and Push Docker Image to AWS ECR

• Set Up a CD Server for Continuous Deployment

• Pull and Run Docker Image from AWS ECR on CD Server

• CI/CD Pipeline: Full Process Recap

CICD Process Using Jenkins

• Overview of CICD Process using Jenkins

• Install a Jenkins Server (CI Server)

• Add maven in Jenkins Server from Global Tool Configuration

• Create a Jenkins pipeline for Checkout & build the project

• Install SonarQube Server using Docker container

• Generate the token from SonarQube Server

• Add Sonar Login Credentials on Jenkins Server

• Install SonarQube Scanner plugins on Jenkins

• Add SonarQube on Jenkins Server

• Pipeline for SonarQube Scanner for Jenkins

• Pipeline for success or aborted due to quality gate failure

• Configure a webhook in your SonarQube Server

• Add stage in pipeline to create a Docker Image using DockerFile

• Create an IAM User to have access to AWS ECR and add it to Jenkins Server

• Add stage in pipeline to Push the Docker Image to AWS ECR

• Configure SES to send an email notification

• Integrate SES with Jenkins using pipeline

• Receive an Email Notification after the success or failure of Jenkins Pipeline

Continuous Deployment using Ansible Playbook

• Configure a CD Server using Ubuntu Server

• Ansible Setup on Jenkins Server

• Install packages on CD Server

• Create a Playbook to establish a connection from CD Server to AWS ECR

• Playbook to pull the image from ECR to CD Server

• Playbook to run the Container using the Docker Image

• Access the Springboot Application running on CD Server

Jenkins Master and Slave Server

• Overview of Jenkins master & slave server

• How does Jenkins Master and Slave Architecture work?

• Lab - Install Jenkins Master Server in AWS Environment

• Lab - Configure Jenkins Master Server

• Lab - Manager Nodes and Clouds

• Lab - Setting up Slaves with Jenkins Master

• Lab - Troubleshooting while adding a slave server

• Lab - Create a job for the Slave Using Freestyle project

• Lab - Create a job for Slave Using a pipeline project (Springboot Appl)

• Lab - Create a job for Slave Using a pipeline project (Springboot Appl)

• Configurations in slave machine

• Lab - Establish connectivity between Master & Slave Using SSH keys

• Lab - Launch agent on Slave Machine

• Lab - Create a job for building a Springboot project on Slave Machine

Hands-On DevOps Project: Deploy a Node.js Web App with Jenkins CI/CD

• Introduction

• Course Overview

Git Bash and GitHub

• Create a GitHub repository for a Bingo application

• Install Git Bash

• Clone the GitHub repository to your local system

• Generate a personal access token

• Push the source code to a GitHub repository

Set up the DevOps Environment on AWS

• Set up virtual machines for Jenkins and SonarQube servers

• Installation of Docker on a SonarQube server

• Authenticate to DockerHub from the SonarQube server

• Run SonarQube using Docker

• Access the SonarQube Server via the URL using port 9000

• Installation of Jenkins

• Access the Jenkins Server via the URL using port 8080

• Customize the Jenkins Server

Plugins required on the Jenkins server

• Required Plugins on Jenkins Server

Configure tools on the Jenkins server

• Configure JDK tool

• Configure SonarQube Scanner tool

• Configure Node.js tool

• Configure Dependency-Check tool

• Configure Docker tool

Set up a connection from Jenkins to the SonarQube server

• Set up a connection from Jenkins to the SonarQube server

• About Webhook

• Configure a webhook

• Add SonarQube Server

Jenkins CI/CD pipeline job to clean and check out the project

• Create a job to clean the workspace

• Add a stage in the pipeline to check out the project

SonarQube - Code quality tool for better code

• Add a stage to the pipeline for SonarQube analysis

• SonarQube Analysis command using `withSonarQubeEnv`

• Run the job and check the SonarQube report

• Add a stage WaitforQualityGate

• Run the job to verify the WaitforQualityGate

Install Node.js dependencies, use npm command

• Add a stage to Install Node.js dependencies

OWASP tool -Security testing tool

• Add a stage to perform OWASP scanning

• Explore the OWASP report

Trivy scanning tool

• Add a stage to perform trivy fs scanning

• Explore the trivy report

Build the Docker image and then push it to DockerHub

• About the Docker Build

• Add a stage to build the Docker image for a Node.js project

• Dockerfile for building the Docker image

• Run the job to verify the Docker Image

• Push the Docker Image to DockerHub

Trivy - Scanning on Docker Image

• Add a stage to scan the docker image

• Explore the trivy report

Deploy the Node.js web Application

• Add a stage to deploy the Docker Image/Node.js Project

• Access the Node.js web application through the URL

Domain Registration and SSL Certification

• Register a free domain

• Install nginx

• Modify the 'A' record DNS for the registered domain

• Install and obtain the SSL Certificate

• Last lecture