Master in DevOps Engineering

Infrastructure Setup

• EC2 Walkthroug
• Installation of DevOps Tools in the Cloud
  • Git
  • Docker
  • Selenium
  • Jenkins
  • Puppet
  • Ansible
  • Kubernetes

Overview of DevOps: In this module you will be introduced tDevOps environment.

• Why DevOps
• What is DevOps
• DevOps Market Trends
• DevOps Engineer Skills
• DevOps Delivery Pipeline
• DevOps Ecosystem

Module 3: Introduction tDevOps on Cloud:

• Why Cloud
• Introduction tCloud Computing
• Why DevOps on Cloud
• Introduction tAWS
• Various AWS Services
• DevOps using AWS

Version Control with Git

• What is Version Control
• What is Git
• Why Git for your Organization
• Install Git
• Common Commands in Git
• Working with Remote Repositories

Git, Jenkins & Maven Integration

• Branching and Merging in Git
• Git Workflows
• Git Cheat Sheet
• What is CI
• Why CI is Required
• Introduction tJenkins (With Architecture)
• Introduction tMaven
• Branching and Merging, Stashing, Rebasing, Reverting and Resetting
• Build and Automation of Test using Jenkins and Maven

Containerization Overview

• Containerization
• History of Containers
• Namespaces and C Groups
• Containers vs Virtual Machines
• Types of Containers
• Introduction to Docker
• Docker Architecture
• Container Lifecycle
• Docker CE vs Docker EE

The Docker Engine

• Docker Engine
  • Setting up Docker Engine
  • Upgrading Docker Engine
• Setting up logging drivers in Docker
• Configuring Logging Drivers
• Docker Terminology
• Port Binding
• Detached vs Foreground Mode
• Starting Containers in different modes
• Docker CLI Commands
• Docker Exec Commands
• Restart Policy in Docker
• Removing Containers

Image Management & Registry

• Docker-file
• Write a Docker-file to create an Image
• Docker-file Instructions
• Docker Registry
• Configuring Local Registry
• Build Context
• Docker Image Tags
• Setting up Docker Hub
• Removing Images from the Registry

Storage in Docker

• Docker Storage
• Types of Persistent Storage
• Volumes
• Bind Mounts
• TMPFs Mount
• Storage Drivers
• Device Mapper
• Docker Clean Up

Orchestration in Docker

• Docker Compose
• Deploy a Multi-container Application using Compose
• Docker Swarm
• Running Docker in Swarm mode
• Docker Service
• Deploying a Service in Swarm
• Service Placement
• Scale Services
• Rolling Update and Rollback
• Docker Stack

Networking and Security

• Docker Networking
• Network Drivers
• Bridge Network
• Overlay Network
• Host and Macvlan
• Docker Security
• Docker Content Trust
• Securing the Docker Daemon
• Create and use a User-defined Bridge Network
• Create and use an Overlay Network
• Use Host and Macvlan Network
• Configure Docker to use External DNS
• Signing images using DCT

Docker EE and Monitoring

• Docker Enterprise
• Universal Control Plane (UCP)
• UCP Architecture
• Access Control in UCP
• Docker Trusted Registry (DTR)
• Monitoring using Prometheus

Docker with Kubernetes

• Kubernetes Core Concepts
• Setup Kubernetes cluster using GKE
• Kubernetes Common Commands
• Pods - Deploy a Pod
• Deployments - Use a Deployment for pod management
• Labels, Selectors, and Annotations
• Services - Deploy different Services
• Persistent Volumes and Persistent Volume Claims
• Use Persistent Storage in Kubernetes
• Storage Classes
• Use Storage Classes

Docker with Microservices

• What are Microservices
• Understanding Microservices and Docket together
• Using Docker for Microservices
• Advantages of using Docker for Microservices
• Design Microservices Architecture with Docker Containers
• Extending the Architecture of a Microservices-Based App with Docker

Kubernetes Core Concepts and Networking

• Kubernetes Fundamentals
  • Kubernetes Core Concepts
  • Kubectl common commands
  • Understanding Pods
  • Configure network on cluster nodes
  • Pod Networking Concepts
  • Setting up a cluster - Kubernetes Certificates
• Practical Assignment:
  • Perform basic Kubectl commands
  • Deploy pods and use INIT containers to pre-set an environment
  • Configure Kubernetes network using Calico
  • Use certificates to authenticate resources

Kubernetes Services and Scheduling

• Services and Controllers
• Service Networking
• Deploy different kinds of services
• Deploy and configure network Load Balancer
• Primitives necessary for self-healing apps
• Effects of resource limiting on pod scheduling
• Configure Kubernetes Scheduler
• Running multiple Schedulers

Kubernetes Controllers

• Replica Set and Replication Controller
• Deploy different Replication Controllers
• About Daemon Sets
• Use Daemon Sets on nodes
• Deployments
• Manage pod updates using Deployments
• Rolling updates and Rollbacks
• Scaling applications and Ingress
• Use HPA for dynamic work-load management
• Use Ingress controller and rules to manage network traffic

Persistent Storage in Kubernetes

• Persistence Storage Overview
  • Persistent Volume and Persistent Volume Claim
  • Access modes for volumes
  • Primitives for Persistent Volume Claim
  • Secrets and Config Maps in your pods
  • Storage classes
  • Headless services
  • Stateful Sets
• Lab Work:
  • Deploy Persistent Volume and Persistent Volume Claim
  • Use Secrets and Config Maps in your applications
  • Use Storage Class for dynamic storage allocation
  • Use stateful applications for sticky identities for pods
  • Deploy a highly available replicated MariaDB cluster

Securing Clusters

• Basic Concepts:
  • Authentication
  • Authorization
  • Kubernetes security primitives
  • Configure Network Policies
  • Security Contexts
• Lab Work:
  • Create and use Roles and Role Bindings
  • Define custom Egress and Ingress policies
  • Use probes and configure a restart policy for pods
  • Define privilege and access control using security contexts

Logging & Monitoring Clusters

• Monitor cluster using Prometheus
• Visualize logs using EFK stack
• Deploy jobs to run tasks to completion
• Manage etcd cluster
• Use Helm Charts

Troubleshooting Clusters

• Troubleshooting application failures
• Troubleshooting cluster failures

Introduction To CI/CD

• Lesson Introduction
• Traditional Software Development
• Continuous Integration
• Continuous Delivery
• Continuous Deployment
• Building the continuous deployment process
• Automated Deployment Pipeline
• CI/CD Tool Selection

Getting Started with Jenkins

• Lesson Introduction
• Setting Up Git
• Assisted Practice: Git Set-up
• Setting Up Jenkins
• Assisted Practice: Jenkins Set-up
• Maven Set-up
• Assisted Practice: Maven Set-up
• Exploring Jenkins
• Assisted Practice: Build a Maven Project
• Building a Maven Project with Jenkins

Build Jobs and Configurations

• Lesson Introduction
• Understanding Jenkins Build Jobs
• Freestyle Build Jobs
• Assisted Practice: Freestyle Job
• Build Triggers
• Assisted Practice: Scheduled Builds
• Assisted Practice: Polling SCM
• Build Steps
• Jenkins Environment Variables
• Post-build Actions
• Assisted Practice: Post-build Actions
• Using Jenkins with Other Languages
• Assisted Practice: Building Projects with Gradle
• Parameterized Build Jobs
• Assisted Practice: Parameterized Builds
• Assisted Practice: Building From Tags
• Assisted Practice: Remote Triggering Parameterized Builds
• Enabling Security in Jenkins
• Assisted Practice: Enabling Security
• Build Pipelines and Promotions
• Triggering Parameterized Builds

Configuring Build Pipelines

• Lesson Introduction
• Introducing Pipelines
• Understanding Pipeline Structure
• Defining a Pipeline
• Declarative Pipeline Syntax
• Scripted Pipeline Syntax
• Assisted Practice: Building Pipelines In Jenkins
• Building a Pipeline
• Continuous Integration Pipeline
• Assisted Practice: Building Continuous Integration Pipelines in Jenkins File
• Building Pipelines from Jenkinsfile
• Assisted Practice: Building Continuous Integration Pipelines in Jenkinsfile
• Snippet Generator
• Unassisted Practice: Snippet Generator
• Global Variable Reference
• Declarative Directive Generator
• Unassisted Practice: Restarting Pipelines
• Multistage Pipeline

Automated Testing in Jenkins

• Jenkins as an Automation Testing tool
• Assisted Practice: CI with Junit in Jenkins
• Code Coverage using Jacoco
• Assisted Practice: Code Coverage with Jacoco
• Code Coverage using Clover
• Assisted Practice: Code Coverage with Clover
• Acceptance and Performance Tests in Jenkins
• Assisted Practice: Integrate JMeter with Jenkins
• Testing Code Coverage

Code Quality Improvement Using Jenkins

• Code Quality and Jenkins
• Internals of Jenkins Jobs
• Assisted Practice: Find Bugs Integration with Jenkins
• Code Complexity
• Assisted Practice: Coverage Complexity with Jenkins
• Open Tasks & Sonar Qube
• Assisted Practice: Sonar Qube with Jenkins
• Static Code Analysis

Automated Deployment and Continuous Delivery

• Introduction to Automated Deployment and Continuous Delivery
• Building the Continuous Delivery Process
• Implementing Automated and Continuous Deployment
• Assisted Practice: Deploying a Python Application
• Assisted Practice: Tomcat and Jenkins
• Assisted Practice: PHP and Jenkins
• Deploying Maven App to Tomcat Server

Distributed System in Jenkins

• Introduction to Distributed Architecture
• Assisted Practice: Create Multiple Slave Nodes
• Deep Diving Jenkins Master/Slave Architecture
• Assisted Practice: Assigning Jobs to Specific Slave Nodes
• Distributed Builds

Introduction to Ansible

• Evolution of Infrastructure
• Overview of Infrastructure as a Code
• What is Configuration Management
• Ansible Overview

Ansible Architecture & Installation

• Ansible Architecture and its working
• Ansible in DevOps
• Installation and Configuration
• Working with Command Line Tools

The Playbook Grammar

• Playbook YAML definition
• Playbook terms
• Playbook tasks

Writing Ansible Playbooks

• Hosts and Users
• Variables
• Tasks
• Handlers
• Jinja2 Templates

Ansible Modules

• Overview of Modules
• Types of Modules
• Core Modules
• Extras Modules
• Return Values
• Adhoc Commands
• Case Study

Ansible Roles

• Overview of Roles
• Role Directory Structure
• Using Roles
• Working with Ansible Galaxy

Ansible Tower

• Installing Ansible Tower
• Features of Ansible Tower
• Managing Jobs
• Manage and Track Inventory
• Remote Command Execution
• Case Study

Getting Started & Setting Up Labs

• Choosing a right Infrastructure as Code Tool
• Installing Terraform - Windows Users
• Installing Terraform ? Mac OS and Linux Users
• Choosing Right IDE for Terraform IAC development
• Setting up AWS account

Deploying Infrastructure with Terraform

• Creating first EC2 instance with Terraform
• Understanding Resources & Providers
• Destroying Infrastructure with Terraform
• Understanding Terraform State files
• Understanding Desired & Current States
• Challenges with the current state on computed values
• Terraform Provider Versioning
• Types of Terraform Providers

Read, Generate, Modify Configurations

• Understanding Attributes and Output Values in Terraform
• Referencing Cross-Account Resource Attributes
• Terraform Variables
• Approaches for Variable Assignment
• Data Types for Variables
• Fetching Data from Maps and List in Variable
• Count and Count Index
• Conditional Expressions
• Local Values
• Terraform Functions
• Data Sources
• Debugging in Terraform
• Terraform Format
• Validating Terraform
• Configuration Files
• Load Order & Semantics
• Dynamic Blocks
• Tainting Resources
• Splat Expressions
• Terraform Graph
• Saving Terraform Plan to File

Terraform Provisioners

• Understanding Provisioners in Terraform
• Types of Provisioners
• Implementing remote-exec provisioners
• Implementing local-exec provisioners

Terraform Modules & Workspaces

• Understanding DRY principle
• Implementing EC2 module with Terraform
• Variables and Terraform Modules Terraform Registry
• Terraform Workspace
• Implementing Terraform Workspace

Remote State Management

• Integrating with GIT for team management
• Security Challenges in Commiting TFState to GIT
• Remote State Management with Terraform
• Implementing S3 Backend
• Challenges with State File locking
• Integrating DynamoDB with S3 for state locking
• Terraform State Management
• Importing Existing Resources with Terraform Import

Security Primer

• Handling Access & Secret Keys the Right Way in Providers
• Terraform Provider Use Case - Resources in Multiple Regions
• Handling Multiple AWS Profiles with Terraform Providers
• Terraform & Assume Role with AWS STS
• Sensitive Parameter

Introduction to Puppet

Puppet Installation

Puppet Configuration

Puppet Master and Agent Setup

Puppet Module

Node Classification

Puppet Environment

Puppet Classes

Automation & Reporting

Install and Configure Puppet

Configure and Implement Servers using Puppet

Introduction to Continuous Monitoring

Introduction to Nagios

Installing Nagios

Nagios Plugins(NRPE) and Objects

Nagios Commands and Notification

Installing Nagios

Monitoring of different servers using Nagios