Apache Kafka Kafka is not just a pub-sub system. It’s an event streaming platform . It Collects, stores, and processes events in real time. Kafka Supports: Distributed Logging, Pub-Sub Messaging’ Stream Processing (via Kafka Streams, ksqlDB) Kafka helps build event-driven architectures, where systems react to changes as they occur, not via polling or batch jobs. Kafka tools: Kafka Connect, Kafka Streams, Schema […]
Namespaces- Organizing Components Default Namespaces In K8s we organize resources in Namespaces. We can have multiple Namespaces in Cluster. We can think of a namespace as a virtual cluster inside of a Kubernetes cluster. when We create a cluster, by default Kubernetes gives us namespaces out-of-the-box. Kube System namespace is not meant for Our use.We
POC1: Deploy Mongo, DB and Mongo Express I am going to deploy 2 applications, MongoDB and Mongo Express. So, first we will create a Mongo DB pod and to talk to that pod we need a service and We are going to create an internal service which means that no external requests are allowed to
YAML Config File Kubernetes configuration file which is the main tool for creating and configuring components in Kubernetes cluster. Three parts of a K8s Config File: Configuration file in Kubernetes has 3 parts the first part is where the metadata of that component . one of the metadata is obviously name of the component itself
Kubernetes Architecture and Kubectl Commands Node Processes (Worker Node) Worker servers, or Nodes, are one of the main components of the Kubernetes architecture. These cluster servers are where Kubernetes components (such as pods, services, ConfigMaps, secrets, ingress) run. Kubernetes manages worker nodes using three essential processes installed on every worker node. Container runtime Kubelet Kube
What is Kubernetes & Main Kubernetes Components Kubernetes Kubernetes is an open-Source container orchestration framework originally developed by Google. It facilitates the management of containerized applications across various environments, including physical machines, virtual machines, and the cloud. Automates deployment, scaling, and container management. This is most widely recognized container orchestration tool. Features of K8S Kubernetes
UNIT Testing Terraform We can write test cases for Terraform scripts, like how you write JUnit tests for Java. Here are the main approaches: 1. Using terraform plan & terraform apply with Assertions We can run terraform plan in a CI/CD pipeline and validate the expected changes using tools like grep, jq, or Terratest. 2.
Terraform Commands terraform plan: If want to see the difference between current and desired state and We don’t want to do terraform apply command. For that We can actually execute Terraform Plan command which is like a preview, same as what Terraform apply command gives We but without the actual applying it. terraform apply -auto-approve:
Remote State & Best Practices Configuring Remote Terraform State When working with Terraform in a team or integrating it into a CI/CD pipeline, multiple team members may execute Terraform commands, leading to state file inconsistencies. To avoid this, configuring remote Terraform state is essential. A remote backend, such as an S3 bucket, securely stores the
CI/CD with Terraform An end-to-end pipeline below stages a typical example will have Where Provision Server step Terraform, integration is required. To execute Terraform commands in Jenkins we need to do 4 steps install Terraform in Jenkins container. Prepare ssh key pair Write TF scripts Write a stage to execute terraform apply Create SSH Key