Task Description:

Integrating the concepts of

User authentication has been provided:

The architecture includes-
- Webserver configured on EC2 Instance
- Document Root(/var/www/html) made persistent by mounting on EBS Block Device.
- Static objects used in code such as pictures stored in S3
- Setting up Content Delivery Network using CloudFront and using the origin domain as S3 bucket.
- Finally place the Cloud Front URL on the webapp code for security and low latency.

Step 1: Launch an instance in AWS

General command:

aws ec2 run-instances --image-id <value> --instance-type <value> --key-name <value> --subnet-id <value> --count <value> --security-group-ids <value> --tag-specifications <value>

🔰The Apache Hadoop🔰

The Apache Hadoop software is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models.

It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.

🔰The Hadoop architecture:🔰


❗❗ Basic knowledge of Logical Volume Management (LVM)

❗❗ Basic knowledge about Hadoop


Here, I have used 2 RHEL8 systems and configured one system as a MasterNode or NameNode and another system as a DataNode .

Let me describe how you can provide elasticity to DataNode storage , i.e, increase/decrease the storage capacity on the fly by using the concept of Logical Volume Management (LVM)

Step 1 : Attaching hard-disks to datanode storage

Add 2 hard disks to the system you have configured as a datanode

Let’s see the routing table using the command:

route -n

We see that there is a rule in the routing table for destination which means that your system can reach any other system

Configuring Apache HTTP Server in a docker container:

🔰 Step 1 🔰

Install docker in your system and start docker services

🔰 Step 2 🔰

Pull an image from dockerhub using the command

docker pull <image_name>:<version>

Here, I am using the latest version of centos image

Jenkins is a free and open source automation server . It helps automate the parts of software development related to building, testing, and deploying, facilitating continuous integration and continuous delivery.

Jenkins can be installed through native system packages, Docker, or even run standalone by any machine with a Java Runtime Environment (JRE) installed.

It is used to continuously build and test software projects, enabling developers to set up a CI/CD environment. It also supports version control tools like Subversion, Git, Mercurial, and Maven.

Let’s take a look at some of the main scenarios Jenkins plays a critical part in :

What is Ansible?

Ansible is a simple IT automation platform that makes your applications and systems easier to deploy and maintain.

✔ Ansible is a software provisioning, configuration management, and application deployment tool.

👀Lets see how Microsoft is solving challenges using Ansible 👀:


The AWS Command Line Interface (CLI) is a unified tool that manages the AWS services for you.

AWS CLI gives you the ability to automate the entire process of controlling and managing AWS services through scripts. These scripts make it easy for users to fully automate cloud infrastructure.

Let’s perform the following using AWS CLI

1.) Create a key pair
2.) Create a security group
3.) Launch an instance using the above created key pair and security group.
4.) Create an EBS volume of 2 GB.
5.) The final step is to attach the above created EBS volume to the instance you created in the previous steps.

Using aws help command, we can create our customized commands

Step 1: Create an IAM user through your AWS account and give programmatic access

Vijaya Madhuri T A

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store