ABSTRACT

We live in on-demand, on-command Digital universe with data prolife ringby Institutions, Individuals and Machines at a very high rate. This data is categories as “Big Data” due to its sheer Volume, Variety, Velocity and Veracit.

Approximately 90 % of the world’s data has been generated in the last two years alone. In addition, 80 % of the data is unstructured or available in a broad variety of frameworks that are difficult to interpret.Having such a vast volume of data is a major challenge and a more an important challenge arises from the fact that this data is not of…

Hi there! Today we are going to see some of the internals of Hadoop and how it actually works behind the scenes.So let’s get right into it.

What is Hadoop?

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. …

Hi there! Today we are going to see how we can resize the size of a Linux partition without loosing data i.e. persistence.

This is rather easy if you already know how to create partitions in Linux.Now then let’s get started.

First of all let me make new partition of size 5Gib using fdisk utility.

Hi there ! Today we are going to see a Command Line based interactive menu created by me and my team as part of Team Task under ARTH Initiative.So let’s get started.

First let’s look at our github repository

Abstract

As we are getting more and more dependent on technology, we also expose ourselves to all kinds of online threats.It has now become necessary to adopt countermeasures against cyber-attacks that are becoming more sophisticated as the years pass. Since the first confirmed attack in 2002, targeted attacks have inflicted significant damage in a number of countries around the world. In 2013, a new threat arose with the proliferation of ransomware. Attack methods have become more varied and are now specifically individualized according to targets, while the sophistication of incubation and evidence removal continues to evolve.

To combat these attacks, artificial…

Hi there ! So today we are going to see how we can contribute limited/specific amount of storage from a datanode to hadoop namenode.This is pretty simple task if you know how to make partitions.

So lets get into it.I used :

• Local VM as one datanode
• ec2 instance as another datanode
• ec2 instance as master or namenode

So lets see how its done first i added and 12 Gib addition hardisk to my local VM and then i created partition of 2 Gib in it and formated it and mounted to a folder.

Today we are going to see some basic AWS CLI and how to setup and run commands using CLI.

AWS CLI

The AWS Command Line Interface (CLI) is a unified tool to manage your AWS services. With just one tool to download and configure, you can control multiple AWS services from the command line and automate them through scripts.

Setup

First step is to download the CLIV2 from aws and just install it simply.Then we need to make an IAM with proper access.

Here how to create IAM :

• First go to IAM section then to users section and click “add user”
• Next…

Ansible is an open-source automation tool, or platform, used for IT tasks such as configuration management, application deployment, intra service orchestration, and provisioning.

Today we are going to create load balancer + web servers infrastructure with the help of ansible. We will use the AWS cloud to provision our load balancer and webservers in ec2.

First, we write a role for launching webserver and load balancer.

1. Role for Web server :