Hadoop , Docker , AWS Cloud, Ansible and LVM Automation using Python Program

What the World needs ?

The Answer to it is Automation

Here’s my Article on Automation using python . I create Menu program which can automate Hadoop , Docker , LVM , some services of AWS Cloud , Prediction automation using previous Data Set etc. Anyone can use this Menu Program without knowing the actual Linux command to set-up Hadoop cluster or Docker container or automating AWS cloud .

My Main Menu Consists of following:

LVM, Webserver, AWS, Docker, Partitions, Hadoop, Anisible and SSHPass

Main Menu

Further SubMenu are as follows :-

LVM:

In the LVM SubMenu we have following Option:

  • Format Drive
  • Mount Drive
  • Create Physical Volume
  • Create Volume Group
  • Create Logical Volume
  • Extend Logical Volume Size
  • Reduce Logical Volume Size
  • List Physical Volume
  • List Volume Groups
  • List Logical Volume
LVM Menu

Its Working

List Storage

WebServer:

  • Intalling Httpd Service
  • Starting Service
  • Stopping Service
  • Status of Service
WebServer Menu
Status WebServer

AWS Menu:

  • Create & Delete Key Pair
  • Create & Delete Security Group
  • Adding Ingress rules to existing Security group
  • Launch Instance
  • Created EBS volume
  • Attached EBS volume to Ec2 Instance
  • Configure WebServer
  • Create static partition and mount /var/www/html folder on EBS volume
  • Create S3 bucket accessible to public
  • Insert the object inside s3 bucket which is accessible by everyone
  • Create Cloudfront distribution providing S3 as origin
  • Delete object inside S3 bucket
  • Delete S3 bucket
  • Stop, Start and terminate Ec2 Instance
AWS Menu
AWS Login
AWS Create Instance

Docker Menu:

  • Pull Image from Docker hub
  • Launch Container
  • List Container running and docker Images in OS
  • Inspect docker container
  • Remove docker Images from OS
  • Start and stop docker Container
  • Delete Single or all docker container
  • Configure Webserver inside docker container
Docker Menu
Docker Status

Partition Menu:

  • Create Partition to disk.
  • Format drive.
  • Mount Drive.
  • Unmount Drive.
  • And many more..
Partition Menu
Partition Creation New
Partition Format Drive

Hadoop:

  • Run any Linux Command Locally & Remotely
  • Configure WebServer on Local OS , Remote OS and AWS Cloud
  • Configure and start Namenode on Local OS and AWS Cloud
  • Configure and start Datanode on Local OS and AWS Cloud
  • Create Virtual Group
  • Create Logical Volume
  • Contribute Limited Storage to Hadoop Cluster
  • Attach More hard-disks to Virtual group dynamically
  • Increase Partition Size Dynamically
Hadoop Menu
Hadoop Create Master Node

Anisible Menu:

  • Installing Python
  • Make an Inventory
  • Check the Connected Hosts
  • Installing WebServer on all Hosts
  • Starting HTTPD Service on all Hosts
  • Stopping HTTPD Service on all Hosts
Ansible Menu

The goal of this project is to automate different different technologies by using python-script and make it more user-friendly. Python scripts are more user-friendly , so user can easily interact with the technology.

In this automation we have integrated python with different technologies like Hadoop , AWS , Docker , and we can integrate many more technologies….

View Our Full Project on Github:

https://github.com/mohitavi/PythonAutomation

Team Members:

Arjun Nigam

https://www.linkedin.com/in/mohitavi

Himanshu Singh

https://www.linkedin.com/in/himanshu-singh-45a9b8135

Mohit Verma

https://www.linkedin.com/in/mohitavi

--

--

--

Hybrid Multi CLoud | Amazon EKS | Flutter

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Industry Expert Session on Use Cases for Kubernetes

Data Durability in MongoDB

How to check Router IOS Version, System Flash, and Configuration Register using Packet Tracer

This app will do the job for me.

DevOps Makes Inefficient Development for Search a Thing of the Past

Food for Agile Thought #204

Join our discord server

Configuring Hadoop Cluster Using Ansible

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Mohit Verma

Mohit Verma

Hybrid Multi CLoud | Amazon EKS | Flutter

More from Medium

How to Deploy a Production Grade Flask application to an AWS EC2 Instance using GitHub Actions…

Performance Analysis for Arm vs x86 CPUs in AWS EC 2

Practical docker

Creating a DynamoDB Table with Python-Part 2