VdbenchAutomation

Automate the Vdbench setup workflow, reducing the setup time from 2 hours to 10 minutes. This automation will setup the end to end environment, from creating to EC2 instances to installing all the required dependencies for Vdbench. This workflow helps reduce the manual efforts to set up an Vdbench environment.

Prerequisites:

Please install boto3 and Fabric before running the scripts

sudo install pip

sudo pip install virtualenv

virtualenv vdbench_automation

source vdbench_automation/bin/activate

sudo pip install boto3

sudo pip install fabric

sudo pip install pyyaml

Getting Set Up

1. Fork this repository on GitHub.
2. Clone your forked repository (not our original one) to your hard drive with git clone https://github.com/ckarthik1994/VdbenchAutomation.git

Important Files:

• MetaData.csv : This files stores the configurable parameters for the AWS EC2 instances.
• vdbench_environment_setup.py : This python file has all the commands for the environment setup. • vdbench_automate_script.py : This python file has all the commands for the Vdbench automation.

Running the automation

Environment Setup

usage: vdbench_environment_setup.py [-h] [-awsAccessId AWSACCESSID]
[-awsAccessKey AWSACCESSKEY] [-keyFile KEYFILE]
[-region REGION] [-metadataFile METADATAFILE]
[-stackName STACKNAME]

Arguments for the AWS automation script
optional arguments:
-h, --help show this help message and exit
-awsAccessId AWSACCESSID, --awsAccessId AWSACCESSID
AWS AccessId of your account
-awsAccessKey AWSACCESSKEY, --awsAccessKey AWSACCESSKEY AWS AccessKey of your account
-keyFile KEYFILE, --keyFile KEYFILE
Key File for the instance
-region REGION, --region REGION
Region of the instance
-metadataFile METADATAFILE, --metadataFile METADATAFILE
Metadata File
-stackName STACKNAME, --stackName STACKNAME
Name of CloudFormation Stack

Vdbench Automation

usage: vdbench_automate_script.py [-h]
(-d JSONCONFIGTEMPLATEDUMP | -m | -f JSONCONFIG)

Arguments for the Vdbench automation script

optional arguments:
-h, --help show this help message and exit
-d JSONCONFIGTEMPLATEDUMP, --JSONConfigTemplateDump JSONCONFIGTEMPLATEDUMP
Dump the JSON template in the file provided
-m, --JSONConfigMenu Provide the configrations via menu
-f JSONCONFIG, --JSONConfig JSONCONFIG
Provide the JSON configration file