manual.md

Infrastructure Setup Manual (mandatory steps are X)

• Physical Resources chameleon cloud and cloudlab
  1. Steps to leasing a server from Chameleon cloud chameleon-lease

Do the steps in the following orders to setup the environment:

• Server Utility Tools zsh and ohmyzsh

  1. Installation of zsh
  2. Installation of ohmyzsh
  3. Installation of zsh autosuggestion

• Python Environment

  1. Download and install miniconda

  2. Create conda virtual-environment

      conda create --name central python=3.9.15
     

  3. Activate conda environment

      conda activate central
     

  4. Install the followings

      sudo apt install cmake libz-dev
     

  5. For Open-CV to work install:

    sudo apt-get update
    sudo apt-get install ffmpeg libsm6 libxext6  -y
  

• Project Data Project data are stored in the google bucket ipa-results

1. Install Gcloud CLI for downloading data.

• Infrastracture Kubernetes

  1. Install Helm
  2. Setup a K8S cluster k8s-setup
  3. Set up multi node cluster Multi-node cluster

• Network Service Mesh Tool Istio

  1. Setup Istio on Chameleon istio-setup

• ML Inference DAG Technology Seldon Core

  1. Setup the Seldon core operator on your cluster seldon-core-installation
  2. See Overview of Component for an overview of the Seldon core framework
  3. Also see the link to the shortlisted parts of the documentation

• Testing Installation

  1. Up to this point you should have a complete working installation
  2. To test the installation use test-installation

• Resources Observibility Tool Prometheus and Grafana

  1. Setup the observibitliy tools for services resource usage monitoring setup-observibility
  2. check out the guide-obervibility for usefule information about using the observability tools

• Docker

  1. For compiling model images of the pipeline you'll need Dcoker
  2. Install them using the offical documentation for docker-doc. Also do the post-installation-steps

• Chameleon Object Storage

  1. we keep the datasets and models in the Chameleon object storage to moount it on a directory use the guide on chameleon website

• Minio and nfs

  1. Minio and nfs are needed for the storage
  2. Setup them using setup-storage

• Multi Node server

  1. How to set multiNode cluster MultiNode

• Installing Gurobi Sovler

  1. Gurobi Solver Installation