Skip to content

Commit

Permalink
Merge pull request #6 from carlgennetais/dev
Browse files Browse the repository at this point in the history
add cluster configuration steps
  • Loading branch information
carlgennetais authored Apr 26, 2024
2 parents 594a5dc + 59ad3d1 commit 8ee627f
Showing 1 changed file with 6 additions and 5 deletions.
11 changes: 6 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,10 +31,11 @@ Une startup de l'AgriTech souhaite développer une application mobile de classif

## Install

```
$ make requirements
$ make data # automatically download and unzip dataset from Kaggle
```
- Create a new cluster in AWS EMR with the following configuration:
- pre-install apps : Hadoop, Spark, Jupyter, TensorFlow
- `bootstrap.sh` to install requirements
- `cluster_apps_config.json` to use S3 bucket as persistent storage in Jupyter
- private aws ssh keys

## Makefile

Expand All @@ -43,7 +44,7 @@ Available rules:
clean Delete all compiled Python files
clean_code Clean notebooks and python fils with black and isort
create_environment Set up python interpreter environment
data Make Dataset
data Make Dataset : download and unzip dataset from Kaggle
lint Lint using flake8
requirements Install Python Dependencies
```
Expand Down

0 comments on commit 8ee627f

Please sign in to comment.