ML_optimization_algorithms

This is an implementation of different optimization algorithms such as: - Gradient Descent (stochastic - mini-batch - batch) - Momentum - NAG - RMS-prop - BFGS - Adam Also, most of them are implemented in vectorized form for multi-variate problems