Pinned Loading

1. Data-Streaming-Flink-Spark Data-Streaming-Flink-Spark Public

   This project showcases a real-time data streaming pipeline using Apache Flink, Apache Spark, and Grafana. It streams data, stores it in Parquet format, and performs aggregations for insights, with …

   Python

2. MeshJoin-Streaming-ETL-Data-Warehouse MeshJoin-Streaming-ETL-Data-Warehouse Public

   MeshJoin-Streaming-ETL-Data-Warehouse integrates real-time transactional data with master data using the Mesh Join algorithm. It processes and enriches data, then loads it into a data warehouse for…

   Java

3. Deep-Learning-Grid-World-Q-Learning Deep-Learning-Grid-World-Q-Learning Public

   Deep Learning Grid World Q-Learning . Implement Q-learning in a 5x5 grid where an agent navigates obstacles and rewards. Train the agent with varying learning rates, visualize its progress, and see…

   Python

4. FMA-A-Dataset-For-Music-Analysis FMA-A-Dataset-For-Music-Analysis Public

   Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interfac…

   Python 2 1

5. Global-Ecommerce-Retail-Trends-Analysis Global-Ecommerce-Retail-Trends-Analysis Public

   The Global E-commerce & Retail Analysis project involves data preprocessing, dimensionality reduction with PCA, CLV calculation and What-If analysis . Key insights include effective PCA for data re…

   Jupyter Notebook

6. Apache-Kafka-and-Frequent-Item-sets Apache-Kafka-and-Frequent-Item-sets Public

   This Bash script automates the setup and execution of a data processing pipeline using Apache Kafka and Python scripts, ensuring fault tolerance and streamlined management of Kafka-based data pipel…

   Python 3