Skip to content

Commit

Permalink
fix: ai tools and cqube projects
Browse files Browse the repository at this point in the history
Signed-off-by: Shruti3004 <[email protected]>
  • Loading branch information
Shruti3004 committed Dec 8, 2023
1 parent 9862194 commit 242e0f1
Show file tree
Hide file tree
Showing 28 changed files with 6 additions and 155 deletions.
4 changes: 1 addition & 3 deletions docs/2023/AI Tools/Deployment Optimization/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,4 @@ Manas Sivakumar
- [GitHub](https://github.com/Manas23601)

# Project Description
Set-up a pipeline and workflow to automate infrastructure initialization

# Project Goals
Set-up a pipeline and workflow to automate infrastructure initialization
19 changes: 0 additions & 19 deletions docs/2023/AI Tools/Deployment Optimization/setup.md

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,6 @@ author: Manas Sivakumar
- Fix Bash Script to Generate Docker File
- GitHub Action to Build and Push Images to ghcr.io

## Screenshots / Videos

## Contributions
- [Bash Script](https://github.com/Samagra-Development/ai-tools/issues/118)
- [Github Worflow](https://github.com/Samagra-Development/ai-tools/issues/132)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,6 @@ author: Manas Sivakumar
## Milestones
- Ansible Script to deploy Images in a Remote Machine

## Screenshots / Videos

## Contributions
- [Ansible Script](https://github.com/Samagra-Development/ai-tools/issues/195)
- [Ansible Script](https://github.com/Samagra-Development/ai-tools/issues/139)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,6 @@ author: Manas Sivakumar
- [ ] Update Vault Setup in NginX
- [ ] Ansible Script to setup Ai-Tools Nginx

## Screenshots / Videos

## Contributions
- [Vault Setup](https://github.com/Samagra-Development/ai-tools/pull/208)
- [Nginx Setup](https://github.com/Samagra-Development/ai-tools/pull/210)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,4 @@ author: Manas Sivakumar
- Map Images with section headers based on relative positions.

## Learnings
Optical Character Recognition using Cipher Substitution.
- Optical Character Recognition using Cipher Substitution.
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@ author: Manas Sivakumar
- [Google Colab](https://colab.research.google.com/drive/1dtIgnFdyLK-dZjBNdbp1_C7L-QiE6wLN#scrollTo=MQIkGCXSzeRC)

## Learnings
Brainstormed various strategies to get desired results. Made a pro-con list for each strategy that includes time and memory constraints.
- Brainstormed various strategies to get desired results. Made a pro-con list for each strategy that includes time and memory constraints.
19 changes: 0 additions & 19 deletions docs/2023/AI Tools/Dictionary Augmented Transformers/setup.md

This file was deleted.

19 changes: 0 additions & 19 deletions docs/2023/AI Tools/Document Uploader/setup.md

This file was deleted.

1 change: 0 additions & 1 deletion docs/2023/AI Tools/Document Uploader/updates/2023-07-07.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,6 @@ author: Harshit Gupta
- [x] Researching a method for chunking free text out from a stream of string.
- [x] Implement a benchmark model and test it's results.
- [x] Comparing the results with [Jugalbandi API's method](https://github.com/OpenNyAI/jugalbandi-api) for text chunking.
<!-- - [ ] Give the description about Milestone 4 -->

## Contributions
- [Here's the link](https://colab.research.google.com/drive/1AgRUKep8juyyJcOik9kY1PFnkc8OCxhe?usp=sharing) to the google colab notebook used to create a benchmark and test it against Jugalbandi API
Expand Down
4 changes: 2 additions & 2 deletions docs/2023/AI Tools/Neural Coref/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,10 +15,10 @@ Sai Gopal Reddy Kovvuri

# Project Description

Initial scope:
**Initial scope:**

During conversation with a chatbot, the user may refer to previous chatbot answers or his earlier questions either implicitly or explicitly. The goal is to take the user's question and resolve the contextual references before passing to a retrieval model for getting more accurate/relavant documents.

Project scope update:
**Project scope update:**

Automate synthetic data generation and finetuning process for various NLP tasks via requests to api endpoints and a frontend.
2 changes: 0 additions & 2 deletions docs/2023/AI Tools/Neural Coref/updates/2023-07-07.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,6 @@ author: Sai Gopal Reddy Kovvuri
- [x] Evaluate spaCy and fcoref models on test cases.
- [x] Setup training pipeline for fcoref model.

## Screenshots / Videos

## Contributions
- Identified and raised an [issue](https://github.com/Samagra-Development/ai-tools/issues/188) regarding coreference resolution models.
- Updated contributions [here](https://github.com/Samagra-Development/ai-tools/issues/42#issuecomment-1619750099).
Expand Down
2 changes: 0 additions & 2 deletions docs/2023/AI Tools/Neural Coref/updates/2023-07-14.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,6 @@ author: Sai Gopal Reddy Kovvuri
- [ ] Validate the quality of generated samples.
- [x] Finetune and evaluate BART on test cases.

## Screenshots / Videos

## Contributions
- Updated [issue](https://github.com/Samagra-Development/ai-tools/issues/174#issuecomment-1619736194).
- [Commit](https://github.com/ksgr5566/coref/commit/1bb94dfd924c44140e083f4e34e551eaf080261f): Added training pipeline (from generating data to training BART).
Expand Down
1 change: 0 additions & 1 deletion docs/2023/AI Tools/Neural Coref/updates/2023-07-21.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ author: Sai Gopal Reddy Kovvuri
- [x] Fix blocking api calls issues by processing the requests async.
- [x] Integrate fcoref to AI-Tools.

## Screenshots / Videos

## Contributions
- [Commit](https://github.com/ksgr5566/AutoTuneNLP/commit/fe9f1ee49c5fa94ef9b24cd5930a9c1aecfb7390): Finished scalable POST data end point.
Expand Down
2 changes: 0 additions & 2 deletions docs/2023/AI Tools/Neural Coref/updates/2023-08-11.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,6 @@ author: Sai Gopal Reddy Kovvuri
- [x] Enable retrieval of in-between rationales and queries.
- [x] Test DSP performance with GPT2 as LM.

## Screenshots / Videos

## Contributions
- [Colab Gist](https://colab.research.google.com/gist/ksgr5566/f23d85b555cbd3002a02cdf72c95239e/colbert-search.ipynb): Notebook covering above milestones.

Expand Down
2 changes: 0 additions & 2 deletions docs/2023/AI Tools/Neural Coref/updates/2023-08-18.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,6 @@ author: Sai Gopal Reddy Kovvuri
- [x] Integrate DSP to AI-Tools.
- [x] Implement word frequecy search based on tags.

## Screenshots / Videos

## Contributions
- [PR](https://github.com/Samagra-Development/ai-tools/pull/250): DSP to AI-Tools.
- [Document](https://github.com/Samagra-Development/ai-tools/issues/172#issuecomment-1680449680) on DSP.
Expand Down
2 changes: 0 additions & 2 deletions docs/2023/AI Tools/Neural Coref/updates/2023-08-25.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,6 @@ author: Sai Gopal Reddy Kovvuri
- [x] Explore possible approaches for hybrid search support to augment vector embedding search retrieval.
- [x] Integrate word score to AI-Tools.

## Screenshots / Videos

## Contributions
- [Notebook Gist](https://colab.research.google.com/gist/ksgr5566/30df8766d7981b85326c6939c8e51ae4/word_freq_score.ipynb) containing approaches tried.
- [PR](https://github.com/Samagra-Development/ai-tools/pull/254): Word score integration to AI-Tools.
Expand Down
2 changes: 0 additions & 2 deletions docs/2023/AI Tools/Neural Coref/updates/2023-09-01.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,6 @@ author: Sai Gopal Reddy Kovvuri
- [x] Convert National Education Policy document to a structured csv file with required headings.
- [x] Create a UI Template for AutoTuneNLP.

## Screenshots / Videos

## Contributions
- [Colab gist](https://colab.research.google.com/gist/ksgr5566/e58a9587de8aaa41bd5f2c5d86b7b4b8/json_to_csv.ipynb) for structuring NEP pdf.
- [UI Template](https://drive.google.com/file/d/1CnzMhyal6Oe4ax79UIL8dWuGA5un_dgQ/view?usp=sharing).
Expand Down
19 changes: 0 additions & 19 deletions docs/2023/cQube/Ingestion Speedup and Refactoring/setup.md

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ author: Shashwat Mahajan

## Contributions

🚀 **Pull Request:** [mplementation - QuoteChar](https://github.com/ChakshuGautam/cQube-ingestion/pull/164)
🚀 **Pull Request:** [Implementation - QuoteChar](https://github.com/ChakshuGautam/cQube-ingestion/pull/164)

🚀 **Pull Request:** [Implementation - csv-delimiter ](https://github.com/ChakshuGautam/cQube-ingestion/pull/165)

Expand Down
2 changes: 0 additions & 2 deletions docs/2023/cQube/Input File Validator/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,5 +13,3 @@ Peddi Sai Lohith
- [Email](mailto:[email protected])
- [Linked In](https://www.linkedin.com/in/peddi-lohith-3a0851203/)
- [GitHub](https://github.com/lohith1392)

# Project Description
19 changes: 0 additions & 19 deletions docs/2023/cQube/Input File Validator/setup.md

This file was deleted.

2 changes: 0 additions & 2 deletions docs/2023/cQube/Input File Validator/updates/2023-07-14.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,6 @@ author: Peddi Sai Lohith

![High Level design](./images/High_level_diagram.png)

## Contributions

## Learnings

- Explored different tech stack options to identify the most suitable technologies.
Expand Down
4 changes: 0 additions & 4 deletions docs/2023/cQube/Input File Validator/updates/2023-07-28.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,6 @@ author: Peddi Sai Lohith
- [x] Minor bug fixes regarding Error Reporting System.
- [x] Worked On my Presentation for Mid-Point Evalutaion

## Screenshots / Videos

## Contributions

## Learnings

- [Presented the work in Midpoint Demo Showcase](https://1drv.ms/p/s!AtG0mX-_V39ihVMn5BvFq66WxR9K?e=bZBRGF)
Expand Down
19 changes: 0 additions & 19 deletions docs/2023/cQube/cQubeChat/setup.md

This file was deleted.

2 changes: 0 additions & 2 deletions docs/2023/cQube/cQubeChat/updates/2023-07-28.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,6 @@ author: Suyash Gautam
- [x] Worked on prompt optimizing.
- [x] Fixed minor issues in visualization of data.

## Screenshots / Videos

## Contributions

- [Prompt enhancement and updated sample questions](https://github.com/Sunbird-cQube/cQubeChat/pull/21)
Expand Down
1 change: 0 additions & 1 deletion docs/2023/cQube/cQubeChat/updates/2023-08-04.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,6 @@ author: Suyash Gautam

- [Made SQL statement expandable](https://github.com/Sunbird-cQube/cQubeChat/pull/24)


## Learnings

- Streamlit expander component and how latex can be used to modify the text decoration of the label.
2 changes: 0 additions & 2 deletions docs/2023/cQube/cQubeChat/updates/2023-09-01.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,6 @@ author: Suyash Gautam
- [x] Deployed cQubeChat in production environment.
- [x] Worked on final presentation and demo.

## Screenshots / Videos

## Contributions
- [cQubeChat official deployment](https://cqubechat.t2s.samagra.io)

Expand Down

0 comments on commit 242e0f1

Please sign in to comment.