Skip to content

Commit

Permalink
#3130 - Update to readme
Browse files Browse the repository at this point in the history
  • Loading branch information
abin-aot committed Nov 30, 2022
1 parent b01ce77 commit 30b8a16
Show file tree
Hide file tree
Showing 6 changed files with 7 additions and 0 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,10 @@
# FOI Dedupe, Document Extraction , NLP Services and related Data, Document Storage

## Introduction
FOI Dedupe, Document extraction and NLP Services described in this documentation will be a value added service(s) on top of current FOI FLOW implementation. These services will support FOI FLOW application for document review, harms assessment and Redaction(PII, Confidentials etc.). Functionally various personas on FOI FLOW app like IAO Analysts, Ministry level FOI Coordinators can ease their effort while doing document deduplication, document review and redaction on PII and other confidential data.

## Architecture and Design
![Here is the File Watcher and Conversion Flow Diagram](\archanddesign\images\Option1_TechArch_Emerald.jpg)

### Architecture

Expand Down
1 change: 1 addition & 0 deletions archanddesign/drawio/FOI_Dedupe_redaction.drawio
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
<mxfile host="app.diagrams.net" modified="2022-10-25T18:12:07.512Z" agent="5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36" etag="2FlAKrsLijhFVhIggLIE" version="20.5.1" type="device"><diagram id="C5RBs43oDa-KdzZeNtuy" name="Page-1">7V1bl6M2Ev41fU72oX0kcX/sm2cmOzPpnU42m6ccjGWbNAYHcF/y61cCxEXINjbXtnFypo0QIKNPVV+VSqUr6W799sk3N6tv3hw7VwjM366k+yuEoKbp5A8teY9LDEOKC5a+PU8qZQVP9j84KQRJ6dae46BQMfQ8J7Q3xULLc11shYUy0/e912K1hecUn7oxl7hU8GSZTrn0d3seruJSHWlZ+WdsL1fsyVA14jNrk1VOfkmwMufea65IeriS7nzPC+Nv67c77NCXx97L71/ef3e+Pquffv5P8Lf52+2/f/3+3+v4ZtNjLkl/go/dsNlbo/jWL6azTd5X8lvDd/YCfW/rzjG9CbiSblfh2iFfIfn6Fw7D96TDzW3okSLPD1fe0nNN56vnbZJ6C88Nk2qQHmN3fkM7lhzPHM96joumtuMkzyBHSX2dHAWh7z2nfUdvkHYEreyYM+zcmtbzMmroned4Pjnlei6mt5oTMCS/JWvcQ1Z6W/HdJn1A75fDVfKmP2FvjUP/nVTwsWOG9ksRfGaC4WVaL7300bPJcxFIxlsKtmS0QXbMbhF4W9/CyVVZb5MvuWZkRREGjsCDXMLDH2TwjpCoA4mkK1lPnooQVsVbLAJc6PyDKEJKtyhSSij67pVAdLgfPjTM2gER7BBEGgci2C2I9Cog+tAQ6VwSJT0LJhL5FDu3P+Ekad3iyqik4kbpNGzpJPEokjgUhaa/xGETKJJvFOWvt+ny9e3r/QKtnOXPr4/XWm3ECDEhwE4OWXMzWEXXw1L/oyKAmIQp4Oe4To+H4Z5XwKy56EXvqae0Qp3JLzXfcxU2tKeD3cxa0sXMeifA9tcnX+IWNIoqWJJNV0h1wkRYUPPXTLpE/XtL7c7br1vLnpvkzJ3nBh6BWXqGfFvSv9NfvpDTP/DfWxzQWzxtZ2s7DAmOkluTlsZ3j+uXgF0WNDlIEpmzofXWb0vqP5gsHO/VWpl+OAkIMMI/aZ3XlR3ip03c9FdSLS+rops849BiN18QwHLSqoD741D8gv0Qv+3FHdNLXIczzvyaeQ1SAbfKeQxUsBupBalzLBgq2Ob019kWkSBU2D96gR3ankv1hxeG3pq8LFbhxrGX9ERIJY2o/za+Z+Eg2NFbmeSKronlE5hAmRyZvpUILPVD9GvaYfmOBV12rD7qDqWi7kBN645aHVe2a8cR2cCIhL2PyLJNUF/vfnFD85mUgy8u+efR95Y+7c6KSpe8ypDDRTRmuf4SdKGZAMsivYZ9AeLW9nweyZT9uAI8dooSJA+ktoAiAaUIFE0pAQUqAqDwxkBjQIHlEd+B7Cav1X//XzTAFXb4xxUzCsnB/Vvh6D05OiDzKQCn5tp2aP0SoLu3J0BFpQAbd8bXwwRoQXpkfP2XDXark/VRbtDhj4pyA4nkhojLtyY3ZLm23Ci8uROEyPHjP7LgOAkQlRV9UqyG5ZhBYFsFMXF8Lx8WE1X9DlAdlJjQ6quOuhDI6xEpLfgjZo5aWrBDm0RHj9i3yfugAiJuUl+oKoq1KySp6i2aTvvEmzwovEGRM+m8rJWuDJR0iqI3A0Wq7zMY9UcyLqSq49kY1niWWqCZd2b04AUZVdRHbHn+fDRRj6OanKjQBVQTdUk1Nal3UZHxjCLHSI3XHQzjAsiEXFH4SMMirzocKqgKkEJFTKGdtLWmZyQ/dQ+ag6FHBJ0d0mdKbfhXqmJPa1zxnTRjqyvchJy0f8bW4LyFXP2WZmzLEZOlkbKXRKUTqKa7NZ0v7mYbHkOikVqg0LAUB5IOO1AF1zldTaTgjXEnP9y2qD01ietiwaRrOjuQ1558zFBzLEs0x1OXZX0ywxURQO4yGjPnS7IisZi0vWrQ+vGY4cWCyLknCzDDnILNO/eUASnH42YIzsaoUyvqNtQbr9rYoapohon1x8X609qHno8aCCNrEDlI1op8Hak1fIIiNl0ATwaNPH4ycHBd1AdaYu3em8Wv7tRFwcZ0C7hhKseK3/oNbeRyZv5E5CB5OOD+/Ct6yYCO9etFMtjpJWvP9YJYEaTnY6JBz4LNW1xOldJ1ol9uomaQ/ov1Haf5rggL49aWKeQN0NJo4VR6xN6IEr0TUnJPv1PDWaG/WiEv8lBdmNZlSDnpNii7Tfzi0zP0H/r6SUFCBpSEDrAq8c+n55nkVHK0IH8+OlrG32MnjJK4YZScIyZ7XtR29lB2YdbSGAhpSyPWQGtEA50Ww+gwPzJpaSS/o5+T8odCcdzHtChhEbSwyCPoyYRJ0JM5LkHPRGyCljOhRQtB3JaYU2SNS3hFrrWxaMsKcj0T04UqfZ+eSrs9G8gKZRVpTSmHE/CeK6c+HVYes4zs7vlrEraRXZg7ZwZZ+TLXAB6V0WEKzXxhccAk9UojK6WVsYjYQSs/uOO/mzClIs+UYZlndjsJwEjtMNiCIhWZ5gRI0uls4QwoqFaVgqJBUdD+PXsVWeEhJ22LfFGr2UFih5XGSRgVcJKj5TUsDLFnPEPcz8oBo+/pYlhePNnAQhJMo1kfgtBemyE+Tw9WWxBROS4hCfycnc4SSkbvYv/ifVZGVS+ENijCUJ+FnsIR8mAbPmGo3LX9OphE6x5GAlCbAMi9EwCmSxolAPd4vt3gUe8fEx4EuTlp0Hd4EBMmjSLjs+mvCSEEN0FARvg68r+NKDk5iEwVoQRqE6VDnMj9+wVyBFHOotMpRby+eG8T09SHvU0Di0oH6oBwVTA7Jlrz8Yl7A8V2M9ejYsXkFmLFKsMLMlozEOOkTGB7lFqSVjBsT5xMH7itUx0qdW2dk6IIJc71our7owg1Y2/92lGEQtQOKWR7chxoR3w2xMuRgJePtvjxtrhWtLg00Lst3sbCnThEJELni41fR3OrxvJwTTCz361RLg+KtlykN57ZSYcNKn1QhLf/xAI55KiRisi4wwTATkkvANq0G1JRFS09k4oKq1NGUlGFVOgTjlfoqHde0cZSlW+2awfxb3+KwjuBt1iM7KKGy1+XemcXF+VyGyi9qLzkoPHkVie5TfiIFbbKamdWbz7CBSocbltwm/SP68EvdYlx137oIr9PScuhi2hcGjMujRmXxoxLY8alMQNYGqPIfS+NQaJQ9rq20C9Uj3ymG86N9s/Joc6KILlzx+bPoGbXLtO5qle0fhgIBuJcHW5ih8PTskM3TKpComcPqmglzcgYmvCgGnLvHtQ28v7/wMGGnBvjpI9zmqbRrQwdSt9uU61/6T+YzHQFRLSbpq55CrAjMKwskSA0unVjsd86ape62oUXHxD0vqmM1MZKi8ftzLGD1ahcaiyvINjoW7dA0H/cxoCj2fMrP/ikZACiA7aPMKSkaS1VeT6v+QB5sT6DkIO5xku2tpWZaE6GwzhTRXMzNJ9CzzeXuyRIDqgL+w2znW/hXv1zAqS721XA4CLLFUESACRKdgr5nbebc41VsG4LCWTNYIMt2qyoT0hBNI+M/YcXTKeTBf2TintQQQ85HMcpKZ8jSVBJiXEJbo3ok6NIbBvTdWCZeBJdtfHtAE/mnrWN1jXyIIMVQNYWohRui3ZJyHnKgGotE6qCRjx9YDypytDwJAqdH/H0UfDER4lIAt7dLZ4qxMOOeKqNp07ygBv8JLRow+4uwaVWcOYUwOVtQ8d2CSZcNwYZSN5drsfIf1PahlvST3MbZ+cElnuhg0VwK2CzKYjliXrOPkQcDo4ZTQVomq+BPJltrWcclrj/YCQdBJBDowpLaJQF+RtkdaK3hUeR/2nE44XgUSvhcaL2jshjzYMRkeeDSN49pajypH8ZeayBMSLyjBDJ520dBCJHE+VsTBQIEOLmJcWhsl1aKaJVgyO+Pii+eAnWO7qqzAGN6PoY6ILS8KRXhZT1I74+Cr6MEr4kQ8DAukVYG6nzn4iZAdh89xi6c4yGk0sYESR06na/R7VC2uxRCH0MIaTxqbv7nvLUyvbf1KYyBfy2cTxzTr48JnGcH1ZilJc2VcZDLvqsLUionCtfFgkcUZxOe5Hoeqmvuw4WvMQN07WqMX5abxt07G33pUSVZyjQ2pQLgiBz2PtGD1oVg6g0XAXdyHT4wvFerRUZiROiCda2a4b0vQv7tqKkP1Y2CLq7qx7Wuf6VoED06wKHcGv9q/ef4yYXjA0AF4wtI+PqhGDsi9QmVfcEYvjqOQMUhGpxNCC4P3M2lBW474LaOaD2vtbd9no5ExCXvAey7D282R7ZZ6TCr769XNIUL4CMDQSi4s/bGfn6U7IeB/v/qmrX75G9trvwom+2NfHt2cxzn+z1JoK865ExDOn4AOwIJciuTt7z40bmLCxe8uaXjC8ce/OZSRM6SNzlj0T25Yq+4kXI7lzRbXC8EdCRJuBj9UU2AFIEil5uTRFUmalO8GSv43UVOaiJ6dxBFhi5Fm5N63kZ6ZQcOBbRh1SJHnbDPBxCd0fSnvtVGG6CaMxNyf/W3EUT2/LchU20lT+xyBPRlK4MIX9oORFOU8IsSdfapnP9imfXkPbklL736Qqb8wCH19Y2IE3F/nWA/RfbwtfBdrMhWu6aDMsQu9cQ6ZONu+zSMOWG0YNK/+sQu7rM8VSJBd7k0CvpAgO2rUltY1ibCUF+52p4KA3lyGI4cnKQxTABOhCbOF1DNQwISorMQ/AkIj1A1MmlodEXBCFoPFX7SUwaQbaOhRFjrQNinMbbjV7DTrfOOgKexjDgqXGxwsyr1So89XIcEjO3YtMqIongk08TkHIwLhHMHOSSX0vqKbdXyr3IPmL0mA99ZDTVXi/Jwx2btGJq/rP1MX0XJsH9OyHLlJRGDf2TNPPPO4fQT+wHk+ClIsU8zezZZZlFTc74OXe2LYYJZR4xoiR/CphAgasMMsOleROpwmrmwsSqMJg3h6UScpqeaeUdAMTGcYiIDSZ/BfTyHT7x5q2UkptVzp7R0ep4WMrSIVgsKIlm3dqaiTXOLv9TrRQdDatJZh8cVJMsRH8ghoQxIIc8zCdDie0IA+of2o7YMbHXBlGrjMChOORViXNKQikPZ8EFTAGKL2iH2LHXei6zz/WHxi7y1p4qLYWFyxOtpExlUQyLrrBlgs1LTiQAxnEzNcaOiRp2nxk/c/M1cgJnUzf3eL7d0GCqB3dJmN9PT9tZYPn2rDh/M+PvO87ptGncdOQXz2bz01g/QTS7Klru1dakjlFhUme0WERydAgWi8LhSVLSAKEDNgtKKzYPKdH6wbrx65zYpO1254zw0I1JwDfb8r1kCi44yxD3btZEyFwKJrbvVgFRQki1BqiDCyJOD7Ao6e0UaJZHlWRIv1aNvjDXtG/dWbDJ39nP8nKbc/qmo52EQNaWexajTm79FvqmFRbauZMTZHc+P5ZwY9zJD7dtsYTTtEFXLIEP/5YEaeolUYyn0hpLqLDeZGQJQ2UJKsr84AxSughSndIECPr3bmZ+rKuCD6v5PUE7S1x8HIoOuqjS5MGHJxMbX4Jwko9K44Snru53UfH1mYtrV31Z31u/pZl0oPU+VkbM797dvG+/LJSL4R06OABifpCATkB8Rn7ZZrRAaVnr3V3kGtuRtqkthmBAfomzaG/5rr21ELSxfcUPPCcGFgUVAjebjUOwlBzFDgWbDrScW+Hm8cvoTTgdWaUVa7pgV6Vu3QkQiKYBuK5sO+XaXfTZhZCPm3JtiU2/JDSPlpOtmUISvwOCqoscpl1GpkMwgAyAIxz7gCOfQFqX+0cj7H9boEuM2U0jxT9KLEjmbWQh5ckjWrYhzmw31MZtiOk0keSt6dDSLkKKPJFB9hEkMO3achCAYiiuRe2Qb/EypV/VpeltbWZWe8mCrh9Ym24oat0L5C4EbIWpnlHAtilgkSIPXsDCAezsMNosfdgsCAAOnaKpxG5NFpE/p+uwzlIMx+VFdqaS8QJjNgxuVMhS35GdEIr8SrXj8DKcYxarRNoHfrn7EX95NP2AdC75dr3Tp77uKFQvj8lz9bAjwMfr6YhtDdGfix2W19a2GLIniJ9Lw/cE+ZEOR+R9//o4huBdsDhPE4el8VKCnZKFIXgtivMKOTXHGLyrYcbgIX7vKVE6r64D8GCFzJ0jooaKqJL/XZABoXNEHbub++gWOBe3gKIOzi1wMC/nCfZPxAyTzDDfH36UF330bPKceTxRKTW+ossT1ch9+rZ8kMgz2rEzKgbp6IC6JItF4R1QggjOjh1QaFxb/IH5pYaGxy9ZvH0OUS9lgjnmIB5zECNolDbRQT0TUlR2io7oHdErVue8A1JvLTCUHPoeJZrpuU9U+X3z5pjW+D8=</diagram></mxfile>
1 change: 1 addition & 0 deletions archanddesign/drawio/Option1_TechArch_Emerald.drawio

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions archanddesign/drawio/dedupe_flow.drawio
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
<mxfile host="app.diagrams.net" modified="2022-10-25T06:01:36.773Z" agent="5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36" etag="3m5JJyUyMBnvKDPOooST" version="20.4.2" type="device"><diagram id="C5RBs43oDa-KdzZeNtuy" name="Page-1">7Vpbc5s4FP41zOw+xAMigP0Y59I0m3ayddK0+5KRQQY1gIgQsemvXwkEBstOaBIHN+mML+ggEHznfOciSTMPo8UHCpPgE/FQqAHdW2jmkQaAsQ+AJj66l5cSZ7RfCnyKPdlpKZjgn0gKdSnNsIfSVkdGSMhw0ha6JI6Ry1oySCmZt7vNSNgeNYE+UgQTF4aq9Bp7LCilQ+As5acI+0E1smGPyjMRrDrLN0kD6JF5Q2Qea+YhJYSVR9HiEIUCvAqX64/5dXh+a384+ze9g1fjfy4/f90rb3byK5fUr0BRzJ5861N6d3ZuXF7CvasbPzr77+P91Y89qct7GGYSL/muLK8ARB7HUzYJZQHxSQzD46V0TEkWe0gMo/PWss85IQkXGlz4AzGWS+OAGSNcFLAolGfLMcVAKzp75IVlv5Rk1EUPvKVUIIPUR+yBfmatVU4HRCLEaM6voyiEDN+3Hw5Ku/Trfkvs+YGE/xdUoSuqOMEcXqBfJSGBAl+g7/HvX/x7fC+AAfo5ThmKEdWEQZ7w3yN0l6EM/a0BG0Yc/HE8TZMa4YZWU0bJbc0I0NYHt/RE9IsWvnAKg1lI5m4AKRukHEN2I/rMA8zQJIEF8HPerR7lHlGGFk/QpIq8vEvtTKQPGsnmfElow5ayoEHmSvbiurLfBW3MjrSx+qSNqdIGMTcQzx0I9sxKEs0oifjfxFQUtc6Qm1xQiLI1KzfbVl63m2YOXtPMR+/CzK2OZj7s08ytNapou/i22fNRoQcZ1MChwEBgWxwV6ZLItrIigMBYhJUApkF989+GH6bTNz8MQ9HKd57rvkGODDtyxNDXq/B1SGKocfkzedfq6DU0DxVtnJaO5mvpaHS04PmryhcakGiapRuSzH58j9X2PZau+p7hGtcz3JrrUfOet2joRtfSzQC9Oh61eJswQtFLhGM75O89nvIaz/ZZAfkjpd3OkMYcrZDG6D1gA0VPnyC9LYfi1XOWhNiFDMlS+wuMxTlDgZgPhZMU7ZKHslc9VP9gq/7/bUZjo2sFYTh9OimgOqk+tMExp/k3eX3R+C4aA6tqHi2aJ4/yZusCUczRQFQKd0a15gZ2dlatvPSC4CISSFbv77dZ7ZgrbC0fTF61YiD1YzyDw2rdOYGR8I8XPHK5xaPWAan8VSNWYQpA94ib/l5JH7Ba4NvDNS7VXONSDX1bPtXcDQ5vnXZOR9qBUa9pn/Mn7Xt8nmYE+s5EKpL0HfkWmH1rHDfiHm8tw55o5I3Gawc9s1qnfZR92wl6lv1I0CvfYGtBD6irom8zcQWdFd3rymi1Vt9Tnlo3uuWpO6O0Z1cbxaUHlMK80SERrEs3k9exnbb3t/QVAyjv+LKMVUvNTRPx53CKwramYYj9mB+7XEHCyY5FTMQuDA/kiQh7XmlUiMdwOC3uJ3QtweA3t8aadfRQUJX7W+TFWr2rpGkXD1j/xmi7pw+GeuWxJOaVLT3VD1ddyGyWou24WHXl5CDOS5hYubfBw7PZgP9P8zph2v2SwdHb1r+2ZFiX+2yvZADvY7MC6LpbAfS6JgLUefs/JQMYrdDGWbO88solgzrxsWmmWM4Sr2HV7s0SG8buIa3uMpFIX8X4rrDrh614B2FeLYEN3e4bZlONuF+ymAu4By/ATsSooU8oZoHYKiUWQKYwLfYdkrj2T7UfknF6RRlP3FcY8jByE+IIsw1q3Jam9leWTdbyQX9VRfUzN1HPyg/MUbPgqU/u0rR85xmKZ0/Lb1Alby43fpdJ8XL7vHn8Pw==</diagram></mxfile>
Binary file added archanddesign/images/FOI_Dedupe_redaction.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added archanddesign/images/Option1_TechArch_Emerald.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 30b8a16

Please sign in to comment.