Skip to content

Commit

Permalink
GitBook: [main] 44 pages modified
Browse files Browse the repository at this point in the history
  • Loading branch information
devtrail42 authored and gitbook-bot committed Apr 12, 2021
1 parent 29dd3c4 commit 3364818
Show file tree
Hide file tree
Showing 44 changed files with 194 additions and 85 deletions.
37 changes: 36 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,46 @@

![Coogle](https://user-images.githubusercontent.com/23492454/114344653-2f41a700-9b9b-11eb-8bb3-c2113474a4e1.png)

![Coogle1](https://user-images.githubusercontent.com/23492454/114345053-f524d500-9b9b-11eb-9aec-3f8d53a7f825.png)
## Intro

Coogle은 KoSentenceBERT를 이용한 문장 임딩 모델 및 fast-text 모델를 기반으로한 단어 임딩 모델을 이용한 사용자 맞춤형 검색 플랫폼을 제공합니다.

![content](https://user-images.githubusercontent.com/23492454/114344794-6ca63480-9b9b-11eb-89e9-f86b187c63bd.png)

사용자가 입력한 쿼리는 학습된 임더 혹은 주어진 단어들의 조합에서 나온 쿼리들에 의해 벡터로 변환됩니다.

## 서비스 화면

![Coogle1](https://user-images.githubusercontent.com/23492454/114345053-f524d500-9b9b-11eb-9aec-3f8d53a7f825.png)

## 서비스 아키텍처 구조

모든 리뷰들은 각각의 전처리 과정을 거쳐 raw data와 키워드, 임베딩 벡터 순으로 엘라스틱 서치에 적재되게 됩니다.

![arch1](https://user-images.githubusercontent.com/23492454/114344813-77f96000-9b9b-11eb-9b8f-6d0f981cf91b.png)

사용자 쿼리가 발생하면 Django에 적재된 임베더에 의해 쿼리가 768차원의 벡터로 변환됩니다.
엘라스틱 서치에 있는 벡터들과 비교해서 가장 유사한 가게를 추천해줍니다.

![arch2](https://user-images.githubusercontent.com/23492454/114344821-792a8d00-9b9b-11eb-91f5-b1899313e51c.png)

전체적인 로직은 비슷하지만 aws\_django2에 있는 프로젝트는 문장 임딩을 사용하지 않고 단어 임베을 활용합니다.

서비스의 로직은 다음 코드들의 비교를 통해 보실 수 있습니다.

### Ver1. 문장 임베딩을 활용한 버

{% embed url="https://github.com/KDT-Hot6/Coogle/blob/main/aws\_django/webproj/homepage/views.py" %}

사용된 모델은 다음 링크에 pt파일로 저장되어 있습니다.

{% embed url="https://github.com/KDT-Hot6/final\_project/tree/main/model/training\_stsbenchmark\_skt\_kobert\_model\_-2021-03-28\_05-25-43\_best" %}

### Ver2. 단어 임베딩을 활용한 버

{% embed url="https://github.com/KDT-Hot6/Coogle/blob/main/aws\_django2/webproj/homepage/views.py" %}





42 changes: 42 additions & 0 deletions SUMMARY.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# Table of contents

* [Coogle](README.md)
* [aws\_django2](aws_django2/README.md)
* [webproj](aws_django2/webproj/README.md)
* [venv](aws_django2/webproj/venv/README.md)
* [lib](aws_django2/webproj/venv/lib/README.md)
* [python3.6](aws_django2/webproj/venv/lib/python3.6/README.md)
* [site-packages](aws_django2/webproj/venv/lib/python3.6/site-packages/README.md)
* [django](aws_django2/webproj/venv/lib/python3.6/site-packages/django/README.md)
* [contrib](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/README.md)
* [admin](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/README.md)
* [static](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/README.md)
* [admin](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/README.md)
* [css](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/README.md)
* [vendor](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/vendor/README.md)
* [select2](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/vendor/select2/README.md)
* [LICENSE-SELECT2](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/vendor/select2/license-select2.md)
* [js](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/README.md)
* [vendor](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/vendor/README.md)
* [select2](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/vendor/select2/README.md)
* [LICENSE](aws_django2/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/vendor/select2/license.md)
* [aws\_django](aws_django/README.md)
* [webproj](aws_django/webproj/README.md)
* [venv](aws_django/webproj/venv/README.md)
* [lib](aws_django/webproj/venv/lib/README.md)
* [python3.6](aws_django/webproj/venv/lib/python3.6/README.md)
* [site-packages](aws_django/webproj/venv/lib/python3.6/site-packages/README.md)
* [django](aws_django/webproj/venv/lib/python3.6/site-packages/django/README.md)
* [contrib](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/README.md)
* [admin](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/README.md)
* [static](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/README.md)
* [admin](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/README.md)
* [js](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/README.md)
* [vendor](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/vendor/README.md)
* [select2](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/vendor/select2/README.md)
* [LICENSE](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/js/vendor/select2/license.md)
* [css](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/README.md)
* [vendor](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/vendor/README.md)
* [select2](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/vendor/select2/README.md)
* [LICENSE-SELECT2](aws_django/webproj/venv/lib/python3.6/site-packages/django/contrib/admin/static/admin/css/vendor/select2/license-select2.md)

2 changes: 2 additions & 0 deletions aws_django/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# aws\_django

2 changes: 2 additions & 0 deletions aws_django/webproj/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# webproj

2 changes: 2 additions & 0 deletions aws_django/webproj/venv/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# venv

2 changes: 2 additions & 0 deletions aws_django/webproj/venv/lib/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# lib

2 changes: 2 additions & 0 deletions aws_django/webproj/venv/lib/python3.6/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# python3.6

2 changes: 2 additions & 0 deletions aws_django/webproj/venv/lib/python3.6/site-packages/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# site-packages

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# django

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# contrib

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# admin

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# static

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# admin

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# css

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# vendor

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# select2

Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# LICENSE-SELECT2

The MIT License \(MIT\)

Copyright \(c\) 2012-2017 Kevin Brown, Igor Vaynberg, and Select2 contributors

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files \(the "Software"\), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# js

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# vendor

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# select2

Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# LICENSE

The MIT License \(MIT\)

Copyright \(c\) 2012-2017 Kevin Brown, Igor Vaynberg, and Select2 contributors

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files \(the "Software"\), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

2 changes: 2 additions & 0 deletions aws_django2/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# aws\_django2

2 changes: 2 additions & 0 deletions aws_django2/webproj/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# webproj

2 changes: 2 additions & 0 deletions aws_django2/webproj/venv/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# venv

2 changes: 2 additions & 0 deletions aws_django2/webproj/venv/lib/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# lib

2 changes: 2 additions & 0 deletions aws_django2/webproj/venv/lib/python3.6/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# python3.6

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# site-packages

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# django

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# contrib

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# admin

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# static

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# admin

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# css

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# vendor

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# select2

Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# LICENSE-SELECT2

The MIT License \(MIT\)

Copyright \(c\) 2012-2017 Kevin Brown, Igor Vaynberg, and Select2 contributors

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files \(the "Software"\), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# js

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# vendor

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# select2

Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# LICENSE

The MIT License \(MIT\)

Copyright \(c\) 2012-2017 Kevin Brown, Igor Vaynberg, and Select2 contributors

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files \(the "Software"\), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

0 comments on commit 3364818

Please sign in to comment.