advanced

Jiphyeonjeon Season 1 - Advanced Class

• 수정 및 업데이트 요청 : 이정섭([email protected] ), 구혜연([email protected])
• 중급반 스케쥴: 구글 독스
  
  

Table of Contents

• Summary
• Presentations
  
  

Summary

by Subject

Subject	Season1
Decoding	1
Augmentation	1
Translation	2
Dialog	2
Knowledge_Distillation	1
Query Generation	1
Architecture	1
coreference	1
Representation	4
Total	18

by Conference/Journals

Conference/Journal	Season1
EMNLP	5
IEEE	1
None	12
Total	18

by Published Year

Year	Season1
2014	1
2017	1
2020	8
2021	2
Total	18

Presentations

• 01 : If beam search is the answer, what was the question?

  • Paper, Video, Presentation
  • Clara Meister et al., EMNLP 2020
  • Keywords: Beam Search, Uniform Information Density
  • Presenter : 진명훈

• 02 : SSMBA- Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness

  • Paper, Video, Presentation
  • Nathan Ng et al., EMNLP 2020
  • Keywords: Augmentation, Manifold, Out-of-Domain
  • Presenter : 박동주

• 03 : Translation Survey (vol1) : Background

  • Paper, Video, Presentation
  • Keywords: Attention Mechanism, Pretrained Language Modeling, Machine Translation
  • Presenter : 고현웅

• 04 : Translation Survey (vol2) : Machine Translation

  • Paper, Video, Presentation
  • Keywords: Translation, Dataset, Efficiency, Training, Architecture
  • Presenter : 고현웅

• 05 : Recipes for building an open-domain chatbot

  • Paper, Video, Presentation
  • Stephen Roller et al.
  • Keywords: BST, poly encoder, retrieve and refine
  • Presenter : 김대규

• 06 : Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation

  • Paper, Video, Presentation
  • Nils Reimers and Iryna Gurevych, EMNLP 2020
  • Keywords: Knowledge Distillation, Cross Lingual
  • Presenter : 양수영

• 07 : Incorporating Behavioral Hypotheses for Query Generation

  • Paper, Video, Presentation
  • Ruey-Cheng Chen and Chia-Jung Lee, EMNLP 2020
  • Keywords: Behavial Hypothese, BART, Meshed Representation
  • Presenter : 송일현

• 08 : GPT-X

  • Paper, Video, Presentation
  • Keywords: GPT, Language Model
  • Presenter : 고현웅

• 09 : Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping

  • Paper, Video, Presentation
  • Minjia Zhang and Yuxiong He
  • Keywords: Progressive Layer Dropping, Stochastic Depth, Transformer
  • Presenter : 구혜연

• 10 : NumNet: Machine Reading Comprehension with Numerical Reasoning

  • Paper, Video, Presentation
  • Qiu Ran et al, EMNLP 2019
  • Keywords: Machine Reading Comprehension
  • Presenter : 김경민

• 11 : Memory Networks

  • Paper, Video, Presentation
  • Jason Weston et al, ICLR 2015
  • Keywords:
  • Presenter : 박민혜

• 12 : Double Graph Based Reasoning for Document-level Relation Extraction (GAIN)

  • Paper, Video, Presentation
  • Shuang Zeng et al, EMNLP 2020
  • Keywords:
  • Presenter : 손수현

• 13 : End-to-end Neural Coreference Resolution

  • Paper, Video, Presentation
  • Kenton Lee et al, EMNLP 2017
  • Keywords: coreference, span
  • Presenter : 허철훈

• 14 : Towards a Human-like Open-Domain Chatbot

  • Paper, Video, Presentation
  • Daniel de Freitas Adiwardana et al
  • Keywords: MEENA, SSA
  • Presenter : 김선행

• 15 : Distributed Representations of Sentences and Documents

  • Paper, Video, Presentation
  • Quoc Le et al
  • Keywords: Paragraph Vector, Bag of Words
  • Presenter : 송성희

• 16 : Improving Skip-Gram Embeddings Using BERT

  • Paper, Video, Presentation
  • Yile Wang et al
  • Keywords: static embedding, Skip-Gram, BERT
  • Presenter : 윤병일

• 17 : Improving Skip-Gram Embeddings Using BERT

  • Paper, Video, Presentation
  • Nina Poerner et al
  • Keywords: factual knowledge, name-based reasoning, unsupervised QA
  • Presenter : 김병진

• 18 : Improving Skip-Gram Embeddings Using BERT

  • Paper, Video, Presentation
  • Nandan Thakur et al
  • Keywords: data augmentation method, domain adaptation, sentence pair modeling, sbert, bi-encoder
  • Presenter : 민지웅