add diagram for gating feature

lucidrains · Jan 16, 2021 · 172985a · 172985a
1 parent 25dee85
commit 172985a
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -573,6 +573,8 @@ logits3, mems3  = model_xl(seg3, mems = mems2, return_mems = True)
 
 ### Gated residual
 
+<img src="./images/gating.png" width="500px"></img>
+
 The authors propose gating the residual connections in the transformer network and demonstrate increased stability and performance for Transformer-XL in a variety of reinforcement learning tasks.
 
 ```python

diff --git a/images/gating.png b/images/gating.png