Skip to content

mauceri/prez

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
.ipynb_checkpoints
.ipynb_checkpoints
 
 
.gitignore
.gitignore
 
 
AlignmentMatrix.png
AlignmentMatrix.png
 
 
AttentionBiDirRNN.png
AttentionBiDirRNN.png
 
 
AttentionRNN.png
AttentionRNN.png
 
 
BERT-language-modeling-masked-lm.png
BERT-language-modeling-masked-lm.png
 
 
CBOW.png
CBOW.png
 
 
Decodeur.png
Decodeur.png
 
 
DifferentTypesOfRNN.png
DifferentTypesOfRNN.png
 
 
Encoder.png
Encoder.png
 
 
LSA-LDA.png
LSA-LDA.png
 
 
README.md
README.md
 
 
RoomMateCookingSchedule.png
RoomMateCookingSchedule.png
 
 
RoomMateFood.png
RoomMateFood.png
 
 
RoomMateMergingFinal.png
RoomMateMergingFinal.png
 
 
RoomMateMergingFoodAndWeather.png
RoomMateMergingFoodAndWeather.png
 
 
RoomMateNN.png
RoomMateNN.png
 
 
RoomMateRNNBurger.png
RoomMateRNNBurger.png
 
 
RoomMateRNNChicken.png
RoomMateRNNChicken.png
 
 
RoomMateRNNCloudy.png
RoomMateRNNCloudy.png
 
 
RoomMateRNNExample.png
RoomMateRNNExample.png
 
 
RoomMateRNNFinalNetwork.png
RoomMateRNNFinalNetwork.png
 
 
RoomMateRNNFinalNetworkTrash.png
RoomMateRNNFinalNetworkTrash.png
 
 
RoomMateRNNPie.png
RoomMateRNNPie.png
 
 
RoomMateRNNSunny.png
RoomMateRNNSunny.png
 
 
RoomMateRNNpng.png
RoomMateRNNpng.png
 
 
RoomMateSchedule.png
RoomMateSchedule.png
 
 
RoomMateSolution.png
RoomMateSolution.png
 
 
RoomMateVectors.png
RoomMateVectors.png
 
 
RoomMateWeather.png
RoomMateWeather.png
 
 
SelfAttention.png
SelfAttention.png
 
 
SelfAttentionDetailes.png
SelfAttentionDetailes.png
 
 
SkipGram.png
SkipGram.png
 
 
ThatsAllFolks.gif
ThatsAllFolks.gif
 
 
The_transformer_encoder_decoder_stack.png
The_transformer_encoder_decoder_stack.png
 
 
The_transformer_encoders_decoders.png
The_transformer_encoders_decoders.png
 
 
TransformerSummary.png
TransformerSummary.png
 
 
Transformer_decoder.png
Transformer_decoder.png
 
 
Transformer_encoder.png
Transformer_encoder.png
 
 
VanishingAndExploding.png
VanishingAndExploding.png
 
 
Vector_space_model.jpg
Vector_space_model.jpg
 
 
attention.gif
attention.gif
 
 
attention.png
attention.png
 
 
bert-next-sentence-prediction.png
bert-next-sentence-prediction.png
 
 
bert-tasks.png
bert-tasks.png
 
 
character_languag_model.ipynb
character_languag_model.ipynb
 
 
encoder_with_tensors.png
encoder_with_tensors.png
 
 
encoder_with_tensors_2.png
encoder_with_tensors_2.png
 
 
lch-mini.txt
lch-mini.txt
 
 
learningRate.jpg
learningRate.jpg
 
 
openai-input-transformations.png
openai-input-transformations.png
 
 
openai-transformer-1.png
openai-transformer-1.png
 
 
openai-transformer-language-modeling.png
openai-transformer-language-modeling.png
 
 
openai-transformer-sentence-classification.png
openai-transformer-sentence-classification.png
 
 
prez.html
prez.html
 
 
prez.ipynb
prez.ipynb
 
 
prez.pdf
prez.pdf
 
 
rnn.jpg
rnn.jpg
 
 
self-attention-matrix-calculation-2.png
self-attention-matrix-calculation-2.png
 
 
self-attention-matrix-calculation.png
self-attention-matrix-calculation.png
 
 
self-attention-output.png
self-attention-output.png
 
 
self-attention_softmax.png
self-attention_softmax.png
 
 
the_transformer_3.png
the_transformer_3.png
 
 
transformer_attention_heads_qkv.png
transformer_attention_heads_qkv.png
 
 
transformer_attention_heads_weight_matrix_o.png
transformer_attention_heads_weight_matrix_o.png
 
 
transformer_attention_heads_z.png
transformer_attention_heads_z.png
 
 
transformer_decoder_output_softmax.png
transformer_decoder_output_softmax.png
 
 
transformer_decoding_1.gif
transformer_decoding_1.gif
 
 
transformer_decoding_2.gif
transformer_decoding_2.gif
 
 
transformer_multi-headed_self-attention-recap.png
transformer_multi-headed_self-attention-recap.png
 
 
transformer_positional_encoding_example.png
transformer_positional_encoding_example.png
 
 
transformer_positional_encoding_vectors.png
transformer_positional_encoding_vectors.png
 
 
transformer_resideual_layer_norm.png
transformer_resideual_layer_norm.png
 
 
transformer_resideual_layer_norm_2.png
transformer_resideual_layer_norm_2.png
 
 
transformer_resideual_layer_norm_3.png
transformer_resideual_layer_norm_3.png
 
 
transformer_self-attention_visualization.png
transformer_self-attention_visualization.png
 
 
transformer_self_attention_score.png
transformer_self_attention_score.png
 
 
transformer_self_attention_vectors.png
transformer_self_attention_vectors.png
 
 

Repository files navigation

ML for NLP the transformer

Embeddings, attention, and residual are all you need.

see. prez.ipynb

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages