add bert

park12sj · Mar 16, 2022 · 27a2183 · 27a2183
1 parent c78e5d6
commit 27a2183
Show file tree

Hide file tree

Showing 2 changed files with 6 additions and 1 deletion.
diff --git a/benchmarks/benchmark-ab.py b/benchmarks/benchmark-ab.py
@@ -519,7 +519,7 @@ def resnet152_batch_docker():
     execution_params['exec_env'] = 'docker'
 
 def bert_batch():
-    execution_params['url'] = 'https://bert-mar-file.s3.us-west-2.amazonaws.com/BERTSeqClassification.mar'
+    execution_params['url'] = 'https://torchserve.pytorch.org/mar_files/BERTSeqClassification.mar'
     execution_params['requests'] = 1000
     execution_params['concurrency'] = 10
     execution_params['batch_size'] = 4

diff --git a/docs/model_zoo.md b/docs/model_zoo.md
@@ -20,6 +20,8 @@ To propose a model for inclusion, please submit a [pull request](https://github.
 | Text classifier | Text Classification | AG_NEWS | 169 MB | [.mar](https://torchserve.pytorch.org/mar_files/my_text_classifier_v4.mar) | [sample_text.txt](https://github.com/pytorch/serve/blob/master/examples/text_classification/sample_text.txt) |Eager|
 | FCN ResNet 101 | Image Segmentation | COCO | 193 MB | [.mar](https://torchserve.pytorch.org/mar_files/fcn_resnet_101.mar) | [persons.jpg](https://github.com/pytorch/serve/blob/master/examples/image_segmenter/persons.jpg?raw=true) |Eager|
 | DeepLabV3 ResNet 101 | Image Segmentation | COCO | 217 MB | [.mar](https://torchserve.pytorch.org/mar_files/deeplabv3_resnet_101_eager.mar) | [persons.jpg](https://github.com/pytorch/serve/blob/master/examples/image_segmenter/persons.jpg) |Eager|
+| BERT token classification | Token Classification | AG_NEWS | 384.7 MB | [.mar](https://torchserve.pytorch.org/mar_files/bert_token_classification_no_torchscript.mar) | [sample_text.txt](https://github.com/pytorch/serve/blob/master/examples/text_classification/sample_text.txt) |Eager|
+| BERT sequence classification | Sequence Classification | AG_NEWS | 386.8 MB | [.mar](https://torchserve.pytorch.org/mar_files/bert_seqc_without_torchscript.mar) | [sample_text.txt](https://github.com/pytorch/serve/blob/master/examples/text_classification/sample_text.txt) |Eager| 
 | AlexNet Scripted | Image Classification | ImageNet | 216 MB | [.mar](https://torchserve.pytorch.org/mar_files/alexnet_scripted.mar) | [kitten.jpg](https://github.com/pytorch/serve/blob/master/examples/image_classifier/kitten.jpg?raw=true) |Torchscripted |
 | Densenet161 Scripted| Image Classification | ImageNet | 105 MB | [.mar](https://torchserve.pytorch.org/mar_files/densenet161_scripted.mar) | [kitten.jpg](https://github.com/pytorch/serve/blob/master/examples/image_classifier/kitten.jpg?raw=true) |Torchscripted |
 | Resnet18 Scripted| Image Classification | ImageNet | 42 MB | [.mar](https://torchserve.pytorch.org/mar_files/resnet-18_scripted.mar) | [kitten.jpg](https://github.com/pytorch/serve/blob/master/examples/image_classifier/kitten.jpg?raw=true) |Torchscripted |
@@ -31,6 +33,9 @@ To propose a model for inclusion, please submit a [pull request](https://github.
 | FCN ResNet 101 Scripted | Image Segmentation | COCO | 193 MB | [.mar](https://torchserve.pytorch.org/mar_files/fcn_resnet_101_scripted.mar) | [persons.jpg](https://github.com/pytorch/serve/blob/master/examples/image_segmenter/persons.jpg?raw=true) |Torchscripted |
 | DeepLabV3 ResNet 101 Scripted | Image Segmentation | COCO | 217 MB | [.mar](https://torchserve.pytorch.org/mar_files/deeplabv3_resnet_101_scripted.mar) | [persons.jpg](https://github.com/pytorch/serve/blob/master/examples/image_segmenter/persons.jpg) |Torchscripted |
 | MMF activity recognition | Activity Recognition | Charades | 549 MB | [.mar](https://torchserve.pytorch.org/mar_files/MMF_activity_recognition_v2.mar) | [372CC.mp4](https://mmfartifacts.s3-us-west-2.amazonaws.com/372CC.mp4) | Torchscripted |
+| BERT sequence classification CPU | Sequence Classification | AG_NEWS | 386.9 MB | [.mar](https://torchserve.pytorch.org/mar_files/BERTSeqClassification_torchscript.mar) | [sample_text.txt](https://github.com/pytorch/serve/blob/master/examples/Huggingface_Transformers/Seq_classification_artifacts/sample_text.txt) |Torchscripted| 
+| BERT sequence classification mGPU | Sequence Classification | CAPTUM | 386.9 MB | [.mar](https://torchserve.pytorch.org/mar_files/BERTSeqClassification_mgpu.mar) | [sample_text_captum_input.txt](https://github.com/pytorch/serve/blob/master/examples/Huggingface_Transformers/Seq_classification_artifacts/sample_text_captum_input.txt) |Torchscripted| 
+| BERT sequence classification | Sequence Classification | AG_NEWS | 386.8 MB | [.mar](https://torchserve.pytorch.org/mar_files/BERTSeqClassification.mar) | [sample_text.txt](https://github.com/pytorch/serve/blob/master/examples/Huggingface_Transformers/Seq_classification_artifacts/sample_text.txt) |Torchscripted| 
 | dog breed classification | Image Classification | ImageNet | 1.1 KB | [.war](https://torchserve.s3.amazonaws.com/war_files/dog_breed_wf.war) | [kitten_small.jpg](https://raw.githubusercontent.com/pytorch/serve/master/docs/images/kitten_small.jpg) | Workflow |
 
 Refer [example](https://github.com/pytorch/serve/tree/master/examples) for more details on above models.