Inference framework

[sky-2002]

@VikParuchuri do you recommend any inference framework to deploy marker on, like torchserve or something, or if you know a better one ?
I checked this, but its not updated.