DeepSpeed-MII v0.2.0

New Features

• DeepSpeed-FastGen: Introducting Mixtral, Phi-2, and Falcon support with major performance and feature enhancements.

What's Changed

• Update version.txt after 0.1.3 release by @mrwyattii in #355
• Add pipeline unit tests by @mrwyattii in #359
• Update supported models list by @mrwyattii in #360
• Add restful_api_host into server args. by @sarattha in #364
• fix bug when mii_config is None by @mrwyattii in #367
• fix address already in use error on UT by @mrwyattii in #369
• Restrict when legacy unit tests are run by @mrwyattii in #370
• Make generate params pydantic model by @mrwyattii in #372
• Add model support unit test by @mrwyattii in #373
• Improve efficiency of scheduling and token sampiling by @tohtana in #377
• Update required DS version by @mrwyattii in #380

New Contributors

• @sarattha made their first contribution in #364

Full Changelog: v0.1.3...v0.2.0