Skip to content

Commit

Permalink
Fixes for pypi release, use deepspeed-mii name
Browse files Browse the repository at this point in the history
  • Loading branch information
jeffra committed Oct 24, 2022
1 parent da98df0 commit f5ab5df
Show file tree
Hide file tree
Showing 3 changed files with 24 additions and 16 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -92,6 +92,7 @@ As an example here is a deployment of the [bigscience/bloom-560m](https://huggin

**Deployment**
```python
import mii
mii_configs = {"tensor_parallel": 1, "dtype": "fp16"}
mii.deploy(task="text-generation",
model="bigscience/bloom-560m",
Expand All @@ -103,6 +104,7 @@ This will deploy the model onto a single GPU and start the GRPC server that can

**Query**
```python
import mii
generator = mii.mii_query_handle("bloom560m_deployment")
result = generator.query({"query": ["DeepSpeed is", "Seattle is"]}, do_sample=True, max_new_tokens=30)
print(result)
Expand All @@ -112,6 +114,7 @@ The only required key is `"query"`, all other items outside the dictionary will

**Shutdown Deployment**
```python
import mii
mii.terminate("bloom560m_deployment")
```

Expand Down Expand Up @@ -139,6 +142,7 @@ To use MII on AML resources, you must have the Azure-CLI installed with an activ

**Deployment**
```python
import mii
mii_configs = {"tensor_parallel": 1, "dtype": "fp16"}
mii.deploy(task="text-generation",
model="bigscience/bloom-560m",
Expand Down
34 changes: 19 additions & 15 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -63,18 +63,22 @@ def command_exists(cmd):
# None of the above, probably installing from source
version_str += f'+{git_hash}'

setup(
name='mii',
version=version_str,
description='deepspeed mii',
install_requires=install_requires,
#scripts=[],
extras_require=extras_require,
packages=find_packages(),
classifiers=[
'Programming Language :: Python :: 3.6',
'Programming Language :: Python :: 3.7',
'Programming Language :: Python :: 3.8',
'Programming Language :: Python :: 3.9'
'Programming Language :: Python :: 3.10'
])
setup(name="deepspeed-mii",
version=version_str,
description='deepspeed mii',
author='DeepSpeed Team',
author_email='[email protected]',
url='http://deepspeed.ai',
project_urls={
'Documentation': 'https://github.com/microsoft/DeepSpeed-MII',
'Source': 'https://github.com/microsoft/DeepSpeed-MII',
},
install_requires=install_requires,
extras_require=extras_require,
packages=find_packages(),
classifiers=[
'Programming Language :: Python :: 3.7',
'Programming Language :: Python :: 3.8',
'Programming Language :: Python :: 3.9',
'Programming Language :: Python :: 3.10'
])
2 changes: 1 addition & 1 deletion version.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0.1.0
0.0.2

0 comments on commit f5ab5df

Please sign in to comment.