Skip to content

Commit

Permalink
add todo
Browse files Browse the repository at this point in the history
  • Loading branch information
XuZhang99 committed Nov 6, 2024
1 parent b13521c commit 9319cca
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -259,7 +259,7 @@ def main():
if get_gpu_memory() > 24:
_ = quantize(pipe.transformer, **quantize_config)
else:
# for gpu with little memory, such as 4090
# (TODO:support 4090) for gpu with little memory, such as 4090
if hasattr(pipe, "transformer"):
pipe.transformer = pipe.transformer.to("cuda")
_ = quantize(pipe.transformer, **quantize_config)
Expand Down

0 comments on commit 9319cca

Please sign in to comment.