Skip to content

Commit

Permalink
Migrating HL compile and export to infer APIs
Browse files Browse the repository at this point in the history
Signed-off-by:Asmita Goswami <[email protected]>
  • Loading branch information
asmigosw committed Dec 19, 2024
1 parent 15666ec commit 3edbd7c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion QEfficient/cloud/infer.py
Original file line number Diff line number Diff line change
Expand Up @@ -102,7 +102,7 @@ def main(
batch_size=batch_size,
mos=mos,
mxint8_kv_cache=mxint8,
num_devices=(0 if device_group is None else len(device_group)),
num_devices = (0 if device_group is None else len(device_group)),
full_batch_size=full_batch_size,
allow_mxint8_mdp_io=allow_mxint8_mdp_io,
enable_qnn=enable_qnn,
Expand Down

0 comments on commit 3edbd7c

Please sign in to comment.