Skip to content

Files

Latest commit

888a516 · Apr 23, 2024

History

History

demo

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Apr 23, 2024
Apr 23, 2024

Magicoder Inference Demo

We provide the inference demo script for Magicoder models.

  1. According to the instructions of README, install the environment.
  2. Install these packages:
pip install fire==0.5.0
pip install gradio==3.46.0
  1. Run the command:
CUDA_VISIBLE_DEVICES=0 python magicoder_demo.py \
   --base_model "ise-uiuc/Magicoder-S-DS-6.7B" \
   --device "cuda:0" \
   --port 8080