Skip to content

Commit

Permalink
Merge branch 'eval' of github.com:open-compass/GPassK into main
Browse files Browse the repository at this point in the history
  • Loading branch information
jnanliu committed Dec 24, 2024
2 parents 2314d71 + 4544543 commit 7b27d80
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ pip install -e .


### 2. Prepare Dataset
You can access the LiveMathBench Dataset from [huggingface](https://huggingface.co/datasets/jnanliu/LiveMathBench).
You can access the LiveMathBench Dataset from [huggingface](https://huggingface.co/datasets/opencompass/LiveMathBench).


### 3. Deploy Judge Models
Expand All @@ -87,10 +87,10 @@ python save_opencompass_configs.py --config_template_file {opencompass_config_te
After running the script, you can check the opencompass config files in `opencompass_configs/`, such as:
```
.
├── deepseek-math-7b-rl_t0-3_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t0-5_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t0-7_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t1-0_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t0-3_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-v202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t0-5_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-v202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t0-7_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-v202412-k4_8_16-r3.py
├── deepseek-math-7b-rl_t1-0_p0-8_k50_rp1-0_rs42_l8192@LiveMathBench-v202412-k4_8_16-r3.py
```

Here, the file name of each opencompass config file follow the pattern:
Expand Down

0 comments on commit 7b27d80

Please sign in to comment.