[Bug/Assistance] how to use local model to replace gpt3.5?

[lambda7xx]

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Screenshots or Terminal Copy&Paste
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: [e.g. Ubuntu 22.04]
• Python: [e.g. 3.9]

Additional context
Add any other context about the problem here.

[lambda7xx]

if I want to use local model like llama3, how to use this model to run the bench?

[TheodorAI]

if I want to use local model like llama3, how to use this model to run the bench?

Use fastchat!