New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

polyglot 5.8B + adapter_model.pt 결합 후 양자화 #1

Open

HiitLee opened this issue May 23, 2023 · 1 comment

HiitLee commented May 23, 2023

안녕하세요~
좋은 정보 감사합니다.

궁금한게 있어서 질문드립니다.
기존 alpaca-lora 코드로 학습시킨 adapter_model.pt모델을 backbone으로 사용하는 Polyglot5.8B로 결합한 후 양자화 하고 싶은데
혹시 관련 방법이 있을까요?

Owner

qwopqwop200 commented May 23, 2023

Lora로 학습시킨 adapter_model.pt를 이 코드처럼 병합하는 코드를 만든뒤 만들어진 HF 포맷 모델로 양자화 코드를 실행하면 될거에요.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment