Skip to content

Commit

Permalink
Update modeling_base.py (#2419)
Browse files Browse the repository at this point in the history
  • Loading branch information
fzyzcjy authored Nov 30, 2024
1 parent d6a8f2c commit 148b592
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion trl/models/modeling_base.py
Original file line number Diff line number Diff line change
Expand Up @@ -619,7 +619,7 @@ def create_reference_model(
"""
if is_deepspeed_zero3_enabled():
raise ValueError(
"DeepSpeed ZeRO-3 is enabled and is not compatible with `create_reference_model()`. Please instantiate your reference model directly with `AutoCausalLM.from_pretrained()`."
"DeepSpeed ZeRO-3 is enabled and is not compatible with `create_reference_model()`. Please instantiate your reference model directly with `AutoModelForCausalLM.from_pretrained()`."
)

parameter_names = [n for n, _ in model.named_parameters()]
Expand Down

0 comments on commit 148b592

Please sign in to comment.