Skip to content

Commit

Permalink
Fix TypeError in add_token_usage_to_result when non-integer usage dat…
Browse files Browse the repository at this point in the history
…a is present
  • Loading branch information
masihmoloodian authored Jan 4, 2025
1 parent cdb8ce9 commit a1c095e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion evals/cli/oaieval.py
Original file line number Diff line number Diff line change
Expand Up @@ -279,7 +279,7 @@ def add_token_usage_to_result(result: dict[str, Any], recorder: RecorderBase) ->
if usage_events:
# Sum up the usage of all samples (assumes the usage is the same for all samples)
total_usage = {
key: sum(u[key] if u[key] is not None else 0 for u in usage_events)
key: sum(u[key] if isinstance(u[key], int) else 0 for u in usage_events)
for key in usage_events[0]
}
total_usage_str = "\n".join(f"{key}: {value:,}" for key, value in total_usage.items())
Expand Down

0 comments on commit a1c095e

Please sign in to comment.