Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[image classification] decode jpeg image in preprocessing #434

Closed
delock opened this issue Apr 2, 2021 · 2 comments
Closed

[image classification] decode jpeg image in preprocessing #434

delock opened this issue Apr 2, 2021 · 2 comments

Comments

@delock
Copy link

delock commented Apr 2, 2021

Hi, I want to get clarification whether decode jpeg image and install it in raw (RGB) format in data preprocessing is conforming to training_policies. Decode a jpeg image is part of reference implementation and is non-random part of the data processing, so my understanding is it is allowed. Want to get confirm from WG.

@johntran-nv
Copy link
Contributor

Hi @delock , we discussed this last week, and agreed that jpeg decode alone can be considered a data layout transformation, which is explicitly allowed by the rules, specifically https://github.com/mlcommons/training_policies/blob/master/training_rules.adoc#61-data-state-at-start-of-run.

Note that data augmentation of any kind would invalidate this.

Does that answer your question?

@delock
Copy link
Author

delock commented Apr 16, 2021

@johntran-nv Thanks, that answers my question.

@delock delock closed this as completed Apr 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants