Skip to content

Commit

Permalink
Update MLPerf_Results_Messaging_Guidelines.adoc
Browse files Browse the repository at this point in the history
last registered trademark fixes
  • Loading branch information
TheKanter authored Dec 20, 2023
1 parent f966659 commit 5777792
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions MLPerf_Results_Messaging_Guidelines.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ For all footnotes required by these Guidelines, the size and color of the footno
**Examples for MLCommons Reviewed Result**:

[quote]
[1] MLPerf® v0.5 Inference Closed ResNet-v1.5 offline. Retrieved from https://mlcommons.org/en/training-normal-05/ 21 December 2018, entry 0.5-12. Result verified by MLCommons Association. The MLPerf name and logo are trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
[1] MLPerf® v0.5 Inference Closed ResNet-v1.5 offline. Retrieved from https://mlcommons.org/en/training-normal-05/ 21 December 2018, entry 0.5-12. Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.

or

Expand All @@ -86,15 +86,15 @@ When comparing results the main text, table, or figure must clearly identify any
____
SmartAI Corp achieved an unverified score of 0.6 on the MLPerf® Image Classification benchmark using a SmartCluster with 8 chips in the RDI category of Closed Division which is faster than the unverified result of 7.2 achieved by LessSmartAI Corp with 16 chips in the Available on-premise category of Closed Division.[1]
**Required Footnote**: “[1]Result not verified by MLCommons Association. MLPerf name and logo are trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
**Required Footnote**: “[1]Result not verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
____

**Example for MLCommons Reviewed Result**:

____
SmartAI Corp achieved a score of 0.6 on the MLPerf® Image Classification benchmark using a SmartCluster with 8 chips in the RDI category of Closed Division which is faster than the result of 7.2 achieved by LessSmartAI Corp with 16 chips in the Available on-premise category of Closed Division.[1]
**Required Footnote**: “[1]Result verified by MLCommons Association. MLPerf name and logo are trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.”
**Required Footnote**: “[1]Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.”
____

Furthermore, a comparison of an unverified result with a verified result must include the following statement in a footnote: “_Unverified results have not been through an MLPerf® review and may use measurement methodologies and/or workload implementations that are inconsistent with the MLPerf specification for verified results._”
Expand All @@ -120,7 +120,7 @@ System power measured using the MLPerf Power methodology is the only MLCommons o
____
AI_OEM1 Corp had a MLPerf® score of 1000fps and a measured power of 200W. Therefore, AI_OEM1 achieved 5fps/W.[1]
**Required Footnote**: “[1]Result verified by MLCommons Association. MLPerf name and logo are trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
**Required Footnote**: “[1]Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
____

or
Expand All @@ -130,15 +130,15 @@ AI_OEM1 Corp had a MLPerf® score of 1000fps using Accelerator1-250W while AI_OE
**Required Footnote 1**: “[1] Note that this comparison does not derive perf/W from the accelerator TDP, but merely differentiates that the two submitters used the same accelerator in a different configuration and obtained different results.”
**Required Footnote 2**: “[2]Result verified by MLCommons Association. MLPerf name and logo are trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.”
**Required Footnote 2**: “[2]Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.”
____

or

____
AI_OEM1 Corp had a MLPerf® score of 1000fps using Accelerator1-250W with a measured system power of 500W. AI_OEM2 Corp had a MLPerf score of 900fps using Accelerator1-150W and a measured system power of 400W. Therefore, AI_OEM1 Corp achieved 2fps/W while AI_OEM2 achieved 2.25fps/W using the same accelerator.[1]
**Required Footnote**: “[1]Result verified by MLCommons Association. MLPerf name and logo are trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
**Required Footnote**: “[1]Result verified by MLCommons Association. The MLPerf name and logo are registered and unregistered trademarks of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use strictly prohibited. See www.mlcommons.org for more information.
(In this case, the submitters are allowed to specify the accelerator TDP configuration since it is part of the SKU name, so the first sentence is valid. However in the second sentence, when they measure power and derive their perf/W score, they used the MLPerf measured power. Therefore the second sentence is also valid and the statement does not violate this rule.)
____
Expand Down

0 comments on commit 5777792

Please sign in to comment.