-
Notifications
You must be signed in to change notification settings - Fork 12
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #1 from NVIDIA-ISAAC-ROS/release-dp3
Isaac ROS 0.30.0 (DP3)
Showing
104 changed files
with
6,312 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
# Images | ||
*.gif filter=lfs diff=lfs merge=lfs -text | ||
*.jpg filter=lfs diff=lfs merge=lfs -text | ||
*.png filter=lfs diff=lfs merge=lfs -text | ||
*.psd filter=lfs diff=lfs merge=lfs -text | ||
|
||
# Archives | ||
*.gz filter=lfs diff=lfs merge=lfs -text | ||
*.tar filter=lfs diff=lfs merge=lfs -text | ||
*.zip filter=lfs diff=lfs merge=lfs -text | ||
|
||
# Documents | ||
*.pdf filter=lfs diff=lfs merge=lfs -text | ||
|
||
# Shared libraries | ||
*.so filter=lfs diff=lfs merge=lfs -text | ||
*.so.* filter=lfs diff=lfs merge=lfs -text | ||
|
||
# ROS Bags | ||
**/resources/**/*.db3 filter=lfs diff=lfs merge=lfs -text | ||
**/resources/**/*.yaml filter=lfs diff=lfs merge=lfs -text | ||
ros2_benchmark/test/pol.bag/pol.bag_0.db3 filter=lfs diff=lfs merge=lfs -text | ||
ros2_benchmark/test/pol.bag/pol.bag_0.db3.zstd filter=lfs diff=lfs merge=lfs -text | ||
ros2_benchmark/test/pol.bag/metadata.yaml filter=lfs diff=lfs merge=lfs -text |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
# Ignore all pycache files | ||
**/__pycache__/** |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
# Isaac ROS Contribution Rules | ||
|
||
Any contribution that you make to this repository will | ||
be under the Apache 2 License, as dictated by that | ||
[license](http://www.apache.org/licenses/LICENSE-2.0.html): | ||
|
||
> **5. Submission of Contributions.** Unless You explicitly state otherwise, any Contribution intentionally submitted for inclusion in the Work by You to the Licensor shall be under the terms and conditions of this License, without any additional terms or conditions. Notwithstanding the above, nothing herein shall supersede or modify the terms of any separate license agreement you may have executed with Licensor regarding such Contributions. | ||
Contributors must sign-off each commit by adding a `Signed-off-by: ...` | ||
line to commit messages to certify that they have the right to submit | ||
the code they are contributing to the project according to the | ||
[Developer Certificate of Origin (DCO)](https://developercertificate.org/). | ||
|
||
[//]: # (202201002) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
* | ||
!.gitignore |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
* | ||
!.gitignore |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4973.809163411458, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 56.293519763104854, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 56.29364691516963, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 280.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 21.661539713541668, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 21.520670572916668, "BasicPerformanceMetrics.MAX_JITTER": 5.090576171875, "BasicPerformanceMetrics.MIN_JITTER": 0.005615234375, "BasicPerformanceMetrics.MEAN_JITTER": 1.0091262927158273, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.5661209040349534, "CPUProfilingMetrics.MAX_CPU_UTIL": 36.40833333333334, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.4166666666666667, "CPUProfilingMetrics.MEAN_CPU_UTIL": 22.194999999999997, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 4.682915076352002, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 23.91388888888889, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4899.922119140625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203902673900808, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.204243819444477, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 21.575439453125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 21.41162109375, "BasicPerformanceMetrics.MAX_JITTER": 2.58447265625, "BasicPerformanceMetrics.MIN_JITTER": 0.1337890625, "BasicPerformanceMetrics.MEAN_JITTER": 1.1052958170572917, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.6023109287697815, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.8500000000000005, "CPUProfilingMetrics.MIN_CPU_UTIL": 5.375, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.043333333333334, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.5149811215525826, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 6.8500000000000005}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4966.563232421875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.200734609275045, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.201971258675506, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 21.620361328125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 21.4169921875, "BasicPerformanceMetrics.MAX_JITTER": 4.22412109375, "BasicPerformanceMetrics.MIN_JITTER": 0.027099609375, "BasicPerformanceMetrics.MEAN_JITTER": 1.0710911106418919, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.558111741196166, "CPUProfilingMetrics.MAX_CPU_UTIL": 13.883333333333335, "CPUProfilingMetrics.MIN_CPU_UTIL": 11.016666666666666, "CPUProfilingMetrics.MEAN_CPU_UTIL": 12.371666666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.9341603478822881, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 12.625}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTag Graph Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_graph.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:37:54Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 56.09375, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTag Graph Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4983.506754557292, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 37.85646957181185, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 36.49659839755778, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 6.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 188.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 32.607421875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 49.900472005208336, "BasicPerformanceMetrics.MAX_JITTER": 6.442138671875, "BasicPerformanceMetrics.MIN_JITTER": 0.00439453125, "BasicPerformanceMetrics.MEAN_JITTER": 1.216977267795139, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.9891846444706426, "CPUProfilingMetrics.MAX_CPU_UTIL": 29.275, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.625, "CPUProfilingMetrics.MEAN_CPU_UTIL": 14.544583333333335, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 12.699829382737507, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 26.92083333333333, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4901.582275390625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203788285941437, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.20078766218717, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 31.6962890625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 33.1376953125, "BasicPerformanceMetrics.MAX_JITTER": 6.69775390625, "BasicPerformanceMetrics.MIN_JITTER": 0.045166015625, "BasicPerformanceMetrics.MEAN_JITTER": 2.6316019694010415, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.457161986967299, "CPUProfilingMetrics.MAX_CPU_UTIL": 11.0375, "CPUProfilingMetrics.MIN_CPU_UTIL": 5.949999999999999, "CPUProfilingMetrics.MEAN_CPU_UTIL": 7.6049999999999995, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.7884455541055757, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 11.0375}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4965.3896484375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.200255119407746, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.209109580594895, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 32.809326171875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 31.353515625, "BasicPerformanceMetrics.MAX_JITTER": 12.767578125, "BasicPerformanceMetrics.MIN_JITTER": 0.048095703125, "BasicPerformanceMetrics.MEAN_JITTER": 2.345127415012669, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.8379051823035286, "CPUProfilingMetrics.MAX_CPU_UTIL": 31.5125, "CPUProfilingMetrics.MIN_CPU_UTIL": 22.2125, "CPUProfilingMetrics.MEAN_CPU_UTIL": 24.745, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 3.4274407361761927, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 23.887500000000003}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTag Graph Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_graph.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:46:08Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 37.65625, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTag Graph Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4972.430826822917, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 52.074666744976504, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 52.08720059361763, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 259.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 25.333170572916668, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 23.818359375, "BasicPerformanceMetrics.MAX_JITTER": 6.654541015625, "BasicPerformanceMetrics.MIN_JITTER": 0.00146484375, "BasicPerformanceMetrics.MEAN_JITTER": 0.9902704736138133, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.8276311522807901, "CPUProfilingMetrics.MAX_CPU_UTIL": 36.9375, "CPUProfilingMetrics.MIN_CPU_UTIL": 33.462500000000006, "CPUProfilingMetrics.MEAN_CPU_UTIL": 34.57416666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.0351902017483037, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 35.35833333333333, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4899.86083984375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203913858638924, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.20437143712727, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 23.95654296875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 23.73681640625, "BasicPerformanceMetrics.MAX_JITTER": 4.758544921875, "BasicPerformanceMetrics.MIN_JITTER": 0.01025390625, "BasicPerformanceMetrics.MEAN_JITTER": 1.5312906901041667, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.1637593770039205, "CPUProfilingMetrics.MAX_CPU_UTIL": 7.5625, "CPUProfilingMetrics.MIN_CPU_UTIL": 6.300000000000001, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.717500000000001, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.47292969879253716, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 6.3125}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4968.205078125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.200874154078136, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.191990395173054, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 23.77783203125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 25.2392578125, "BasicPerformanceMetrics.MAX_JITTER": 5.159423828125, "BasicPerformanceMetrics.MIN_JITTER": 0.0107421875, "BasicPerformanceMetrics.MEAN_JITTER": 1.3712570602829393, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.0654320777480555, "CPUProfilingMetrics.MAX_CPU_UTIL": 21.474999999999998, "CPUProfilingMetrics.MIN_CPU_UTIL": 20.2875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 20.76, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.4419700216077994, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 20.725}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTag Graph Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_graph.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:38:21Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Wed Mar 15 00:17:07 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 51.875, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTag Graph Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4971.258870442708, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 70.51107157531938, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 68.28758892865032, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 11.333333333333334, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 351.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 23.384928385416668, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 17.588704427083332, "BasicPerformanceMetrics.MAX_JITTER": 17.716064453125, "BasicPerformanceMetrics.MIN_JITTER": 0.005126953125, "BasicPerformanceMetrics.MEAN_JITTER": 3.12129768782747, "BasicPerformanceMetrics.STD_DEV_JITTER": 2.778092399535001, "CPUProfilingMetrics.MAX_CPU_UTIL": 11.945, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.2, "CPUProfilingMetrics.MEAN_CPU_UTIL": 5.129393939393939, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 4.871038018113185, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 10.37, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4895.722412109375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203014073981816, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.21299734566792, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 24.467529296875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 19.67724609375, "BasicPerformanceMetrics.MAX_JITTER": 27.980712890625, "BasicPerformanceMetrics.MIN_JITTER": 0.12548828125, "BasicPerformanceMetrics.MEAN_JITTER": 13.935201009114584, "BasicPerformanceMetrics.STD_DEV_JITTER": 8.655868859403062, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.455000000000001, "CPUProfilingMetrics.MIN_CPU_UTIL": 4.670000000000001, "CPUProfilingMetrics.MEAN_CPU_UTIL": 5.441000000000001, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.6268524547291812, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.640000000000001}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4975.775146484375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.19921590129367, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.09113981190607, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 1, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 19.96142578125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 12.282958984375, "BasicPerformanceMetrics.MAX_JITTER": 18.91064453125, "BasicPerformanceMetrics.MIN_JITTER": 0.005859375, "BasicPerformanceMetrics.MEAN_JITTER": 4.6704282407407405, "BasicPerformanceMetrics.STD_DEV_JITTER": 3.919311095826127, "CPUProfilingMetrics.MAX_CPU_UTIL": 10.23, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.25, "CPUProfilingMetrics.MEAN_CPU_UTIL": 4.75909090909091, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 4.427961165439985, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 8.575}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4973.922119140625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.198441211907095, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.15728763077545, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 21.840087890625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 28.618408203125, "BasicPerformanceMetrics.MAX_JITTER": 50.89453125, "BasicPerformanceMetrics.MIN_JITTER": 0.07958984375, "BasicPerformanceMetrics.MEAN_JITTER": 14.454510663006756, "BasicPerformanceMetrics.STD_DEV_JITTER": 11.24524177572293, "CPUProfilingMetrics.MAX_CPU_UTIL": 9.205000000000002, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.34500000000000003, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.501666666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 2.856419184145695, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 7.545}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTag Graph Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_graph.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:36:10Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "x86_64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.15.0-53-generic #59~20.04.1-Ubuntu SMP Thu Oct 20 15:10:22 UTC 2022", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 70.3125, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTag Graph Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4993.696940104167, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 102.38673824158148, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 96.72201983531191, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 27.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 510.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 11.093912760416666, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 23.682942708333332, "BasicPerformanceMetrics.MAX_JITTER": 7.44775390625, "BasicPerformanceMetrics.MIN_JITTER": 0.000244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.8939437866210938, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.068149376164518, "CPUProfilingMetrics.MAX_CPU_UTIL": 14.93125, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.1875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.624431818181818, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 6.529344184013596, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 14.177083333333334, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4923.05126953125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.202802622199982, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.156302923239872, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.650634765625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 33.087646484375, "BasicPerformanceMetrics.MAX_JITTER": 46.2978515625, "BasicPerformanceMetrics.MIN_JITTER": 0.302001953125, "BasicPerformanceMetrics.MEAN_JITTER": 16.638427734375, "BasicPerformanceMetrics.STD_DEV_JITTER": 12.308986953133498, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.0625, "CPUProfilingMetrics.MIN_CPU_UTIL": 4.74375, "CPUProfilingMetrics.MEAN_CPU_UTIL": 5.27125, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.4384917331033733, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 4.74375}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4994.420166015625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.1968065221829, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.06703281420746, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.90478515625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 21.671875, "BasicPerformanceMetrics.MAX_JITTER": 20.758056640625, "BasicPerformanceMetrics.MIN_JITTER": 0.01025390625, "BasicPerformanceMetrics.MEAN_JITTER": 4.975956244756712, "BasicPerformanceMetrics.STD_DEV_JITTER": 4.343603447297051, "CPUProfilingMetrics.MAX_CPU_UTIL": 10.19375, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.1875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 7.957291666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 3.51119010396483, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 8.85625}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4984.275146484375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.19869948003089, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.094646782451704, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.612060546875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 27.785888671875, "BasicPerformanceMetrics.MAX_JITTER": 50.579833984375, "BasicPerformanceMetrics.MIN_JITTER": 0.015869140625, "BasicPerformanceMetrics.MEAN_JITTER": 19.100704708614863, "BasicPerformanceMetrics.STD_DEV_JITTER": 12.507807066725656, "CPUProfilingMetrics.MAX_CPU_UTIL": 8.881250000000001, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.25, "CPUProfilingMetrics.MEAN_CPU_UTIL": 7.063541666666667, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 2.6308749155329596, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 8.08125}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTag Graph Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_graph.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:48:54Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "x86_64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 102.1875, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTag Graph Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4972.9150390625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 56.29393607520256, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 56.30500379224376, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 280.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 17.749430338541668, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 16.727132161458332, "BasicPerformanceMetrics.MAX_JITTER": 4.0302734375, "BasicPerformanceMetrics.MIN_JITTER": 0.00048828125, "BasicPerformanceMetrics.MEAN_JITTER": 1.0116089745391188, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.9001130124477038, "CPUProfilingMetrics.MAX_CPU_UTIL": 11.416666666666666, "CPUProfilingMetrics.MIN_CPU_UTIL": 9.624999999999998, "CPUProfilingMetrics.MEAN_CPU_UTIL": 10.264444444444445, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.5739445973878597, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 10.424999999999999, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4899.154541015625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203856918409302, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.205842575775266, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 17.67529296875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 16.721923828125, "BasicPerformanceMetrics.MAX_JITTER": 6.5224609375, "BasicPerformanceMetrics.MIN_JITTER": 0.08251953125, "BasicPerformanceMetrics.MEAN_JITTER": 1.3714853922526042, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.2762208164791524, "CPUProfilingMetrics.MAX_CPU_UTIL": 3.1666666666666665, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.75, "CPUProfilingMetrics.MEAN_CPU_UTIL": 2.3366666666666664, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.5674651237447695, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 3.1666666666666665}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4965.58837890625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.20091423633444, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.20790056566064, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 17.673583984375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 16.52490234375, "BasicPerformanceMetrics.MAX_JITTER": 3.684326171875, "BasicPerformanceMetrics.MIN_JITTER": 0.050537109375, "BasicPerformanceMetrics.MEAN_JITTER": 1.197273872994088, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.9240179603761576, "CPUProfilingMetrics.MAX_CPU_UTIL": 5.574999999999999, "CPUProfilingMetrics.MIN_CPU_UTIL": 4.983333333333333, "CPUProfilingMetrics.MEAN_CPU_UTIL": 5.356666666666667, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.21261598142086, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.55}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTagNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:09:46Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 56.09375, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTagNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4987.517822265625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 37.85687528869692, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 35.70665223708915, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 10.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 188.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 28.379231770833332, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 50.309488932291664, "BasicPerformanceMetrics.MAX_JITTER": 8.0478515625, "BasicPerformanceMetrics.MIN_JITTER": 0.002197265625, "BasicPerformanceMetrics.MEAN_JITTER": 1.4701926491477273, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.2288354069392453, "CPUProfilingMetrics.MAX_CPU_UTIL": 21.4375, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.625, "CPUProfilingMetrics.MEAN_CPU_UTIL": 9.74125, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 7.744736418950775, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 17.395833333333332, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4898.153076171875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203871661800646, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.207929238315522, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 27.646484375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 25.69873046875, "BasicPerformanceMetrics.MAX_JITTER": 8.3310546875, "BasicPerformanceMetrics.MIN_JITTER": 0.0283203125, "BasicPerformanceMetrics.MEAN_JITTER": 2.345001220703125, "BasicPerformanceMetrics.STD_DEV_JITTER": 2.004978735456671, "CPUProfilingMetrics.MAX_CPU_UTIL": 7.574999999999999, "CPUProfilingMetrics.MIN_CPU_UTIL": 3.9000000000000004, "CPUProfilingMetrics.MEAN_CPU_UTIL": 5.6725, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.1693855224005465, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.7375}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4965.076171875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.201093865530616, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.21101687214485, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 27.63330078125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 26.001953125, "BasicPerformanceMetrics.MAX_JITTER": 8.59765625, "BasicPerformanceMetrics.MIN_JITTER": 0.03564453125, "BasicPerformanceMetrics.MEAN_JITTER": 2.208507640941723, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.5723510630178295, "CPUProfilingMetrics.MAX_CPU_UTIL": 14.4625, "CPUProfilingMetrics.MIN_CPU_UTIL": 11.9875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 13.217500000000001, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.0634143124859656, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 11.9875}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTagNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:53:22Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 37.65625, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTagNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4989.111328125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 52.07507744302578, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 51.4401803784458, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 2.3333333333333335, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 259.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 19.655110677083332, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 35.252197265625, "BasicPerformanceMetrics.MAX_JITTER": 2.71533203125, "BasicPerformanceMetrics.MIN_JITTER": 0.00439453125, "BasicPerformanceMetrics.MEAN_JITTER": 0.8428512933686023, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.7027841240598968, "CPUProfilingMetrics.MAX_CPU_UTIL": 16.7125, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.25, "CPUProfilingMetrics.MEAN_CPU_UTIL": 8.14375, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 7.231725896043417, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 14.741666666666665, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4893.1669921875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203843191841868, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.218331007265991, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 25.794189453125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 18.8466796875, "BasicPerformanceMetrics.MAX_JITTER": 5.673583984375, "BasicPerformanceMetrics.MIN_JITTER": 0.00537109375, "BasicPerformanceMetrics.MEAN_JITTER": 1.4343414306640625, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.2428963889751103, "CPUProfilingMetrics.MAX_CPU_UTIL": 4.237500000000001, "CPUProfilingMetrics.MIN_CPU_UTIL": 3.35, "CPUProfilingMetrics.MEAN_CPU_UTIL": 3.8525, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.3117891916022749, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 3.975}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4965.300537109375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.200921658986175, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.20965173788348, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 19.71630859375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 18.281005859375, "BasicPerformanceMetrics.MAX_JITTER": 4.723876953125, "BasicPerformanceMetrics.MIN_JITTER": 0.0009765625, "BasicPerformanceMetrics.MEAN_JITTER": 1.3563793285472974, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.1351416093451883, "CPUProfilingMetrics.MAX_CPU_UTIL": 9.95, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.25, "CPUProfilingMetrics.MEAN_CPU_UTIL": 7.670833333333334, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 3.3561096856661616, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 8.9}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTagNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T06:45:47Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Wed Mar 15 00:17:07 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 51.875, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTagNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4976.709879557292, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 83.94718116641211, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 82.91041066953973, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 5.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 418.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 14.570068359375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 11.489013671875, "BasicPerformanceMetrics.MAX_JITTER": 11.79931640625, "BasicPerformanceMetrics.MIN_JITTER": 0.00146484375, "BasicPerformanceMetrics.MEAN_JITTER": 1.357513427734375, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.4817453105367744, "CPUProfilingMetrics.MAX_CPU_UTIL": 7.19, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.15, "CPUProfilingMetrics.MEAN_CPU_UTIL": 3.2181818181818183, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 2.8025477328603237, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 6.368333333333333, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4894.314697265625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203482755566103, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.215934833110383, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 21.096435546875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 15.12353515625, "BasicPerformanceMetrics.MAX_JITTER": 26.339599609375, "BasicPerformanceMetrics.MIN_JITTER": 0.052001953125, "BasicPerformanceMetrics.MEAN_JITTER": 9.435445149739584, "BasicPerformanceMetrics.STD_DEV_JITTER": 7.941061721672677, "CPUProfilingMetrics.MAX_CPU_UTIL": 2.465, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.2, "CPUProfilingMetrics.MEAN_CPU_UTIL": 1.685, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.4513756750202651, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 1.85}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4983.61865234375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.199776249659756, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.1972223253705, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 14.4892578125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 14.70068359375, "BasicPerformanceMetrics.MAX_JITTER": 20.553955078125, "BasicPerformanceMetrics.MIN_JITTER": 0.0068359375, "BasicPerformanceMetrics.MEAN_JITTER": 4.296779965394295, "BasicPerformanceMetrics.STD_DEV_JITTER": 4.007593151396193, "CPUProfilingMetrics.MAX_CPU_UTIL": 5.18, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.3, "CPUProfilingMetrics.MEAN_CPU_UTIL": 4.034166666666667, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.2777924214136747, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 4.529999999999999}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4978.76708984375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.1987929919926, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.127940771920603, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 13.99853515625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 25.6796875, "BasicPerformanceMetrics.MAX_JITTER": 26.107177734375, "BasicPerformanceMetrics.MIN_JITTER": 0.012451171875, "BasicPerformanceMetrics.MEAN_JITTER": 7.787990260768581, "BasicPerformanceMetrics.STD_DEV_JITTER": 6.257325678135366, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.2700000000000005, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.545, "CPUProfilingMetrics.MEAN_CPU_UTIL": 3.4608333333333334, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.721838689373143, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 4.4}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTagNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:50:29Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "x86_64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.15.0-53-generic #59~20.04.1-Ubuntu SMP Thu Oct 20 15:10:22 UTC 2022", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 83.75, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTagNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4989.017659505208, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 102.38682857097332, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 99.55185369023422, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 13.333333333333334, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 510.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.168538411458334, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 20.14404296875, "BasicPerformanceMetrics.MAX_JITTER": 7.8857421875, "BasicPerformanceMetrics.MIN_JITTER": 0.000244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.7341056034482759, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.8879469672790238, "CPUProfilingMetrics.MAX_CPU_UTIL": 8.9875, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.0625, "CPUProfilingMetrics.MEAN_CPU_UTIL": 4.020075757575757, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 3.7881164978261403, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 7.966666666666666, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4920.376953125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.202855992616081, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.161823062813164, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.118896484375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 29.9072265625, "BasicPerformanceMetrics.MAX_JITTER": 36.933349609375, "BasicPerformanceMetrics.MIN_JITTER": 0.187744140625, "BasicPerformanceMetrics.MEAN_JITTER": 13.511072794596354, "BasicPerformanceMetrics.STD_DEV_JITTER": 10.74949430281793, "CPUProfilingMetrics.MAX_CPU_UTIL": 2.9625, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.70625, "CPUProfilingMetrics.MEAN_CPU_UTIL": 2.3775000000000004, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.4010065460812329, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 1.70625}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4987.548583984375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.19791534344826, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.14979001173773, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.06591796875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 14.05322265625, "BasicPerformanceMetrics.MAX_JITTER": 19.60400390625, "BasicPerformanceMetrics.MIN_JITTER": 0.012939453125, "BasicPerformanceMetrics.MEAN_JITTER": 4.334905227558725, "BasicPerformanceMetrics.STD_DEV_JITTER": 3.805935867079221, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.26875, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.4375, "CPUProfilingMetrics.MEAN_CPU_UTIL": 4.611458333333333, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.9432623204756878, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.09375}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4985.48388671875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.1991195462425, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.087350276990687, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 10.11181640625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 28.5634765625, "BasicPerformanceMetrics.MAX_JITTER": 44.39013671875, "BasicPerformanceMetrics.MIN_JITTER": 0.0244140625, "BasicPerformanceMetrics.MEAN_JITTER": 18.522754566089528, "BasicPerformanceMetrics.STD_DEV_JITTER": 12.677575741769282, "CPUProfilingMetrics.MAX_CPU_UTIL": 4.7250000000000005, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.75, "CPUProfilingMetrics.MEAN_CPU_UTIL": 3.8093749999999997, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.3933470549812779, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 4.55625}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "apriltag_ros AprilTagNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/apriltag_ros_apriltag_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:26:07Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "x86_64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 102.1875, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.INPUT_DATA_START_TIME": 3.0, "BenchmarkMetadata.INPUT_DATA_END_TIME": 3.5, "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: apriltag_ros AprilTagNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: 3.5\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: 3.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 10\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 600.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4997.042154947917, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 185.25400548960957, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 182.19262943469187, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 14.333333333333334, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 925.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 5.988118489583333, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 9.530110677083334, "BasicPerformanceMetrics.MAX_JITTER": 6.496337890625, "BasicPerformanceMetrics.MIN_JITTER": 0.0, "BasicPerformanceMetrics.MEAN_JITTER": 0.266068279611617, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.38272721588598085, "CPUProfilingMetrics.MAX_CPU_UTIL": 51.26666666666667, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.16666666666666666, "CPUProfilingMetrics.MEAN_CPU_UTIL": 24.40530303030303, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 24.639560130970093, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 50.297222222222224, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4900.088623046875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203758799683225, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.203897081540946, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 5.83642578125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 5.77001953125, "BasicPerformanceMetrics.MAX_JITTER": 1.026123046875, "BasicPerformanceMetrics.MIN_JITTER": 0.02197265625, "BasicPerformanceMetrics.MEAN_JITTER": 0.291168212890625, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.25268249817021077, "CPUProfilingMetrics.MAX_CPU_UTIL": 2.9499999999999997, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.3416666666666668, "CPUProfilingMetrics.MEAN_CPU_UTIL": 2.158333333333333, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.527467745196066, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 2.0}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4983.658935546875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.20001808744033, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.19673574774433, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 5.556884765625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 5.82861328125, "BasicPerformanceMetrics.MAX_JITTER": 1.461669921875, "BasicPerformanceMetrics.MIN_JITTER": 0.00146484375, "BasicPerformanceMetrics.MEAN_JITTER": 0.27171213034815433, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.2175841037134863, "CPUProfilingMetrics.MAX_CPU_UTIL": 16.2, "CPUProfilingMetrics.MIN_CPU_UTIL": 15.566666666666668, "CPUProfilingMetrics.MEAN_CPU_UTIL": 15.84333333333333, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.23276120333461425, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 16.016666666666666}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4966.643798828125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.200841494540548, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.20148133743603, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 5.762451171875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 5.6572265625, "BasicPerformanceMetrics.MAX_JITTER": 1.345703125, "BasicPerformanceMetrics.MIN_JITTER": 0.000244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.2915517446157095, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.23871500335189133, "CPUProfilingMetrics.MAX_CPU_UTIL": 9.625, "CPUProfilingMetrics.MIN_CPU_UTIL": 8.858333333333333, "CPUProfilingMetrics.MEAN_CPU_UTIL": 9.205, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.24679050945195527, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 8.858333333333333}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "image_proc::RectifyNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_proc_rectify_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T06:55:29Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 185.078125, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_proc::RectifyNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 100\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 2500.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 5007.840413411458, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 195.00182244364032, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 187.1473331134782, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 37.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 974.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 6.211507161458333, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 19.1787109375, "BasicPerformanceMetrics.MAX_JITTER": 16.339599609375, "BasicPerformanceMetrics.MIN_JITTER": 0.00048828125, "BasicPerformanceMetrics.MEAN_JITTER": 0.8953767144795016, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.1467821426450948, "CPUProfilingMetrics.MAX_CPU_UTIL": 58.1375, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.75, "CPUProfilingMetrics.MEAN_CPU_UTIL": 28.243106060606063, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 27.682316849118596, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 57.337500000000006, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4900.391845703125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203759308065544, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.203265692689893, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 5.80078125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 6.037841796875, "BasicPerformanceMetrics.MAX_JITTER": 12.5732421875, "BasicPerformanceMetrics.MIN_JITTER": 0.0224609375, "BasicPerformanceMetrics.MEAN_JITTER": 1.1947428385416667, "BasicPerformanceMetrics.STD_DEV_JITTER": 2.027210417005194, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.45, "CPUProfilingMetrics.MIN_CPU_UTIL": 4.987500000000001, "CPUProfilingMetrics.MEAN_CPU_UTIL": 5.58, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.49343185953077645, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.7125}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4983.0859375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.19949607417275, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.20365768576512, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 6.045166015625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 5.70068359375, "BasicPerformanceMetrics.MAX_JITTER": 5.585693359375, "BasicPerformanceMetrics.MIN_JITTER": 0.000244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.5806663564387584, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.6790004000871129, "CPUProfilingMetrics.MAX_CPU_UTIL": 19.25, "CPUProfilingMetrics.MIN_CPU_UTIL": 18.275, "CPUProfilingMetrics.MEAN_CPU_UTIL": 18.557499999999997, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.3580851853958777, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 18.4375}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4965.3837890625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.200649992309746, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.209145228695622, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 6.867919921875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 5.47119140625, "BasicPerformanceMetrics.MAX_JITTER": 7.58837890625, "BasicPerformanceMetrics.MIN_JITTER": 0.001220703125, "BasicPerformanceMetrics.MEAN_JITTER": 0.933349609375, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.9787423457229263, "CPUProfilingMetrics.MAX_CPU_UTIL": 11.05, "CPUProfilingMetrics.MIN_CPU_UTIL": 8.875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 9.932500000000001, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.7735712636855127, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 9.7375}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "image_proc::RectifyNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_proc_rectify_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T08:03:35Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 194.8046875, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_proc::RectifyNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 100\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 2500.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4999.922119140625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 165.82192987447544, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 162.00254677885147, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 18.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 828.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 7.152587890625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 13.376302083333334, "BasicPerformanceMetrics.MAX_JITTER": 4.991943359375, "BasicPerformanceMetrics.MIN_JITTER": 0.000244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.8234838958398194, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.587584010462973, "CPUProfilingMetrics.MAX_CPU_UTIL": 68.3875, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.125, "CPUProfilingMetrics.MEAN_CPU_UTIL": 31.03068181818182, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 32.91807187059966, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 66.64999999999999, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4900.115966796875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203750157191562, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.203840141498565, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 6.29833984375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 6.255126953125, "BasicPerformanceMetrics.MAX_JITTER": 2.39404296875, "BasicPerformanceMetrics.MIN_JITTER": 0.0029296875, "BasicPerformanceMetrics.MEAN_JITTER": 0.384368896484375, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.42777845839207435, "CPUProfilingMetrics.MAX_CPU_UTIL": 12.725, "CPUProfilingMetrics.MIN_CPU_UTIL": 3.8375, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.15, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 3.3567748658496592, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.7375}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4981.4970703125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.199251291408174, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.222859868344834, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 8.033203125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 6.07958984375, "BasicPerformanceMetrics.MAX_JITTER": 3.410400390625, "BasicPerformanceMetrics.MIN_JITTER": 0.0009765625, "BasicPerformanceMetrics.MEAN_JITTER": 0.3660872286598154, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.5891074664846498, "CPUProfilingMetrics.MAX_CPU_UTIL": 25.55, "CPUProfilingMetrics.MIN_CPU_UTIL": 23.3875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 24.2375, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.7505831066577505, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 23.3875}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4966.49365234375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.20075539246186, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.202394385264768, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 6.347412109375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 6.077880859375, "BasicPerformanceMetrics.MAX_JITTER": 3.426025390625, "BasicPerformanceMetrics.MIN_JITTER": 0.00244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.34471666490709457, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.5244729554604504, "CPUProfilingMetrics.MAX_CPU_UTIL": 12.8125, "CPUProfilingMetrics.MIN_CPU_UTIL": 11.8875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 12.505, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.3781203512110928, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 12.8125}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "image_proc::RectifyNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_proc_rectify_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T06:52:01Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Wed Mar 15 00:17:07 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 165.625, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_proc::RectifyNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 100\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 2500.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 5011.115559895833, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 194.98777414572444, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 188.91212271610812, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 28.666666666666668, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 974.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 4.271484375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 19.930582682291668, "BasicPerformanceMetrics.MAX_JITTER": 5.3330078125, "BasicPerformanceMetrics.MIN_JITTER": 0.0, "BasicPerformanceMetrics.MEAN_JITTER": 0.7888703208556149, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.7807628006922117, "CPUProfilingMetrics.MAX_CPU_UTIL": 29.375, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.15, "CPUProfilingMetrics.MEAN_CPU_UTIL": 13.320454545454547, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 13.833210668788517, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 28.628333333333334, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4904.35693359375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.201528505775446, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.195016528570987, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 3.79931640625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 6.929931640625, "BasicPerformanceMetrics.MAX_JITTER": 5.970703125, "BasicPerformanceMetrics.MIN_JITTER": 0.001220703125, "BasicPerformanceMetrics.MEAN_JITTER": 0.8275705973307291, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.1305080967834902, "CPUProfilingMetrics.MAX_CPU_UTIL": 3.075, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.5549999999999999, "CPUProfilingMetrics.MEAN_CPU_UTIL": 1.217, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.9646999533533731, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 0.6}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4987.36572265625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.19431182368044, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.151995398528996, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 4.091064453125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 7.59716796875, "BasicPerformanceMetrics.MAX_JITTER": 6.0703125, "BasicPerformanceMetrics.MIN_JITTER": 0.00439453125, "BasicPerformanceMetrics.MEAN_JITTER": 0.5933387295511745, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.6691427230195265, "CPUProfilingMetrics.MAX_CPU_UTIL": 11.055000000000001, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.0, "CPUProfilingMetrics.MEAN_CPU_UTIL": 9.031666666666668, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 3.6022315614383014, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 10.33}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4968.52490234375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.199073531352553, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.190046935105844, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 4.99658203125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 6.481689453125, "BasicPerformanceMetrics.MAX_JITTER": 4.468994140625, "BasicPerformanceMetrics.MIN_JITTER": 0.00146484375, "BasicPerformanceMetrics.MEAN_JITTER": 0.885425464527027, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.9054682486884615, "CPUProfilingMetrics.MAX_CPU_UTIL": 5.709999999999999, "CPUProfilingMetrics.MIN_CPU_UTIL": 2.145, "CPUProfilingMetrics.MEAN_CPU_UTIL": 4.289166666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 1.1356621294303255, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 5.709999999999999}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "image_proc::RectifyNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_proc_rectify_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T08:07:53Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "x86_64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.15.0-53-generic #59~20.04.1-Ubuntu SMP Thu Oct 20 15:10:22 UTC 2022", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 194.8046875, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_proc::RectifyNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 100\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 2500.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4997.471110026042, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 622.9545893240639, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 619.7893153610273, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 15.666666666666666, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 3113.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 1.926025390625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 2.243896484375, "BasicPerformanceMetrics.MAX_JITTER": 4.12060546875, "BasicPerformanceMetrics.MIN_JITTER": 0.0, "BasicPerformanceMetrics.MEAN_JITTER": 0.07487857673117324, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.1273964537249417, "CPUProfilingMetrics.MAX_CPU_UTIL": 37.725, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.1875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 16.40189393939394, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 17.343613702454245, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 35.46666666666666, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4906.33984375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.20316046881131, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.190896185818254, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 1.649169921875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 7.546630859375, "BasicPerformanceMetrics.MAX_JITTER": 12.384033203125, "BasicPerformanceMetrics.MIN_JITTER": 0.033203125, "BasicPerformanceMetrics.MEAN_JITTER": 2.357365926106771, "BasicPerformanceMetrics.STD_DEV_JITTER": 3.2347003943701536, "CPUProfilingMetrics.MAX_CPU_UTIL": 2.18125, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.38125, "CPUProfilingMetrics.MEAN_CPU_UTIL": 1.75, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.2969111820056631, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 1.38125}, "60.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4989.330322265625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 60.19361593994354, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 60.128309937950114, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 300, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 1.743408203125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 7.156494140625, "BasicPerformanceMetrics.MAX_JITTER": 12.400146484375, "BasicPerformanceMetrics.MIN_JITTER": 0.0009765625, "BasicPerformanceMetrics.MEAN_JITTER": 1.112996146182886, "BasicPerformanceMetrics.STD_DEV_JITTER": 2.4357359363470397, "CPUProfilingMetrics.MAX_CPU_UTIL": 15.50625, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.30625, "CPUProfilingMetrics.MEAN_CPU_UTIL": 12.572916666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 5.0610050090262595, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 15.375}, "30.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4972.648193359375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 30.197828213874153, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 30.165013523440997, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 150, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 1.795166015625, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 7.19873046875, "BasicPerformanceMetrics.MAX_JITTER": 11.675537109375, "BasicPerformanceMetrics.MIN_JITTER": 0.000244140625, "BasicPerformanceMetrics.MEAN_JITTER": 0.9338840793918919, "BasicPerformanceMetrics.STD_DEV_JITTER": 1.9612979971080644, "CPUProfilingMetrics.MAX_CPU_UTIL": 8.568750000000001, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.5625, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.925, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 2.8562545587126276, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 7.9375}, "custom": {"data_resolution": "HD (1280,720)"}, "metadata": {"BenchmarkMetadata.NAME": "image_proc::RectifyNode Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_proc_rectify_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T08:29:04Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "x86_64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 622.7734375, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_storage", "BenchmarkMetadata.INPUT_DATA_SIZE": 3087908864, "BenchmarkMetadata.INPUT_DATA_HASH": "5e8f11201fe10dbac7307a8628553e94", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_proc::RectifyNode Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info:\n data_resolution: Resolution(1280, 720, HD)\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_storage\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 100\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 2500.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 4961.859375, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 28.013350572102258, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 28.01369194603439, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 139.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 36.709147135416664, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 36.64794921875, "BasicPerformanceMetrics.MAX_JITTER": 1.287353515625, "BasicPerformanceMetrics.MIN_JITTER": 0.000732421875, "BasicPerformanceMetrics.MEAN_JITTER": 0.1553482835310219, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.13880038992228247, "CPUProfilingMetrics.MAX_CPU_UTIL": 10.483333333333333, "CPUProfilingMetrics.MIN_CPU_UTIL": 9.0, "CPUProfilingMetrics.MEAN_CPU_UTIL": 9.713333333333333, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.41290041103398517, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 9.797222222222222, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4900.03759765625, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203981475986987, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.20400333742656, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 36.585205078125, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 36.57470703125, "BasicPerformanceMetrics.MAX_JITTER": 0.557861328125, "BasicPerformanceMetrics.MIN_JITTER": 0.0361328125, "BasicPerformanceMetrics.MEAN_JITTER": 0.16943359375, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.10224226124942692, "CPUProfilingMetrics.MAX_CPU_UTIL": 3.9916666666666667, "CPUProfilingMetrics.MIN_CPU_UTIL": 3.0833333333333335, "CPUProfilingMetrics.MEAN_CPU_UTIL": 3.4666666666666672, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.3279142841929546, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 3.1666666666666665}, "metadata": {"BenchmarkMetadata.NAME": "image_transport H264 Decoder Node Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_transport_h264_decoder_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:43:05Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 27.8125, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_mezzanine", "BenchmarkMetadata.INPUT_DATA_SIZE": 2057437184, "BenchmarkMetadata.INPUT_DATA_HASH": "c84d7420c5524d882f1019d350232fb1", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_transport H264 Decoder Node Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info: {}\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_mezzanine\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 1\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 200.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 5324.946126302083, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 28.013612917539636, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 25.600255521379637, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 2.6666666666666665, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 139.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 40.866129557291664, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 404.2188313802083, "BasicPerformanceMetrics.MAX_JITTER": 18.4013671875, "BasicPerformanceMetrics.MIN_JITTER": 0.00048828125, "BasicPerformanceMetrics.MEAN_JITTER": 1.716968677662037, "BasicPerformanceMetrics.STD_DEV_JITTER": 3.652003122561876, "CPUProfilingMetrics.MAX_CPU_UTIL": 18.299999999999997, "CPUProfilingMetrics.MIN_CPU_UTIL": 1.125, "CPUProfilingMetrics.MEAN_CPU_UTIL": 9.392916666666666, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 6.68498947798687, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 14.566666666666668, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4898.8330078125, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203877762526767, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.206512432708285, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 42.458740234375, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 41.19384765625, "BasicPerformanceMetrics.MAX_JITTER": 18.67333984375, "BasicPerformanceMetrics.MIN_JITTER": 0.0517578125, "BasicPerformanceMetrics.MEAN_JITTER": 6.6923065185546875, "BasicPerformanceMetrics.STD_DEV_JITTER": 5.4827866699951295, "CPUProfilingMetrics.MAX_CPU_UTIL": 28.9125, "CPUProfilingMetrics.MIN_CPU_UTIL": 20.9375, "CPUProfilingMetrics.MEAN_CPU_UTIL": 26.3, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 2.8401584462842915, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 28.9125}, "metadata": {"BenchmarkMetadata.NAME": "image_transport H264 Decoder Node Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_transport_h264_decoder_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:58:38Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Sun Mar 19 07:55:28 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 27.8125, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_mezzanine", "BenchmarkMetadata.INPUT_DATA_SIZE": 2057437184, "BenchmarkMetadata.INPUT_DATA_HASH": "c84d7420c5524d882f1019d350232fb1", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_transport H264 Decoder Node Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info: {}\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_mezzanine\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 1\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 200.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"BasicPerformanceMetrics.RECEIVED_DURATION": 5350.896321614583, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 28.01353940505049, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 25.416304196190854, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 3.0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 139.0, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 41.16796875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 430.2591959635417, "BasicPerformanceMetrics.MAX_JITTER": 27.55078125, "BasicPerformanceMetrics.MIN_JITTER": 0.000732421875, "BasicPerformanceMetrics.MEAN_JITTER": 0.9848651031949627, "BasicPerformanceMetrics.STD_DEV_JITTER": 2.1572855053914637, "CPUProfilingMetrics.MAX_CPU_UTIL": 15.7625, "CPUProfilingMetrics.MIN_CPU_UTIL": 0.25, "CPUProfilingMetrics.MEAN_CPU_UTIL": 8.357083333333334, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 6.34438669177582, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 14.579166666666666, "10.0fps": {"BasicPerformanceMetrics.RECEIVED_DURATION": 4899.8779296875, "BasicPerformanceMetrics.MEAN_PLAYBACK_FRAME_RATE": 10.203866069474776, "BasicPerformanceMetrics.MEAN_FRAME_RATE": 10.20433584621747, "BasicPerformanceMetrics.NUM_MISSED_FRAMES": 0, "BasicPerformanceMetrics.NUM_FRAMES_SENT": 50, "BasicPerformanceMetrics.FIRST_SENT_RECEIVED_LATENCY": 41.285888671875, "BasicPerformanceMetrics.LAST_SENT_RECEIVED_LATENCY": 41.060302734375, "BasicPerformanceMetrics.MAX_JITTER": 0.692138671875, "BasicPerformanceMetrics.MIN_JITTER": 0.003662109375, "BasicPerformanceMetrics.MEAN_JITTER": 0.19063822428385416, "BasicPerformanceMetrics.STD_DEV_JITTER": 0.14379403529647114, "CPUProfilingMetrics.MAX_CPU_UTIL": 6.875, "CPUProfilingMetrics.MIN_CPU_UTIL": 5.6875, "CPUProfilingMetrics.MEAN_CPU_UTIL": 6.180000000000001, "CPUProfilingMetrics.STD_DEV_CPU_UTIL": 0.4100762124288606, "CPUProfilingMetrics.BASELINE_CPU_UTIL": 6.05}, "metadata": {"BenchmarkMetadata.NAME": "image_transport H264 Decoder Node Benchmark", "BenchmarkMetadata.TEST_FILE_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/scripts/image_transport_h264_decoder_node.py", "BenchmarkMetadata.TEST_DATETIME": "2023-04-04T07:56:32Z", "BenchmarkMetadata.DEVICE_HOSTNAME": "ros", "BenchmarkMetadata.DEVICE_ARCH": "aarch64", "BenchmarkMetadata.DEVICE_OS": "Linux 5.10.104-tegra #1 SMP PREEMPT Wed Mar 15 00:17:07 PDT 2023", "BenchmarkMetadata.BENCHMARK_MODE": 1, "BenchmarkMetadata.PEAK_THROUGHPUT_PREDICTION": 27.8125, "BenchmarkMetadata.INPUT_DATA_PATH": "/workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets/datasets/r2b_dataset/r2b_mezzanine", "BenchmarkMetadata.INPUT_DATA_SIZE": 2057437184, "BenchmarkMetadata.INPUT_DATA_HASH": "c84d7420c5524d882f1019d350232fb1", "BenchmarkMetadata.CONFIG": "ros2_benchmark_config:\n additional_fixed_publisher_rate_tests:\n - 10.0\n - 30.0\n - 60.0\n assets_root: /workspaces/isaac_ros-dev/ros_ws/src/ros2_benchmark/assets\n benchmark_duration: 5.0\n benchmark_mode: BenchmarkMode.LOOPING\n benchmark_name: image_transport H264 Decoder Node Benchmark\n benchmark_namespace: r2b\n binary_search_acceptable_frame_loss_fraction: 0.05\n binary_search_acceptable_frame_rate_drop: 10.0\n binary_search_duration_fraction: 1.0\n binary_search_terminal_interval_width: 10.0\n cpu_profiling_interval_sec: 1.0\n custom_report_info: {}\n default_config_version: 0.30.0\n default_service_future_timeout_sec: 15.0\n enable_cpu_profiler: true\n enforce_publisher_rate: false\n input_data_end_time: -1.0\n input_data_path: datasets/r2b_dataset/r2b_mezzanine\n input_data_start_time: -1.0\n linear_scan_acceptable_frame_loss_fraction: 0.01\n linear_scan_acceptable_frame_rate_drop: 5.0\n linear_scan_duration_fraction: 1.0\n linear_scan_step_size: 5.0\n load_data_in_real_time: false\n log_file_name: kpi.json\n log_folder: /output\n monitor_info_list:\n - calculators:\n - class_name: BasicPerformanceCalculator\n config:\n report_prefix: ''\n module_name: ros2_benchmark.basic_performance_calculator\n service_name: start_monitoring0\n play_messages_service_future_timeout_sec: 15.0\n playback_message_buffer_size: 1\n publish_tf_messages_in_set_data: false\n publish_tf_static_messages_in_set_data: false\n publisher_lower_frequency: 10.0\n publisher_upper_frequency: 200.0\n record_data_timeline: false\n revise_timestamps_as_message_ids: false\n set_data_service_future_timeout_sec: 60.0\n setup_service_client_timeout_sec: 20.0\n start_monitoring_service_timeout_sec: 10\n start_recording_service_future_timeout_sec: 35.0\n start_recording_service_timeout_sec: 30\n test_iterations: 5\n"}} |
Oops, something went wrong.