All notable changes to this project will be documented in this file.
Changes are grouped by the date they are merged to the main branch of the repository and are ordered from newest to oldest. Dates use the ISO 8601 extended calendar date format, i.e. YYYY-MM-DD.
- Update to Rocket League harness for artifact management and new menu navigation.
- Update some timings in RDR2 harness.
- Update encoding presets.
- Add AMD VCE encoding handbrake presets.
- Fix to Handbrake encoding harness.
- Add Alan Wake 2 test harness.
- Add Tiny Tina's Wonderlands harness back with updates.
- Correct typos in MSI Kombustor and PugetBench harnesses.
- Update test name in y-cruncher harness to not be the tuning used.
- Update PugetBench harness to use the latest benchmark version available.
- Fix to Cyberpunk 2077 harness not creating artifact manifest.
- Updated Cyberpunk 2077 harness to take screenshots of settings and results.
- Added a harness for the Black Myth Wukong Benchmark tool
- Implemented the artifact manager to capture screenshots of in game settings and config for atomic heart
- Added steam build ID tracking to atomic heart
- Implemented the artifact manager to capture screenshots of in game settings and results for the following games:
- Cities Skylines 2
- Counterstrike 2
- F1 23
- Grid Legends
- Returnal
- Total War Pharaoh
- Total War Warhammer 3
- Also implemented steam build ID tracking for the same games
- Add screen splitting to Keras Service.
- Add Grid Legends test harness.
- Add Total War: Pharaoh harness.
- Update godot compile harness with some path fixes.
- Add back Shadow of The Tomb Raider harness that uses Keras.
- Add
artifacts.py
toharness_utils
for capturing test artifacts.
- Add Stellaris harness based on one_year console command.
- Add City Skylines 2 harness.
- Update blender harness to support different scenes.
- Fixed some bugs with handbrake harness.
- Add godot compile harness.
- Add handbrake test harness.
- Update Y Cruncher test to use version 0.8.5.9543 of Y Cruncher
- Add initial c-ray harness.
- Add initial primesieve harness.
- Update y-cruncher version, and change parameter to 1b from 5b to loosen memory constraints.
- Update y-cruncher to run 5 times and average the score.
- Update 7-Zip to used a locked version, 24.07.
- Update 7-Zip to iterate 3 times each test run.
- Fix type error in DOTA2
read_config
utility function
- Update DOTA 2 test utils script to check for alternative file path when attempting to read video config file if initial file is not found
- small tweak to mouse input timings in Total War: Warhammer III test script
- Update DOTA 2 test harness to use fallback values and not fail when unable to mark test start or end times
- Update start and end time marking strategies for Atomic Heart test harness
- Update start and end time marking strategies for F1 23 test harness
- Update start and end time marking strategies for TLoU: Part I test harness
- Fix Blender Benchmark harness not running on device type gpu when Intel Arc GPU present.
- Update non-game benchmark reports to fit new schema. This is for downstream reporting compatibility.
- Update menu navigation and start/end time marking for Rocket League harness
- Update Returnal harness to not fail if end time prompt not found
- Update menu navigation and start/end time marking strategies for Cyberpunk 2077 test harness
- Add initial 3DMark harness.
- Update strategies for marking start and end time in Returnal test harness
- Minor changes to logging output in DOTA 2 and Total War: Warhammer III test harnesses
- Update Cinebench test harness to allow for sequential runs of different Cinebench performance tests
- Update DOTA 2 test harness
- Track configuration file
- Update script timings
- Update README and LICENSES
- Update Rocket League test harness
- Update inputs for main menu navigation
- Update Total War: Warhammer III test harness
- Update strategies for marking start/end times
- Rename
Included Binaries
section in LICENSES.md toRequired Binaries
- Update strategies for marking benchmark start and end times in DOTA 2 test harness
- Fix issues with links in
CONTRIBUTING.MD
found by @chomes and @OwenHunter
- Remove deprecated test harnesses
- CS:GO
- FarCry6
- Hitman 3
- Overwatch
- Shadow of the Tomb Raider
- Tiny Tina's Wonderland
- Remove unused dependencies
- Deprecate CS:GO test harness.
- Add Cinebench 2024 test harness.
- Remove deprecated Cinebench R23 harness.
- Add Rocket League test harness.
- Add Dota 2 test harness.
- Add Blender barbershop render test harness.
- Fix typos found by community members @TheDevMinerTV, @KikisGamingService, @seanmrice, @Intron014, @Jcraft153
- Add readme file to the game settings directory.
- Add logging to
harness_utils.misc.remove_files
when attempting to remove a file that doesn't exist. - Fix MSI Kombustor harness failing when benchmark option is False
- First