Add Coaching & ScoreBoard class (result tracking)#72

Merged

andreaskoepf merged 40 commits intomainfrom accuracy_tracking

Feb 6, 2025

+549-39

Commits on Feb 6, 2025

feat: Add Coach and ScoreBoard classes for performance tracking and difficulty adjustment
andreaskoepf
committed
refactor: Move difficulty parameters to nested metadata dictionary
andreaskoepf
committed
feat: Add aggregate method to ScoreBoard for grouping scores by difficulty parameters
andreaskoepf
committed
refactor: Optimize aggregate method to avoid list slicing and improve memory efficiency
andreaskoepf
committed
test: Add comprehensive unit test for Coach with ChainSum dataset
andreaskoepf
committed
feat: Add GroupedScores class to wrap aggregated scores with total count
andreaskoepf
committed
refactor: Move GroupedScores class below import statement
andreaskoepf
committed
feat: Add stats() method to GroupedScores with mean, std, min, max calculation
andreaskoepf
committed
fix: Add missing imports for GroupedScores, OrderedDict, and math
andreaskoepf
committed
fix: Resolve GroupedScores length check and empty case handling
andreaskoepf
committed
fix: Correct iteration over GroupedScores in test_coach_with_chain_sum
andreaskoepf
committed
lint
andreaskoepf
committed
feat: Add optional JSONL score logging to Coach with configurable log file path
andreaskoepf
committed
feat: Log full dataset entry instead of only metadata in Coach class
andreaskoepf
committed
feat: Add __str__() method to GroupedScores for detailed score reporting
andreaskoepf
committed
refactor: Create ScoreStats class with tuple-based score statistics
andreaskoepf
committed
refactor: Remove total_scores from ScoreStats class and related code
andreaskoepf
committed
feat: Add formatted score list display with last 100 values in GroupedScores.__str__
andreaskoepf
committed
style: Compact ScoreStats __str__ output with unicode mean and std
andreaskoepf
committed
test: Add print statement for debugging in test_coach_with_chain_sum
andreaskoepf
committed
test: Update test assertions for ScoreStats string representation
andreaskoepf
committed
style: Compact ScoreStats __str__ output with inline parameters
andreaskoepf
committed
refactor: Remove unnecessary empty lines in string representations
andreaskoepf
committed
feat: Add count to ScoreStats tuple for tracking number of elements
andreaskoepf
committed
fix: Correct type checking for stats values in coaching test
andreaskoepf
committed
fix: Correct stats calculation for empty groups in test_coach_with_chain_sum
andreaskoepf
committed
refactor: Compact GroupedScores __str__ with single-line stats display
andreaskoepf
committed
test: Add print statements for debugging in test_coach_with_chain_sum
andreaskoepf
committed
test: Update test assertions to match new string format
andreaskoepf
committed
refactor: Remove automatic difficulty update in score_answer method
andreaskoepf
committed
refactor: Prioritize source dataset and index in metadata key generation
andreaskoepf
committed
feat: Add unit test for Coach with CompositeDataset and multiple datasets
andreaskoepf
committed
fix: Add difficulty metadata to leg counting dataset
andreaskoepf
committed
refactor: Remove max_count from LegCountingDataset difficulty and update test config
andreaskoepf
committed
feat: Add answer to log_entry in Coach's score_answer method
andreaskoepf
committed
feat: Add clear() method to ScoreBoard to reset all stored data
andreaskoepf
committed
feat: Add __len__ method to ScoreBoard to return number of scores
andreaskoepf
committed
lint
andreaskoepf
committed
feat: Add update_dataset_config method to CompositeDataset
andreaskoepf
committed
cleanup __init__ & imports
andreaskoepf
committed