Implement New Configuration System

[ShohamBit]

Implement New Configuration System (Config File and Flags)

Description

This issue tracks the implementation of a new configuration system for Tracee, supporting both configuration files (YAML/JSON) and command-line flags. This will improve configuration management, validation, and the ability to override settings.

Goal

Provide a flexible and manageable way to configure Tracee using both configuration files and command-line flags.

Steps

Implement Config File Parsing

1. Implement YAML/JSON parsing for the config file.
2. Define the data structures to represent the configuration.
3. Handle file loading and error handling.

Checklist

Preview Give feedback

1. Implement YAML parsing.
2. Define configuration data structures.
3. Implement file loading and error handling.

Implement Command-Line Flags Parsing and Mapping to Config

1. Implement parsing for all command-line flags.
2. Map the parsed flag values to the corresponding configuration data structures.

Checklist

Preview Give feedback

1. Implement flag parsing for Events.
2. Implement flag parsing for Source.
3. Implement flag parsing for Enrichment.
4. Implement flag parsing for Data Stores.
5. Implement flag parsing for Output.
6. Implement flag parsing for Server.
7. Implement flag parsing for Logging.
8. Implement flag parsing for Buffers.
9. Implement flag parsing for General.
10. Implement flag parsing for Capabilities.
11. Implement flag parsing for Capture (Deprecated).
12. Implement flag parsing for Signatures (Deprecated).
13. Map parsed flags to configuration structs.

Implement Configuration Merging and Precedence Rules

1. Define the precedence rules (flags override config file settings).
2. Implement the logic to merge the configuration from the file and the flags.

Checklist

Preview Give feedback

1. Define precedence rules.
2. Implement configuration merging logic.

Implement Validation, Error Handling, and Backward Compatibility

1. Implement validation of the combined configuration.
2. Implement proper error handling for invalid configurations.
3. Ensure backward compatibility with existing flag usage.
4. Implement deprecation warnings for deprecated options.

Checklist

Preview Give feedback

1. Implement configuration validation.
2. Implement error handling.
3. Ensure backward compatibility.
4. Implement deprecation warnings.

Enhance Testing, Logging, and Additional Configuration Options

1. Write unit and integration tests for the new configuration system.
2. Improve logging related to configuration loading and validation.
3. Implement additional configuration options (e.g., --config <path>, --dry-run).

Checklist

Preview Give feedback

1. Write unit tests.
2. Write integration tests.
3. Improve logging.
4. Implement --config flag.
5. Implement --dry-run flag.

Acceptance Criteria

1. All configuration options can be specified via both config file and flags.
2. Flags override config settings when both are present.
3. Validation ensures no invalid configurations are used.
4. Deprecated fields are supported with a warning.
5. Documentation and tests are updated.