Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEDOT warm start experiment #6

Merged
merged 34 commits into from
May 21, 2024
Merged
Changes from 1 commit
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
2653757
add DatasetModelsFitnessScaler
MorrisNein Dec 13, 2023
87ab25d
simplify imports
MorrisNein Mar 26, 2024
6d3a30d
typing & other fixes
MorrisNein Dec 13, 2023
ad1e1fa
update DatasetModelsFitnessScaler to support different dataset types
MorrisNein Dec 13, 2023
176ce1f
fix typing
MorrisNein Dec 14, 2023
7aa5db8
fix typing [2]
MorrisNein Dec 14, 2023
b6605ac
add MetaLearningApproach
MorrisNein Oct 22, 2023
b72719f
add fedot_history_loader.py
MorrisNein Dec 13, 2023
0d814e0
add KNNSimilarityModelAdvice
MorrisNein Dec 13, 2023
1cf3a10
minor fixes
MorrisNein Dec 13, 2023
c938452
create Dockerfile abd .dockerignore
MorrisNein Apr 20, 2023
0467259
create the experiment script & config
MorrisNein Jul 20, 2023
cac2ba3
adapt to #39
MorrisNein Jul 27, 2023
1e1b08c
add config for debugging
MorrisNein Jul 28, 2023
ff6852a
remove data leak
MorrisNein Oct 12, 2023
cf1190a
persist train/test datasets split
MorrisNein Oct 12, 2023
50379f8
add final choices to the best models
MorrisNein Oct 12, 2023
4f3d0d8
fix pipeline evaluation, compute fitness on test data;
MorrisNein Oct 22, 2023
bf8aac6
set TMPDIR from script
MorrisNein Nov 3, 2023
877be96
set logging level of FEDOT
MorrisNein Nov 7, 2023
fa48660
create config_light.yaml
MorrisNein Nov 10, 2023
28506e6
fix train/test split
MorrisNein Nov 13, 2023
071574b
add evaluation caching
MorrisNein Nov 15, 2023
2b9b863
split config file
MorrisNein Nov 21, 2023
8824679
increase debug fedot timeout
MorrisNein Nov 21, 2023
82eb33c
minor fixes
MorrisNein Nov 16, 2023
61641be
various experiment improvements & fixes
MorrisNein Dec 13, 2023
3a09a4d
add cache for AutoML repetitions
MorrisNein Dec 14, 2023
238483f
adjust configs to advise 3 initial assumptions; add prefix for config…
MorrisNein Dec 14, 2023
da6168b
fix after rebase
MorrisNein Dec 14, 2023
71dac64
fix after rebase
MorrisNein Mar 26, 2024
176c71d
some experiment fixes
MorrisNein Apr 1, 2024
26c0a52
experiment stability update
MorrisNein May 20, 2024
295c7e2
Builds fix (#98)
MorrisNein May 21, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
adjust configs to advise 3 initial assumptions; add prefix for config…
…_light.yaml
MorrisNein committed May 20, 2024
commit 238483f375a503fdb459ccd1fa2ecdb52fd49471
2 changes: 1 addition & 1 deletion experiments/fedot_warm_start/config.yaml
Original file line number Diff line number Diff line change
@@ -14,4 +14,4 @@ assessor_params:
n_neighbors: 5
advisor_params:
minimal_distance: 1
n_best_to_advise: 5
n_best_to_advise: 3
2 changes: 1 addition & 1 deletion experiments/fedot_warm_start/config_debug.yaml
Original file line number Diff line number Diff line change
@@ -14,4 +14,4 @@ assessor_params:
n_neighbors: 2
advisor_params:
minimal_distance: 1
n_best_to_advise: 5
n_best_to_advise: 3
3 changes: 2 additions & 1 deletion experiments/fedot_warm_start/config_light.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
---
seed: 42
tmpdir: '/var/essdata/tmp'
save_dir_prefix: light_
#data_settings:
n_datasets: 16 # null for all available datasets
test_size: 0.25
@@ -15,4 +16,4 @@ assessor_params:
n_neighbors: 5
advisor_params:
minimal_distance: 1
n_best_to_advise: 5
n_best_to_advise: 3
3 changes: 1 addition & 2 deletions experiments/fedot_warm_start/evaluation_config.yaml
Original file line number Diff line number Diff line change
@@ -1,11 +1,10 @@
n_folds: 1
split_seed: 0
collect_metrics:
- f1
- roc_auc
- accuracy
- neg_log_loss
- precision
baseline_model: 'xgboost'
baseline_model: 'catboost'
data_test_size: 0.25
data_split_seed: 0