Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[INFRA] MATLAB test automation #43

Open
wants to merge 30 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
af934b4
Add common tools for MATLAB and Python testing
Remi-Gau Apr 7, 2022
20e6fd9
add smoke tests matlab
Remi-Gau Apr 7, 2022
918091b
add matlab test automation
Remi-Gau Apr 7, 2022
aee01dc
add matlab test demo automation
Remi-Gau Apr 7, 2022
faba452
add expected data and an assert to system test
Remi-Gau Apr 7, 2022
b886a8b
rename test file
Remi-Gau Apr 7, 2022
04508a5
add documentation
Remi-Gau Apr 7, 2022
b9df9f2
lint
Remi-Gau Apr 7, 2022
0eff103
remove unneeded upload coverage artefact from CI workflow
Remi-Gau Apr 7, 2022
3ab086b
run tests matlab demos with CRON job on 1rt and 15th of every month
Remi-Gau Apr 7, 2022
ef3920e
add assert on value of R2
Remi-Gau Apr 7, 2022
8284581
add doc in CI yml and scripts
Remi-Gau Apr 7, 2022
61cfe71
fix typo
Remi-Gau Apr 7, 2022
bd5d8fa
add matlab tests badge to README
Remi-Gau Apr 7, 2022
956da88
add matlab demo badge to README
Remi-Gau Apr 7, 2022
9def9a2
run demos with MOxUnit in CI so that demo2 is run even if demo1 fails
Remi-Gau Apr 8, 2022
c4530c3
force demos to fail to make sure this is picked by CI
Remi-Gau Apr 8, 2022
10161f0
add a check log to try to show workflow as failed
Remi-Gau Apr 8, 2022
f569dd6
remove forced errors in demo and reset to run demos bimonthly
Remi-Gau Apr 8, 2022
26389af
add doc on running tests and demos in CI
Remi-Gau Apr 8, 2022
56807a6
miss_hit lint CI code
Remi-Gau Apr 8, 2022
07da5c3
add miss hit and linting documentation
Remi-Gau Apr 8, 2022
1908552
add pre-commit doc
Remi-Gau Apr 8, 2022
70d205e
update contributors doc
Remi-Gau Apr 8, 2022
731ac95
add doc on generating and chekcing test data
Remi-Gau Apr 8, 2022
a312579
update repo map
Remi-Gau Apr 8, 2022
b35bec6
switch to using png image in doc
Remi-Gau Apr 8, 2022
ca40488
try testing different os and matlab version
Remi-Gau Apr 8, 2022
882cf8e
only run tests on ubuntu latest with matlab 2020a
Remi-Gau Apr 8, 2022
4ae81fd
Update .github/workflows/run_tests_matlab.yaml
Remi-Gau Apr 12, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
lint
Remi-Gau committed Apr 7, 2022
commit b9df9f254c8d53a2902cdc574df15de59ee2cc26
2 changes: 1 addition & 1 deletion tests/miss_hit.cfg
Original file line number Diff line number Diff line change
@@ -14,7 +14,7 @@ suppress_rule: "copyright_notice"
tab_width: 2

# snake_case
regex_function_name: "[a-z]+(_[a-z]*)*"
regex_function_name: "[a-zA-Z]+(_[a-zA-Z]*)*"

metric "cnest": limit 4
metric "file_length": limit 500
13 changes: 6 additions & 7 deletions tests/test_GLMestimatesingletrial.m
Original file line number Diff line number Diff line change
@@ -29,8 +29,7 @@ function test_GLMestimatesingletrial_system()
tr, ...
output_dir, ...
struct('wantmemoryoutputs', [1 1 1 1]));



% THEN
assertEqual(results{2}.HRFindex, expected{2}.HRFindex);
assertEqual(results{3}.HRFindex, expected{3}.HRFindex);
@@ -49,21 +48,21 @@ function test_GLMestimatesingletrial_system()
data = load(data_file);

expected_dir = fullfile(test_dir, 'expected', 'matlab');
load(fullfile(expected_dir, 'TYPEB_FITHRF.mat'))
load(fullfile(expected_dir, 'TYPEB_FITHRF.mat'));
expected{2}.HRFindex = HRFindex;
load(fullfile(expected_dir, 'TYPEC_FITHRF_GLMDENOISE.mat'))
load(fullfile(expected_dir, 'TYPEC_FITHRF_GLMDENOISE.mat'));
expected{3}.HRFindex = HRFindex;
load(fullfile(expected_dir, 'TYPED_FITHRF_GLMDENOISE_RR.mat'))
load(fullfile(expected_dir, 'TYPED_FITHRF_GLMDENOISE_RR.mat'));
expected{4}.HRFindex = HRFindex;

output_dir = fullfile(test_dir, 'outputs', 'matlab');

run(fullfile(test_dir, '..', 'setup.m'));

end

function clean_up()

% ununsed for now

end