Porting TPC Data compression decoding to GPU

[cima22]

Average of 300 clusters over 53175874 not correctly decoded, maybe fast-math problem. Still need to incorporate GPU decoding in the offline chain.

[davidrohr]

Approving to start the CI, please do not merge yet!
The code-formatting check fails. Could you please run git-clang-format, to fix the formatting. Please also squash all test commits, and leave only meaningfull commits in. Alternatively, we can squash the full PR when merging.

[alibuild]

Error while checking build/O2/fullCI for f0249ef at 2024-01-30 11:34:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
"/sw/SOURCES/O2/12616-slc8_x86-64/0/GPU/GPUTracking/Base/GPUConstantMem.h", line 73: error: 
ninja: build stopped: subcommand failed.

Full log here.

[davidrohr]

Looks pretty good so far, though I didn't fully check the functionality. I have mostly a couple of cosmetic comments.

[davidrohr]

approved to start the CI

[davidrohr]

Looks good, let's see what the CI says. I have only 2 cosmetic comments below, which can also be fixed afterwards.

[alibuild]

Error while checking build/O2/fullCI for 60b937e at 2024-02-29 08:55:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'


## sw/BUILD/O2-full-system-test-latest/log
Detected critical problem in logfile reco_ASYNC.log
reco_ASYNC.log:[56150:gpu-reconstruction]: [07:55:15][ERROR] Exception caught: cluster native output ptrs out of sync 
[56139:ctp-entropy-decoder]: [07:55:09][ERROR] LM:375 L0:0 L1:2 TwI:9 Trigger classes wo input:336
[56150:gpu-reconstruction]: [07:55:15][ERROR] Exception caught: cluster native output ptrs out of sync 
[ERROR] Workflow crashed - PID 56150 (gpu-reconstruction) did not exit correctly however it's not clear why. Exit code forced to 128.
[ERROR]  - Device gpu-reconstruction: pid 56150 (exit 128)
[ERROR] SEVERE: Device gpu-reconstruction (56150) returned with 128


## sw/BUILD/o2checkcode-latest/log
--
========== List of errors found ==========
++ GRERR=0
++ grep -v clang-diagnostic-error error-log.txt
++ grep ' error:'
++ GRERR=1
++ [[ 1 == 0 ]]
++ mkdir -p /sw/INSTALLROOT/f7f0975f063caa4cd3c7259ea5a388a3baf92584/slc8_x86-64/o2checkcode/1.0-local1965/etc/modulefiles
++ cat
--

Full log here.

[davidrohr]

@ktf : It seems framework core ctest is failing regularly in the CI today, this seems to be a new problem?

[ktf]

I am checking.

[ktf]

Should be fixed by #12781 .

[alibuild]

Error while checking build/O2/fullCI for d3ce442 at 2024-03-01 18:19:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'


## sw/BUILD/O2-full-system-test-latest/log
Detected critical problem in logfile reco_ASYNC.log
reco_ASYNC.log:[57300:gpu-reconstruction]: [17:18:59][ERROR] Exception caught: cluster native output ptrs out of sync 
[57289:ctp-entropy-decoder]: [17:18:45][ERROR] LM:274 L0:0 L1:1 TwI:5 Trigger classes wo input:226
[57300:gpu-reconstruction]: [17:18:59][ERROR] Exception caught: cluster native output ptrs out of sync 
[ERROR] Workflow crashed - PID 57300 (gpu-reconstruction) did not exit correctly however it's not clear why. Exit code forced to 128.


## sw/BUILD/o2checkcode-latest/log
--
========== List of errors found ==========
++ GRERR=0
++ grep -v clang-diagnostic-error error-log.txt
++ grep ' error:'
++ GRERR=1
++ [[ 1 == 0 ]]
++ mkdir -p /sw/INSTALLROOT/a676fe5b5d28da865a191682e551427da3fe0d0f/slc8_x86-64/o2checkcode/1.0-local1343/etc/modulefiles
++ cat
--

Full log here.

[alibuild]

Error while checking build/O2/fullCI for 7ee82f7 at 2024-03-02 00:54:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'


## sw/BUILD/O2-full-system-test-latest/log
task timeout reached .. killing all processes


## sw/BUILD/o2checkcode-latest/log
--
========== List of errors found ==========
++ GRERR=0
++ grep -v clang-diagnostic-error error-log.txt
++ grep ' error:'
++ GRERR=1
++ [[ 1 == 0 ]]
++ mkdir -p /sw/INSTALLROOT/048753e9843ae3df9b1f1af0116c6bbe04e1e974/slc8_x86-64/o2checkcode/1.0-local150/etc/modulefiles
++ cat
--

Full log here.

[alibuild]

Error while checking build/O2/fullCI for 579d623 at 2024-03-03 20:55:

## sw/BUILD/O2-latest/log
c++: error: unrecognized command-line option '--rtlib=compiler-rt'
c++: error: unrecognized command-line option '--rtlib=compiler-rt'


## sw/BUILD/O2-full-system-test-latest/log
task timeout reached .. killing all processes


## sw/BUILD/o2checkcode-latest/log
--
========== List of errors found ==========
++ GRERR=0
++ grep -v clang-diagnostic-error error-log.txt
++ grep ' error:'
++ GRERR=1
++ [[ 1 == 0 ]]
++ mkdir -p /sw/INSTALLROOT/9ef1b1e20b4211ceeba526cedaf5ed6530849596/slc8_x86-64/o2checkcode/1.0-local162/etc/modulefiles
++ cat
--

Full log here.

[davidrohr]

can be merged now if the FullCI becomes green

[davidrohr]

Full CI again failed randomly. Tried it locally and it worked, and also works as part of #12799, so should be fine, merging.