about training code

[Mrkkew]

will the training code be released?

[survivi]

will the training code be released?

We will organize and release the training code as soon as possible. The continual pre-training is done based on the slurm workload manager.

[chowkamlee81]

@survivi , any update on training code?

[jerrynchen]

hi
any update about the training code?

[survivi]

We are quite sorry for the delayed release of the code. We just released the code used for continual pre-training and data preparation. The code contains detailed documentation comments.