Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Server take too long to start and it make kubernetes kill the pod #51

Open
mscherer opened this issue Jun 17, 2022 · 0 comments
Open

Server take too long to start and it make kubernetes kill the pod #51

mscherer opened this issue Jun 17, 2022 · 0 comments

Comments

@mscherer
Copy link
Contributor

From a quick reading of the code, the server first parse and start threads for each repository:

https://github.com/Humbedooh/clc/blob/main/server/main.py#L57

It take a long time on our infra (around 3 minutes for 86 repositories), and as we are deploying on kubernetes, the pod is not seen as ready fast enough, so it get killed in a loop.

Could the init part be done in a asynchronous way in the background, and then listen right away ?
We are trying to work around the slow starting time by increasing timeout, but this is not a sustainable way (as it increase with each repository, as we are loading bigger and longer yaml files as time pass).

Also, I checked, we are already using the c++ loader, so that's not python slowness here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant