New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate options for configuring frequencies, batching and timeouts #78

Open

Miles-Garnsey opened this issue Aug 12, 2022 · 0 comments

Assignees

Miles-Garnsey commented Aug 12, 2022

There are various places where data is handed off between system components. These include:

Metrics being pushed into collectd's netty channel.
The netty channel writing out files onto disk.
Collectd ingesting those files.
Prometheus scraping the collectd endpoint.

Each of these handoff points offers opportunities to

Configure the size of the scrape/write/batch.
Throttling data flow via downsampling or slowing batch/write/scrape frequency.
Modifying the timeouts to ensure that the scrape/write/batch has time to complete.

Some of these options should be configurable, this ticket tracks work to determine which.

Miles-Garnsey self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment