Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configure output for kubernetes and docker and parsl workflow to write to file #33

Open
julietcohen opened this issue Feb 26, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request k8s logging

Comments

@julietcohen
Copy link
Collaborator

The kubernetes and docker and parsl workflow currently outputs logging statements to the terminal that communicate a lot of information, including the number active tasks, active slots, connected workers, etc . These statements include DEBUG level logging, so this results in a constant stream of output that is hard to search through. An easy solution to this would be to configure parsl to output these logging statements to a file instead. Parsl has this functionality, like using parsl.set_file_logger() or setting up logging settings like in this stack overflow post. Note that this logging is different than the viz workflow logging, which is already set up to write to a log.log file.

@julietcohen julietcohen self-assigned this Feb 26, 2024
@julietcohen julietcohen added the enhancement New feature or request label Feb 26, 2024
@julietcohen
Copy link
Collaborator Author

This issue is a sub-task towards the ultimate goal of issue#1

@mbjones
Copy link
Member

mbjones commented Feb 26, 2024

@julietcohen related to your ticket: DataONEorg/k8s-cluster#43 @artntek has made good progress towardds setting up centralized, searchable logging on the cluster

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request k8s logging
Projects
Status: Backlog
Development

No branches or pull requests

4 participants