Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatic deletion of compaction config is no longer "false" by default #17692

Open
lejinghu opened this issue Jan 31, 2025 · 0 comments
Open

Comments

@lejinghu
Copy link

Please provide a detailed title (e.g. "Broker crashes when using TopN query with Bound filter" instead of just "Broker crashes").

Affected Version

31.0

Description

Issue

We noticed compaction configs for multiple tables were deleted after upgrading to Druid 31.0.

The history of the configs indicate they were removed by the coordinator:

{
"globalConfig": ...
"compactionConfig": null,
"auditInfo": {
"author": "KillCompactionConfig",
"identity": "KillCompactionConfig",
"comment": "CoordinatorDuty for automatic deletion of compaction config",
"ip": ""
},
"auditTime": ...
}

Although the documentation states "druid.coordinator.kill.compaction.on" is false by default (https://druid.apache.org/docs/latest/configuration/#metadata-management), it seems it is true by default.

Investigation

In Druid 29, the compaction kill is false by default

https://github.com/apache/druid/blob/druid-29.0.1/server/src/main/java/org/apache/druid/server/coordinator/DruidCoordinatorConfig.java

@config("druid.coordinator.kill.compaction.on")
@default("false")
public abstract boolean isCompactionKillEnabled();

But after the refactoring in Druid 31, the compaction takes the default config, which seems to be true by default

https://github.com/apache/druid/blob/druid-31.0.0/server/src/main/java/org/apache/druid/server/coordinator/config/CoordinatorKillConfigs.java

this.compactionConfigs = Configs.valueOrDefault(compactionConfigs, MetadataCleanupConfig.DEFAULT);

@lejinghu lejinghu changed the title Automatic deletion of compaction config is not "false" by default Automatic deletion of compaction config is no longer "false" by default Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant