Support dynamic change user.yaml ?

[anhnch30820]

I deployed Milvus with config here

apiVersion: milvus.io/v1beta1
kind: Milvus
metadata:
  name: my-release
  labels:
    app: milvus
spec:
  mode: cluster
  dependencies: {}
  components: 
    updateConfigMapOnly: true
  config:
    common:
      ttMsgEnabled: false

then I changed ttMsgEnabled: true and kubectl apply. But I can't search, insert or delete with error Deadline Exceeded.
So How can it work?

[haorenfsa]

Hi @anhnch30820 Which version of Milvus are you using? This only works for Milvus v2.4.0 or later version. And it takes some time (about a minute or so) for kubelet to change the file and for Milvus to reload config.

[anhnch30820]

@haorenfsa
I use version 2.4.4 with operator 0.9.16. My workflow:

Create milvus with ttMsgEnabled: false --> change ttMsgEnabled: true and apply --> create collection --> create index --> load collection.

But, load collection stuck at 0% and I waited for more than 30 minutes. I enter pod and see config

ttMsgEnabled: true in file user.yaml
ttMsgEnabled: false in file milvus.yaml

I don't know how to fix?

[haorenfsa]

@anhnch30820 Milvus will prioritize user.yaml if it's different from milvus.yaml.

Could you please provide the log of the Milvus Pod?

[anhnch30820]

@haorenfsa Here is the log milvus-proxy
milvus-milvus-proxy-6c98fb49c4-622fp_proxy.log

[haorenfsa]

Hi @anhnch30820, it's an known issue in milvus milvus-io/milvus#33461. Team Milvus plan to fix this in v2.4.5

[anhnch30820]

@haorenfsa I hope it will be released soon, thank you.

[haorenfsa]

@anhnch30820 milvus v2.4.5 is released, please help us verify if you got time.

[anhnch30820]

@haorenfsa it doesn't work.

[haorenfsa]

track it in milvus-io/milvus#33461