Milvus Lite Server connection refused when deployed in container in a VM

[viperabyss]

I understand Milvus Lite doesn't really work in an environment where there are VMs running, but would it have issue when it's embedded into a model that's ran in a container within the VM? It looks like Milvus Lite would have trouble connecting.

[2024/02/22 19:25:34.267 +00:00] [INFO] [indexnode/indexnode.go:268] ["Index node stopped."] [2024/02/22 19:25:34.267 +00:00] [WARN] [grpclog/grpclog.go:46] ["[core][Channel #155 SubChannel #156] grpc: addrConn.createTransport failed to connect to {\n \"Addr\": \"172.18.0.3:13333\",\n \"ServerName\": \"172.18.0.3:13333\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n}. Err: connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:13333: connect: connection refused\""] [2024/02/22 19:25:34.268 +00:00] [WARN] [grpcclient/client.go:367] ["call received grpc error"] [clientRole=datacoord] [error="rpc error: code = Unavailable desc = connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:13333: connect: connection refused\""] [2024/02/22 19:25:34.268 +00:00] [WARN] [grpcclient/client.go:428] ["start to reset connection because of specific reasons"] [client_role=datacoord] [error="rpc error: code = Unavailable desc = connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:13333: connect: connection refused\""] [2024/02/22 19:25:34.268 +00:00] [WARN] [grpcclient/client.go:213] ["failed to get client address"] [error="context canceled"] [2024/02/22 19:25:34.268 +00:00] [WARN] [grpcclient/client.go:405] ["fail to get grpc client in the retry state"] [client_role=datacoord] [error="context canceled"] [2024/02/22 19:25:34.268 +00:00] [ERROR] [retry/retry.go:46] ["retry func failed"] ["retry time"=0] [error="rpc error: code = Unavailable desc = connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:13333: connect: connection refused\""] [stack="github.com/milvus-io/milvus/pkg/util/retry.Do\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/pkg/util/retry/retry.go:46\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).call\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/util/grpcclient/client.go:411\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).Call\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/util/grpcclient/client.go:489\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).ReCall\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/util/grpcclient/client.go:505\ngithub.com/milvus-io/milvus/internal/distributed/datacoord/client.wrapGrpcCall[...]\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/distributed/datacoord/client/client.go:102\ngithub.com/milvus-io/milvus/internal/distributed/datacoord/client.(*Client).UpdateChannelCheckpoint\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/distributed/datacoord/client/client.go:499\ngithub.com/milvus-io/milvus/internal/datanode/broker.(*dataCoordBroker).UpdateChannelCheckpoint\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/datanode/broker/datacoord.go:100\ngithub.com/milvus-io/milvus/internal/datanode.(*ttNode).updateChannelCP\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/datanode/flow_graph_time_tick_node.go:132\ngithub.com/milvus-io/milvus/internal/datanode.(*ttNode).Operate\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/datanode/flow_graph_time_tick_node.go:98\ngithub.com/milvus-io/milvus/internal/util/flowgraph.(*nodeCtx).work\n\t/__w/milvus-lite/milvus-lite/milvus_binary/milvus/internal/util/flowgraph/node.go:135"] [2024/02/22 19:25:34.323 +00:00] [WARN] [grpclog/grpclog.go:46] ["[core][Channel #143 SubChannel #144] grpc: addrConn.createTransport failed to connect to {\n \"Addr\": \"172.18.0.3:53100\",\n \"ServerName\": \"172.18.0.3:53100\",\n \"Attributes\": null,\n \"BalancerAttributes\": null,\n \"Type\": 0,\n \"Metadata\": null\n}. Err: connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:53100: connect: connection refused\""] [2024/02/22 19:25:34.323 +00:00] [WARN] [grpcclient/client.go:367] ["call received grpc error"] [clientRole=rootcoord] [error="rpc error: code = Unavailable desc = connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:53100: connect: connection refused\""] [2024/02/22 19:25:34.323 +00:00] [WARN] [grpcclient/client.go:428] ["start to reset connection because of specific reasons"] [client_role=rootcoord] [error="rpc error: code = Unavailable desc = connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:53100: connect: connection refused\""]

[2024/02/22 19:25:34.628 +00:00] [WARN] [grpclog/grpclog.go:46] ["[core][Channel #191 SubChannel #192] grpc: addrConn.createTransport failed to connect to {\n  \"Addr\": \"172.18.0.3:53100\",\n  \"ServerName\": \"172.18.0.3:53100\",\n  \"Attributes\": null,\n  \"BalancerAttributes\": null,\n  \"Type\": 0,\n  \"Metadata\": null\n}. Err: connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:53100: connect: connection refused\""]
[2024/02/22 19:25:34.628 +00:00] [WARN] [grpcclient/client.go:405] ["fail to get grpc client in the retry state"] [client_role=rootcoord] [error="failed to connect 172.18.0.3:53100, reason: connection error: desc = \"transport: error while dialing: dial tcp 172.18.0.3:53100: connect: connection refused\""]

standalone-19.log