Problem with milvus,Please check the log #40
Comments
please check time in all your pod. |
|
milvus within a Docker, How should I check |
|
just check with date command of each pod |
{{ message }}
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
[2023/04/09 10:05:29.180 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=7] [2023/04/09 10:05:29.183 +08:00] [WARN] [rootcoord/quota_center.go:134] ["quotaCenter calculate rates failed"] [error="can not get timestamp"] [2023/04/09 10:05:29.206 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=3] [2023/04/09 10:05:29.214 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=0] [2023/04/09 10:05:29.214 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=153.429µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=246.994µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=320.89µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=416.5µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=339.686µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=330.927µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=361.115µs] [2023/04/09 10:05:29.215 +08:00] [DEBUG] [rmq/rmq_producer.go:47] ["tr/send msg to stream"] [msg="send msg to stream done"] [duration=500.713µs] [2023/04/09 10:05:29.217 +08:00] [DEBUG] [etcd/etcd_kv.go:794] [tr/putEtcdMeta] [msg="putEtcdMeta done"] [duration=439.013µs] [2023/04/09 10:05:29.217 +08:00] [WARN] [rootcoord/root_coord.go:248] ["failed to update tso"] [error="etcdserver: mvcc: database space exceeded"] [errorVerbose="etcdserver: mvcc: database space exceeded\ngithub.com/milvus-io/milvus/internal/tso.(*timestampOracle).saveTimestamp\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/tso/tso.go:97\ngithub.com/milvus-io/milvus/internal/tso.(*timestampOracle).UpdateTimestamp\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/tso/tso.go:200\ngithub.com/milvus-io/milvus/internal/tso.(*GlobalTSOAllocator).UpdateTSO\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/tso/global_allocator.go:100\ngithub.com/milvus-io/milvus/internal/rootcoord.(*Core).tsLoop\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/rootcoord/root_coord.go:247\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1571"] [2023/04/09 10:05:29.231 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=8] [2023/04/09 10:05:29.257 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=4] [2023/04/09 10:05:29.265 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=1] [2023/04/09 10:05:29.266 +08:00] [DEBUG] [etcd/etcd_kv.go:794] [tr/putEtcdMeta] [msg="putEtcdMeta done"] [duration=464.173µs] [2023/04/09 10:05:29.266 +08:00] [WARN] [rootcoord/root_coord.go:248] ["failed to update tso"] [error="etcdserver: mvcc: database space exceeded"] [errorVerbose="etcdserver: mvcc: database space exceeded\ngithub.com/milvus-io/milvus/internal/tso.(*timestampOracle).saveTimestamp\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/tso/tso.go:97\ngithub.com/milvus-io/milvus/internal/tso.(*timestampOracle).UpdateTimestamp\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/tso/tso.go:200\ngithub.com/milvus-io/milvus/internal/tso.(*GlobalTSOAllocator).UpdateTSO\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/tso/global_allocator.go:100\ngithub.com/milvus-io/milvus/internal/rootcoord.(*Core).tsLoop\n\t/__w/embd-milvus/embd-milvus/milvus_binary/milvus/internal/rootcoord/root_coord.go:247\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1571"] [2023/04/09 10:05:29.281 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=9] [2023/04/09 10:05:29.308 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=5] [2023/04/09 10:05:29.315 +08:00] [INFO] [tso/global_allocator.go:130] ["logical part outside of max logical interval, please check ntp time"] [retry-count=2]The text was updated successfully, but these errors were encountered: