Skip to content

Commit

Permalink
fix: cluster performance testing issues (#615)
Browse files Browse the repository at this point in the history
Fixes the following issues:

- timeout handler can be invoked again, before it has finished
- batch position handler not committing for all partitions
- downstream fix from central-services-stream to close Kafka connections on process exit
  • Loading branch information
kalinkrustev authored Apr 8, 2024
1 parent b89c013 commit f4760a8
Show file tree
Hide file tree
Showing 32 changed files with 88 additions and 91 deletions.
12 changes: 6 additions & 6 deletions bulk-centralledger/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Bulk Services Helm chart for Kubernetes
name: bulk-centralledger
version: 14.7.0
appVersion: v17.6.0
version: 14.7.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand All @@ -16,19 +16,19 @@ maintainers:
email: [email protected]
dependencies:
- name: cl-handler-bulk-transfer-prepare
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-bulk-transfer-prepare"
condition: cl-handler-bulk-transfer-prepare.enabled
- name: cl-handler-bulk-transfer-fulfil
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-bulk-transfer-fulfil"
condition: cl-handler-bulk-transfer-fulfil.enabled
- name: cl-handler-bulk-transfer-processing
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-bulk-transfer-processing"
condition: cl-handler-bulk-transfer-processing.enabled
- name: cl-handler-bulk-transfer-get
version: ">= 14.1.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-bulk-transfer-get"
condition: cl-handler-bulk-transfer-get.enabled
- name: common
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Bulk Transfer Fulfil Handler Helm chart for Kubernetes
name: cl-handler-bulk-transfer-fulfil
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
4 changes: 2 additions & 2 deletions bulk-centralledger/chart-handler-bulk-transfer-get/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Bulk Transfer Get Handler Helm chart for Kubernetes
name: cl-handler-bulk-transfer-get
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Bulk Transfer Prepare Handler Helm chart for Kubernetes
name: cl-handler-bulk-transfer-prepare
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Bulk Transfer Processing Handler Helm chart for Kubernetes
name: cl-handler-bulk-transfer-processing
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
8 changes: 4 additions & 4 deletions bulk-centralledger/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ cl-handler-bulk-transfer-prepare:
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down Expand Up @@ -396,7 +396,7 @@ cl-handler-bulk-transfer-fulfil:
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down Expand Up @@ -767,7 +767,7 @@ cl-handler-bulk-transfer-processing:
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down Expand Up @@ -1147,7 +1147,7 @@ cl-handler-bulk-transfer-get:
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
20 changes: 10 additions & 10 deletions centralledger/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Helm chart for Kubernetes
name: centralledger
version: 14.15.0
appVersion: v17.6.0
version: 14.15.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand All @@ -16,35 +16,35 @@ maintainers:
email: [email protected]
dependencies:
- name: centralledger-service
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-service"
condition: centralledger-service.enabled
- name: centralledger-handler-transfer-prepare
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-transfer-prepare"
condition: centralledger-handler-transfer-prepare.enabled
- name: centralledger-handler-transfer-position
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-transfer-position"
condition: centralledger-handler-transfer-position.enabled
- name: centralledger-handler-transfer-position-batch
version: ">= 14.4.0"
version: ">= 15.4.1"
repository: "file://./chart-handler-transfer-position-batch"
condition: centralledger-handler-transfer-position-batch.enabled
- name: centralledger-handler-transfer-get
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-transfer-get"
condition: centralledger-handler-transfer-get.enabled
- name: centralledger-handler-transfer-fulfil
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-transfer-fulfil"
condition: centralledger-handler-transfer-fulfil.enabled
- name: centralledger-handler-timeout
version: ">= 14.4.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-timeout"
condition: centralledger-handler-timeout.enabled
- name: centralledger-handler-admin-transfer
version: ">= 14.3.0"
version: ">= 14.4.1"
repository: "file://./chart-handler-admin-transfer"
condition: centralledger-handler-transfer-get.enabled
- name: common
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-handler-admin-transfer/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Transfer Prepare Handler Helm chart for Kubernetes
name: centralledger-handler-admin-transfer
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-handler-admin-transfer/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-handler-timeout/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Timeout Handler Helm chart for Kubernetes
name: centralledger-handler-timeout
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-handler-timeout/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-handler-transfer-fulfil/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Transfer Fulfil Handler Helm chart for Kubernetes
name: centralledger-handler-transfer-fulfil
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-handler-transfer-fulfil/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-handler-transfer-get/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Get Transfer Handler Helm chart for Kubernetes
name: centralledger-handler-transfer-get
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-handler-transfer-get/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: "Central-Ledger Transfer Position Batch Handler Helm chart for Kubernetes."
name: centralledger-handler-transfer-position-batch
version: 15.4.0
appVersion: "17.6.0"
version: 15.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ nameOverride: "handler-pos-batch"
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down Expand Up @@ -195,7 +195,6 @@ config:
kafka_host: kafka
kafka_port: 9092
kafka_partitioner: 'murmur2_random'
kafka_partition_assignment_strategy: 'cooperative-sticky'

## Node Configuration
log_level: 'info'
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-handler-transfer-position/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Transfer Position Handler Helm chart for Kubernetes
name: centralledger-handler-transfer-position
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-handler-transfer-position/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-handler-transfer-prepare/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Transfer Prepare Handler Helm chart for Kubernetes
name: centralledger-handler-transfer-prepare
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-handler-transfer-prepare/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
4 changes: 2 additions & 2 deletions centralledger/chart-service/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
apiVersion: v2
description: Central-Ledger Service Helm chart for Kubernetes
name: centralledger-service
version: 14.4.0
appVersion: v17.6.0
version: 14.4.1
appVersion: v17.6.1
home: http://mojaloop.io
icon: http://mojaloop.io/images/logo.png
sources:
Expand Down
2 changes: 1 addition & 1 deletion centralledger/chart-service/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ global: {}
image:
registry: docker.io
repository: mojaloop/central-ledger
tag: v17.6.0
tag: v17.6.1
## Specify a imagePullPolicy
## Defaults to 'Always' if image tag is 'latest', else set to 'IfNotPresent'
## ref: http://kubernetes.io/docs/user-guide/images/#pre-pulling-images
Expand Down
Loading

0 comments on commit f4760a8

Please sign in to comment.