Implement EKS E2E Testing Workflow

[musa-asad]

Description of the issue

We aim to enhance our testing framework to support end-to-end testing of various helm-charts values and allow the use of custom branches for the agent, operator, and helm-charts repositories to enable testing of different configurations and prevent regressions to verify Kubernetes resource creation/deletion and metric emission.

Description of changes

Co-PR: aws/amazon-cloudwatch-agent-test#434.

Important

Updated build-test-artifacts.yml due to failing workflow run, which tried to run the integration tests: View Workflow Run #12324314762. It isn't problematic to include this as an option.

• Implemented e2e-test.yml workflow to run end-to-end tests with configurable inputs for region, operator_branch, and helm_charts_branch.
• Moved e2e-build.yml into e2e-test.yml to prevent calling more than three nested workflows.
• Implemented eks-e2e-test.yml as a reusable workflow for EKS cluster Terraform creation.
• Created GenerateTestMatrix job, similar to the one in integration-test.yml, to generate test configurations using a Go generator script from the amazon-cloudwatch-agent-test repository.

An example job for the re-usable workflow:

  EKSE2EJVMTomcatTest:
    needs: [ GetLatestOperatorCommitSHA, GenerateTestMatrix, OutputEnvVariables ]
    name: 'EKSE2EJVMTomcatTest'
    uses: ./.github/workflows/eks-e2e-test.yml
    with:
      terraform_dir: terraform/eks/e2e
      job_id: eks-e2e-jvm-tomcat-test
      test_props: ${{ needs.GenerateTestMatrix.outputs.eks_e2e_matrix }}
      test_repo_name: ${{ needs.OutputEnvVariables.outputs.CWA_GITHUB_TEST_REPO_NAME }}
      test_repo_url: ${{ needs.OutputEnvVariables.outputs.CWA_GITHUB_TEST_REPO_URL }}
      test_repo_branch: ${{ needs.OutputEnvVariables.outputs.CWA_GITHUB_TEST_REPO_BRANCH }}
      cloudwatch_agent_repository: ${{ needs.OutputEnvVariables.outputs.ECR_INTEGRATION_TEST_REPO }}
      cloudwatch_agent_tag: ${{ github.sha }}
      cloudwatch_agent_operator_repository: ${{ needs.OutputEnvVariables.outputs.ECR_OPERATOR_REPO }}
      cloudwatch_agent_operator_tag: ${{ needs.GetLatestOperatorCommitSHA.outputs.operator_commit_sha }}
      region: ${{ inputs.region }}
      helm_charts_branch: ${{ inputs.helm-charts-branch }}
      terraform_assume_role: ${{ vars.TERRAFORM_AWS_ASSUME_ROLE }}
      agent_config: resources/cwagent_configs/jvm_tomcat.json
      sample_app: resources/sample_apps/tomcat-deployment.yaml
    secrets: inherit

License

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Tests

View Workflow Run #12337417856

Requirements

Before commit the code, please do the following steps.

1. Run make fmt and make fmt-sh
2. Run make lint

[okankoAMZ]

minor comments

[okankoAMZ]

This looks good, but would like to see it tested with the test repo after, the test repo is merged