Remove the Training Operator V1 Source Code (#2389)

* Remove Training Operator V1 files

Signed-off-by: Andrey Velichkevich <[email protected]>

* Refactor README and Makefile

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove v1 GitHub workflows

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove finish action from Go

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename Kubeflow Training to Kubeflow Trainer

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename comment

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add steps for free-up space

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update Python tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove integration workflow

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install SDK in Python integration tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove generate file

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add Kubeflow Trainer logo

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add tech diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Exclude images from pre-commit

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix git diff in CI

Signed-off-by: Andrey Velichkevich <[email protected]>

* Run go mod tidy

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Cleanup examples

Signed-off-by: Andrey Velichkevich <[email protected]>

* Always install Go bins

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update hack
Remove manifests for JobSet
Rename to tools.go

Signed-off-by: Andrey Velichkevich <[email protected]>

* Create tools.go

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>

.github/ISSUE_TEMPLATE/bug_report.yaml

@@ -1,11 +1,11 @@
 name: Bug Report
-description: Tell us about a problem you are experiencing with Training Operator
+description: Tell us about a problem you are experiencing with Kubeflow Trainer
 labels: ["kind/bug", "lifecycle/needs-triage"]
 body:
   - type: markdown
     attributes:
       value: |
-        Thanks for taking the time to fill out this Training Operator bug report!
+        Thanks for taking the time to fill out this Kubeflow Trainer bug report!
   - type: textarea
     id: problem
     attributes:

.github/ISSUE_TEMPLATE/config.yml

@@ -1,12 +1,12 @@
 blank_issues_enabled: true
 
 contact_links:
-  - name: Training Operator Documentation
-    url: https://www.kubeflow.org/docs/components/training/
+  - name: Kubeflow Trainer Documentation
+    url: https://www.kubeflow.org/docs/components/trainer/
     about: Much help can be found in the docs
-  - name: Kubeflow Training Operator Slack Channel
+  - name: Kubeflow Trainer Slack Channel
     url: https://www.kubeflow.org/docs/about/community/#kubeflow-slack-channels
-    about: Ask the Training Operator community on CNCF Slack
-  - name: Kubeflow Training Operator Community Meeting
+    about: Ask the Kubeflow Trainer community on CNCF Slack
+  - name: Kubeflow Training and AutoML WG Community Meeting
     url: https://bit.ly/2PWVCkV
     about: Join the Kubeflow Training working group meeting

.github/ISSUE_TEMPLATE/feature_request.yaml

@@ -1,18 +1,18 @@
 name: Feature Request
-description: Suggest an idea for Training Operator
+description: Suggest an idea for Kubeflow Trainer
 labels: ["kind/feature", "lifecycle/needs-triage"]
 body:
   - type: markdown
     attributes:
       value: |
-        Thanks for taking the time to fill out this Training Operator feature request!
+        Thanks for taking the time to fill out this Kubeflow Trainer feature request!
   - type: textarea
     id: feature
     attributes:
       label: What you would like to be added?
       description: |
-        A clear and concise description of what you want to add to Training Operator.
-        Please consider to write Training Operator enhancement proposal if it is a large feature request.
+        A clear and concise description of what you want to add to Kubeflow Trainer.
+        Please consider to write Kubeflow Enhancement Proposal (KEP) if it is a large feature request.
     validations:
       required: true
   - type: textarea

.github/PULL_REQUEST_TEMPLATE.md

@@ -12,4 +12,4 @@ Fixes #
 
 **Checklist:**
 
-- [ ] [Docs](https://www.kubeflow.org/docs/components/training/) included if any changes are user facing
+- [ ] [Docs](https://www.kubeflow.org/docs/components/trainer/) included if any changes are user facing

.github/workflows/build-and-push-images.yaml

@@ -0,0 +1,67 @@
+name: Build and Publish Images
+
+on:
+  - push
+  - pull_request
+
+jobs:
+  build-and-publish:
+    name: Build and Publish Images
+    runs-on: ubuntu-latest
+
+    strategy:
+      fail-fast: false
+      matrix:
+        include:
+          - component-name: training-operator-v2
+            dockerfile: cmd/training-operator.v2alpha1/Dockerfile
+            platforms: linux/amd64,linux/arm64,linux/ppc64le
+            tag-prefix: v2alpha1
+          - component-name: model-initializer-v2
+            dockerfile: cmd/initializer_v2/model/Dockerfile
+            platforms: linux/amd64,linux/arm64
+            tag-prefix: v2
+          - component-name: dataset-initializer-v2
+            dockerfile: cmd/initializer_v2/dataset/Dockerfile
+            platforms: linux/amd64,linux/arm64
+            tag-prefix: v2
+
+    steps:
+      - name: Checkout
+        uses: actions/checkout@v4
+
+      - name: Docker Login
+        # Trigger workflow only for kubeflow/training-operator repository with specific branch (master, release-*) or tag (v.*).
+        if: >-
+          github.repository == 'kubeflow/training-operator' &&
+          (github.ref == 'refs/heads/master' || startsWith(github.ref, 'refs/heads/release-') || startsWith(github.ref, 'refs/tags/v'))
+        uses: docker/login-action@v3
+        with:
+          username: ${{ secrets.DOCKERHUB_USERNAME }}
+          password: ${{ secrets.DOCKERHUB_TOKEN }}
+
+      - name: Publish Component ${{ matrix.component-name }}
+        # Trigger workflow only for kubeflow/training-operator repository with specific branch (master, release-*) or tag (v.*).
+        if: >-
+          github.repository == 'kubeflow/training-operator' &&
+          (github.ref == 'refs/heads/master' || startsWith(github.ref, 'refs/heads/release-') || startsWith(github.ref, 'refs/tags/v'))
+        id: publish
+        uses: ./.github/workflows/template-publish-image
+        with:
+          image: docker.io/kubeflow/${{ matrix.component-name }}
+          dockerfile: ${{ matrix.dockerfile }}
+          platforms: ${{ matrix.platforms }}
+          context: ${{ matrix.context }}
+          tag-prefix: ${{ matrix.tag-prefix }}
+          push: true
+
+      - name: Test Build For Component ${{ matrix.component-name }}
+        if: steps.publish.outcome == 'skipped'
+        uses: ./.github/workflows/template-publish-image
+        with:
+          image: docker.io/kubeflow/${{ matrix.component-name }}
+          dockerfile: ${{ matrix.dockerfile }}
+          platforms: ${{ matrix.platforms }}
+          context: ${{ matrix.context }}
+          tag-prefix: ${{ matrix.tag-prefix }}
+          push: false