Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(v2): sync with kubeflow/pipelines 2.0.3 #1408

Merged
merged 254 commits into from
Oct 27, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
254 commits
Select commit Hold shift + click to select a range
ea7a5ef
feat(components): Review and update batch_predict_job GCPC docstrings
Jun 26, 2023
35f7507
chore(deps): bump fast-xml-parser and @aws-sdk/credential-providers i…
dependabot[bot] Jun 26, 2023
e1708d3
chore(components): Add automl directory under preview
TheMichaelHu Jun 29, 2023
7f23bfc
fix(components): Move model eval version.py to _implementation folder
jsondai Jun 29, 2023
a634eef
feat(components): define new GCPC Model Eval component for LLM Text G…
jsondai Jun 30, 2023
4a57ab6
chore(components): Move openvino components and samples to the right …
chensun Jul 5, 2023
95901c8
feat(components): Add helper functions to create slice_specs and bias…
Jul 5, 2023
7e89d05
test: Use GKE stable release channel to unblock presubmit tests. Fixe…
chensun Jul 5, 2023
5ea193c
chore(frontend): Remove redundant handleVersionSelected helper functi…
jlyaoyuli Jul 6, 2023
d1be1d9
fix(frontend): Recurring run card in experiment details page (#9697)
jlyaoyuli Jul 6, 2023
259d7f2
chore(components): Migrate AutoML components to preview and v1 as needed
TheMichaelHu Jul 6, 2023
3b62017
chore(components): Migrate AutoML components to preview and v1 as needed
Jul 6, 2023
c8204d0
chore(sdk): partition KFP SDK source code into runtime and non-runtim…
connor-mccarthy Jul 7, 2023
ba322ab
chore(frontend): Refactor resource selector for sharable usage in bot…
jlyaoyuli Jul 8, 2023
e070387
chore(components): Migrate AutoML components to preview and v1 as needed
TheMichaelHu Jul 10, 2023
4f74148
chore(deps): bump fast-xml-parser and @aws-sdk/credential-providers i…
dependabot[bot] Jul 10, 2023
283f74b
chore(frontend): Remove unnecessary getVersionTemplate() call in Pipe…
jlyaoyuli Jul 12, 2023
213dd5a
fix(backend): Fix performance issue within a mysql request (#9680)
difince Jul 12, 2023
49bfda9
feat(manifests): Add a postgresql deployment manifest in third-party …
zijianjoy Jul 12, 2023
e532039
chore(deps): bump semver from 5.7.1 to 5.7.2 in /frontend/server (#9729)
dependabot[bot] Jul 13, 2023
5a0e2bd
fix(components): fix parent_model parameter of ModelUploadOp ignored
connor-mccarthy Jul 13, 2023
474cc45
chore(components): release GCPC v2.1.0
connor-mccarthy Jul 13, 2023
6674241
docs(components): point GCPC README at v2 reference documentation
connor-mccarthy Jul 17, 2023
1045c95
chore(sdk): resolve mypy finding (#9742)
droctothorpe Jul 17, 2023
d9a3eca
chose(test): Set image-type to cos_containerd and hard-code GKE versi…
gkcalat Jul 18, 2023
de89b1c
fix(backend) Replace LEFT with INNER JOIN when Archive Experiment (#9…
difince Jul 18, 2023
81e989a
test(components): INTERNAL
Jul 18, 2023
fdb25f6
test(components): fix k8s_client 401 unauthorized error (#9749)
rd-pong Jul 18, 2023
79d31db
chore(components): remove unused GCPC files
connor-mccarthy Jul 18, 2023
d331ca0
feat(components): Allow ImportModelEvaluationOp to take LLM metrics f…
KevinBNaughton Jul 18, 2023
b1c3dff
test(components): INTERNAL
Jul 19, 2023
3c6d74f
test(components): INTERNAL
Jul 19, 2023
998e856
test(components): INTERNAL
Jul 19, 2023
273c772
test(components): INTERNAL
Jul 19, 2023
79b079c
chore(components): internal
connor-mccarthy Jul 19, 2023
c917fb9
chore(components): internal
connor-mccarthy Jul 19, 2023
fde2a3d
chore(components): internal
connor-mccarthy Jul 20, 2023
e5b3652
chore(frontend): Avoid redundant v2 API call in PipelineDetails. (#9728)
jlyaoyuli Jul 20, 2023
b834c8a
chore(components): clean up pipeline yaml
connor-mccarthy Jul 20, 2023
1619f2c
docs(components): present all v2 GCPC versions on all pages of v2 GCP…
connor-mccarthy Jul 20, 2023
c27d23a
feat(components): Output imported evaluation resource name in ImportM…
KevinBNaughton Jul 25, 2023
99830e3
chore(components): move output artifact util to common utils dir
connor-mccarthy Jul 25, 2023
525ff90
chore(sdk): extract DSL into `kfp-dsl` package (#9738)
connor-mccarthy Jul 25, 2023
309c5b9
chore(sdk): release KFP SDK 2.1.0 (#9782)
connor-mccarthy Jul 26, 2023
8ad9716
fix(sdk): various kfp-dsl fixes (#9785)
connor-mccarthy Jul 26, 2023
49db9ef
chore(sdk): release KFP SDK 2.1.1 (#9787)
connor-mccarthy Jul 27, 2023
46fafe3
chore(components): add project_id and location placeholders as GCPC i…
connor-mccarthy Jul 27, 2023
7c55a4f
chore(components): release GCPC v2.1.1
connor-mccarthy Jul 27, 2023
cc829bd
chore(components): release GCPC v2.1.1
connor-mccarthy Jul 27, 2023
8dd9bd6
chore(components): Update evaluation component type hints to be Pytho…
KevinBNaughton Jul 27, 2023
2cfe463
fix(components): Update package import for google protobuf
KevinBNaughton Jul 27, 2023
ae804f4
feat(components): Implement LLM Safety Bias Component & E2E tests
Jul 27, 2023
540294a
fix(sdk): fix GCPC break in KFP SDK (#9791)
connor-mccarthy Jul 27, 2023
25f6ee6
chore(sdk): release KFP SDK 2.1.2 (#9797)
connor-mccarthy Jul 28, 2023
27ee817
chore(components): add comment to GCPC utils and convert annotation t…
connor-mccarthy Jul 29, 2023
af753dc
feat(components): Update RAI safety component with latest image
jsondai Aug 1, 2023
0153430
fix(frontend): Missing pipeline version name in new run page. (#9799)
jlyaoyuli Aug 2, 2023
11a5ae1
chore(sdk): clean up artifact code (#9800)
connor-mccarthy Aug 4, 2023
a6af41c
fix(backend): fix timeouts with list run api. Fixes #9780 (#9806)
deepk2u Aug 4, 2023
c92f40c
chore(components): Refactor evaluation pipelines into graph components
KevinBNaughton Aug 4, 2023
f07aef7
chore(components): release GCPC v2.1.1 [roll forward]
connor-mccarthy Aug 7, 2023
671bb0c
docs(components): Name change and update LLM safety bias metrics comp…
jsondai Aug 7, 2023
f8c1f9c
feat(components): Internal change
KevinBNaughton Aug 8, 2023
1a2a752
chore(components): internal
connor-mccarthy Aug 8, 2023
37b907f
test(sdk): add KFP SDK upgrade presubmit test (#9827)
connor-mccarthy Aug 8, 2023
f80d2b3
feat(components): Internal change
KevinBNaughton Aug 8, 2023
1dc8453
feat(components): Internal change
KevinBNaughton Aug 8, 2023
d98fa90
feat: Adding new test infrastructure for e2e pipeline tests
Aug 8, 2023
82386d7
chore: Add config for stale GHA (#9817)
gkcalat Aug 8, 2023
443a674
test(frontend): Improve v1 frontend-integration-test (#9811)
jlyaoyuli Aug 8, 2023
f9e9efa
chore(components): internal
connor-mccarthy Aug 8, 2023
7bb24e7
chore(components): clean up
connor-mccarthy Aug 9, 2023
2f32b23
chore(test): change hard-coded GKE version to 1.25 (#9841)
Linchin Aug 9, 2023
b350ac4
feat(components): Upgrade LLM evaluation classification and text gene…
KevinBNaughton Aug 10, 2023
e1f0c01
feat(backend): add postgres initialization (#9798)
Linchin Aug 10, 2023
3e45328
chore(components): INTERNAL
Aug 10, 2023
83d7e71
fix(frontend): Introduce ALLOWED_ARTIFACT_DOMAIN_REGEX flag to preven…
zijianjoy Aug 11, 2023
1002e0c
fix(samples): update samples to v2 pipelines (#9851)
ryanjung-jm Aug 11, 2023
b630d5c
feat(components): add Vertex RAI safety bias evaluation pipeline
jsondai Aug 11, 2023
b71d43e
feat(eval): Implement embedding metrics importing
Aug 14, 2023
88e1045
feat(components): use GCPC project id placeholder as project paramete…
connor-mccarthy Aug 14, 2023
ff90cea
feat(components): Internal change
Aug 14, 2023
450e910
feat(chore): Change AutoML Vision Error Analysis pipeline names
KevinBNaughton Aug 14, 2023
7b4ddf6
test: enabe back archiving experiment action in kfp_functional_test (…
difince Aug 15, 2023
ff2e002
fix(samples): Update loop_parameter, loop_static samples to v2 pipeli…
junggil Aug 15, 2023
f454a86
feat(components): Add Feature Attribution components to _implementati…
jsondai Aug 15, 2023
e88e7a6
chore(components): GCPC v2.2.0 release
Aug 15, 2023
c9e5479
chore(sdk): undo creation of kfp-dsl namespace package (#9874)
connor-mccarthy Aug 15, 2023
3e3a747
fix(samples): Update execution_order, loop_output samples to v2 pipel…
junggil Aug 16, 2023
f6d0772
chore(sdk): remove kfp-dsl source code (#9881)
connor-mccarthy Aug 16, 2023
fe60742
fix(backend): Move ConMaxLifeTime back to DbConfig.ConMaxLifeTime. (#…
zijianjoy Aug 16, 2023
47f1147
feat(components): Metric importing for embedding evaluation
Aug 16, 2023
90cec16
fix(samples): Update volume_ops sample to v2 pipelines (#9877)
junggil Aug 17, 2023
cd7e316
test: upgrade e2e sample tests to using sdk v2 (#9885)
chensun Aug 17, 2023
cb18d00
feat(backend) Enable auth between pesistence agent and pipelineAPI (R…
difince Aug 17, 2023
6dfcee7
Fix Persistence Agent SA Token time interval (#9892)
difince Aug 17, 2023
4ed8b7c
chore(components): add GCPC automl reference docs
connor-mccarthy Aug 17, 2023
40c759f
chore(release): bump version to 2.0.1 on master branch (#9899)
chensun Aug 17, 2023
c405d6b
docs(components): fix automl docs
connor-mccarthy Aug 17, 2023
562cd29
feat(components): Components for Embedding Eval pipeline
Aug 18, 2023
db3f867
chore(components): Update the pipelines for the Tabular Workflow for …
Aug 18, 2023
f323acf
fix(components): Fix proto reference from range to _range in model ev…
KevinBNaughton Aug 18, 2023
c3b9550
chore(components): INTERNAL
Aug 19, 2023
beb66ab
chore(components): INTERNAL
Aug 19, 2023
611298a
feat(components): Add rlhf and infer pipelines to preview/llm. Add ll…
Aug 19, 2023
9184062
docs(components): add LLM docs to GCPC readthedocs
connor-mccarthy Aug 20, 2023
2451b51
chore(components): use type generics from typing module in GCPC
connor-mccarthy Aug 20, 2023
7d282b9
chore(components): reorganize gcpc llm components
connor-mccarthy Aug 20, 2023
59aa41d
chore(components): fix infer_pipeline invocation
connor-mccarthy Aug 20, 2023
4e10c58
chore(components): GCPC 2.3.0 release
connor-mccarthy Aug 20, 2023
5b59e4a
chore(components): add `__init__.py` file to gcpc `_implementation/llm`
connor-mccarthy Aug 20, 2023
b086020
feat(deployment): add option to deploy mysql in KFP standalone (#9855)
Linchin Aug 21, 2023
0fed207
fix(manifests): Update persistence agent manifests in marketplace hel…
zijianjoy Aug 21, 2023
e8fefc9
chore(frontend): Update caniuse-lite in package-lock.json (#9857)
zijianjoy Aug 21, 2023
eaec515
chore(mlmd): Upgrade ML Metadata to 1.14.0. (#9856)
zijianjoy Aug 22, 2023
f43272d
feat(components): Update container URIs for embedding eval components
Aug 22, 2023
9ce2866
feat(components): Update supported large model reference names that c…
Aug 23, 2023
b6be4ea
feat(mlmd): Introduce PostgreSQL kustomization for MLMD. (#9927)
zijianjoy Aug 24, 2023
cf0e0cf
feat(sdk): enable dependency-free runtime install of kfp (#9886)
connor-mccarthy Aug 24, 2023
43a3c5c
chore(stalebot): Increase stalebot operations from 30 to 200. (#9928)
zijianjoy Aug 24, 2023
63a0803
fix: Move stale GHA operation config to the right place (#9935)
zijianjoy Aug 25, 2023
110e082
feat(components): Update policy to reward model name mapping in funct…
Aug 27, 2023
e3bf085
fix(components):Update batch_prediction_*_gcs_source to predictions_*…
Aug 28, 2023
ba2440a
chore(test): update marketplace snapshot (#9900)
chensun Aug 29, 2023
bc5fe57
chore(frontend): Refactor RecurringRunDetails to functional component…
jlyaoyuli Aug 30, 2023
6b7739d
chore(frontend): Refactor NewExperiment to functional component (#9948)
jlyaoyuli Sep 1, 2023
3fb1996
chore(components): convert GCPC docstrings to markdown
connor-mccarthy Sep 1, 2023
ef0788d
feat(sdk): add logging at end of executor execution (#9895)
connor-mccarthy Sep 5, 2023
cac1856
feat(components): Embedding eval pipeline for experimental launch
Sep 5, 2023
959f54e
chore(sdk): release kfp sdk 2.1.3 (#9896)
connor-mccarthy Sep 5, 2023
e21174f
feat(components): Add sampling_strategy parameter to bulk inferrer to…
Sep 5, 2023
2b05ec8
chore(sdk): remove old file (#9959)
connor-mccarthy Sep 5, 2023
3b8cea0
fix(components): Have RLHF importer use default image if override is …
TheMichaelHu Sep 7, 2023
760c158
feat(backend): enforce SA Token based auth b/w Persistence Agent and …
difince Sep 7, 2023
1791818
chore(components): release GCPC SDK 2.3.1
connor-mccarthy Sep 11, 2023
c6b236d
feat(sdk): support dsl.If, dsl.Elif, and dsl.Else (#9894)
connor-mccarthy Sep 11, 2023
0ced6ec
feat(components): Implement chunking for embedding evaluation pipeline
Sep 12, 2023
abf05f4
feat(components): fork a subset of `v1` `custom_job` and `gcp_launche…
connor-mccarthy Sep 12, 2023
4bee3d8
chore(components): Add public-image-gcpc-v2-scan tag for latest gcpc …
Sep 12, 2023
2a4460c
chore(components): internal
connor-mccarthy Sep 13, 2023
a39980a
chore(frontend): Improve structure of NewExperimentFC. (#9951)
zijianjoy Sep 13, 2023
510f23a
chore(components): remove error __init__.py file
connor-mccarthy Sep 13, 2023
cc2cd58
fix(sdk): fix --no-deps flag usage (#9982)
connor-mccarthy Sep 13, 2023
cfe671c
chore(components): Update the pipelines for the Tabular Workflow
Sep 13, 2023
1fbdeb2
chore(components): fix GCPC markdown docstrings rendering
connor-mccarthy Sep 14, 2023
659c54b
chore(sdk): release KFP SDK 2.2.0 (#9984)
connor-mccarthy Sep 14, 2023
8518e95
feat(components): Implement helper functions for Jinja2-based Templat…
Sep 14, 2023
fc1f12b
feat(components): add `persistent_resource_id` to preview GCPC custom…
connor-mccarthy Sep 14, 2023
a13e143
test: fix sdk execution test (#9988)
chensun Sep 14, 2023
ad058b5
chore(components): bump KFP SDK version number in GCPC
connor-mccarthy Sep 14, 2023
e307545
feat(components): Implement `create_templated_custom_job` for Templat…
Sep 15, 2023
e137ae7
Fix(frontend): content is not available (#9720)
axel7083 Sep 15, 2023
f8f01bc
feat(components): Add main entry and command-line flags for Templated…
Sep 15, 2023
d001b80
chore(sdk): refactor python component executor (#9990)
connor-mccarthy Sep 15, 2023
df4bc46
feat(components): Add AutoML image training job v1 remote runner
KCFindstr Sep 15, 2023
6468b4d
feat(components): Use t5-xl reward model when tuning t5-xxl
Sep 15, 2023
20218a9
chore(sdk): test observability, refactorings, and cleanup (#10005)
connor-mccarthy Sep 18, 2023
4945e2c
feat(components): Support multiple chunking functions
Sep 19, 2023
b31d8a5
feat(components): Update default image tag used by LLM implementation…
Sep 19, 2023
adb8677
No public description
Sep 19, 2023
e99f270
feat(sdk): support `PipelineTaskFinalStatus` in tasks that use `.igno…
connor-mccarthy Sep 21, 2023
434b41a
fix(backend): update requirements scripts (#10009)
davidspek Sep 21, 2023
c5baf57
chore(deps): bump github.com/emicklei/go-restful from 2.15.0+incompat…
dependabot[bot] Sep 21, 2023
623e309
chore(components): fix import in proto/README
connor-mccarthy Sep 22, 2023
e8b8450
feat(components): Add support for customizing evaluation_display_name…
jsondai Sep 22, 2023
b0cccfe
fix(components): include model version in upload model output artifac…
connor-mccarthy Sep 22, 2023
9fe2dce
chore: fix go mod file (#10023)
chensun Sep 22, 2023
2ef5afe
chore(sdk): release KFP SDK 2.3.0 (#10024)
connor-mccarthy Sep 22, 2023
4003e56
fix(backend): OutPutPath dir creation mode Fixes #7629 (#9946)
rvadim Sep 22, 2023
dcaafee
fix(backend): Sync scheduled workflows v1 if APIVersion and Kind are …
sweb Sep 23, 2023
a76e385
feat(components): Implement the chunking component
Sep 25, 2023
173be83
chore(components): bump GCPC's KFP SDK upper bound to 2.3.0
connor-mccarthy Sep 25, 2023
45fe8e8
feat(components): Use 64 v3 TPUs for llm pipelines
Sep 25, 2023
a070006
chore(components): release GCPC SDK 2.4.0
Sep 28, 2023
4fd1c02
fix(components): Disable caching for LLM pipeline components that sto…
Oct 2, 2023
cc9d7e7
chore(components): fix GCPC readthedocs dropdown versions
connor-mccarthy Oct 2, 2023
3581146
chore(components): add `build.os` field to readthedocs config
connor-mccarthy Oct 2, 2023
42df5e1
fix(components): Fix the feature transform engine arguments
Oct 3, 2023
3886ae8
chore(components): release GCPC SDK 2.4.1
Oct 3, 2023
f55ec3f
docs(components): migrate to `build.os` (additional changes)
connor-mccarthy Oct 3, 2023
b83b9a4
docs(components): fix preview.custom_job.create_custom_training_job_f…
connor-mccarthy Oct 4, 2023
07156ae
fix(components): Minor update for chunking parameter name
Oct 4, 2023
87005cc
chore(sdk): wrap conditional branch groups in outer pipeline (#10034)
connor-mccarthy Oct 5, 2023
2fbabd9
chore(component): Update KServe component to support Kubeflow 1.8 (#1…
Tomcli Oct 5, 2023
271d4eb
Intel oneAPI XGBoost daal4py example pipeline (#10044)
kellibelcher Oct 5, 2023
d3a15d9
chore: Update OWNERS (#10064)
Linchin Oct 6, 2023
b273aab
feat(components): Add LLM implementation component that uploads tenso…
Oct 6, 2023
0670337
feat(components): internal change
Oct 6, 2023
fcdff29
fix(sdk): fix incorrect sub-DAG output type when using `dsl.Collected…
connor-mccarthy Oct 9, 2023
55f174e
chore(sdk): clean up compiler_test.py (#10070)
connor-mccarthy Oct 9, 2023
2bb57ec
feat(components): Upload tensorboard metrics from RLHF pipeline if a …
Oct 9, 2023
15c24e3
feat(components): Switch v1 AutoMLImageTrainingJob to use the pipelin…
KCFindstr Oct 9, 2023
8b0e6a3
chore(backend): Update driver and launcher license files (#10072)
chensun Oct 10, 2023
2131dfa
chore(components): Fix formatting in upcoming release notes
Oct 10, 2023
5835824
feat(backend): Added metrics to be collected from failed/successful w…
MGSousa Oct 10, 2023
72e7f96
feat(components): [text2sql] Initialize text2sql pipeline
Oct 10, 2023
9cf92c3
feat(components): Release new model evaluation image versions
jsondai Oct 10, 2023
3c5f62a
feat(backend): Update driver and launcher images (#10076)
chensun Oct 10, 2023
1f37243
feat(components): Update embedding pipeline containers to use llm-pip…
Oct 11, 2023
5c44143
feat(components): Implement timestamp filtering for chunking
Oct 11, 2023
b348911
chore(components): pin GCPC's `google-cloud-aiplatform` dependency
connor-mccarthy Oct 11, 2023
8f07661
feat(components): Add vision data converter component to preview
KCFindstr Oct 11, 2023
efe630c
chore(release): bumped version to 2.0.2
chensun Oct 11, 2023
412216f
feat(components): Add question_answer support for AutoSxS default ins…
Oct 11, 2023
1386a82
feat(components): Set display names for SFT, RLHF and LLM inference p…
Oct 12, 2023
4d71fda
feat(components): Update image tag used by llm pipelines
Oct 12, 2023
9aa750e
feat(components): [text2sql] Initialize preprocess component and int…
Oct 12, 2023
633ddeb
feat(components): [text2sql] Initialize validate and process component
Oct 13, 2023
ea93979
feat(components): [text2sql] Initialize evaluation component
Oct 13, 2023
0487f9a
feat(components): Add sliced evaluation metrics support for custom an…
jsondai Oct 13, 2023
c903271
fix(sdk): Fix OOB for IPython and refactor. Closes #10075. (#10094)
gkcalat Oct 13, 2023
ab33e2a
chore(sdk): Improve a message printed for users. Closes #10100 (#10101)
gkcalat Oct 15, 2023
da6a360
fix(frontend): Replace twitter artifactory endpoint with npm endpoint…
zijianjoy Oct 16, 2023
1682ce8
feat(components): Support service account in kubeflow model_batch_pre…
Oct 17, 2023
2d3171c
feat(sdk): support collecting outputs from conditional branches using…
connor-mccarthy Oct 18, 2023
faba922
feat(components): migrate `DataflowFlexTemplateJobOp` to GA namespace…
connor-mccarthy Oct 18, 2023
73d51c8
fix(sdk): fix bug when `dsl.importer` argument is provided by loop va…
connor-mccarthy Oct 18, 2023
d8a0660
feat(components): Add sliced evaluation metrics support for custom an…
jsondai Oct 18, 2023
e8fb699
feat(components): Make `model_checkpoint` optional for `preview.llm.i…
Oct 19, 2023
8d00d0e
feat(sdk): support a Pythonic artifact authoring style (#9932)
connor-mccarthy Oct 19, 2023
0e240db
No public description
Oct 19, 2023
99fd201
feat(components): Add ability to preprocess chat llama datasets to `_…
Oct 19, 2023
1ae7271
chore(components): pin `apache_beam[gcp]` to `2.50.0`
connor-mccarthy Oct 19, 2023
8d979e8
docs(sdk): add KFP SDK reference docs local build script (#10124)
connor-mccarthy Oct 19, 2023
c0adea9
chore(sdk): add test for key error bug resolved in #10067 (#10128)
connor-mccarthy Oct 19, 2023
5cb9ebf
chore(deps): bump word-wrap from 1.2.3 to 1.2.4 in /frontend/server (…
dependabot[bot] Oct 20, 2023
c32cdc7
chore(frontend): update all references to python 3.9 (#10020)
davidspek Oct 20, 2023
a690009
chore(components): release GCPC 2.5.0
connor-mccarthy Oct 20, 2023
d53ddda
feat(components): add support for customizing model_parameters in LLM…
jsondai Oct 20, 2023
3eafa17
chore(deps-dev): bump @babel/traverse from 7.9.5 to 7.23.2 in /fronte…
dependabot[bot] Oct 21, 2023
0cb2217
chore(components): update GCPC custom job docstrings
connor-mccarthy Oct 23, 2023
2054b7c
feat(components) Extend kserve component (#10136)
magdalenakuhn17 Oct 23, 2023
21079b5
feat(components): [text2sql] Implement preprocess component logic
Oct 24, 2023
ebb4245
feat(components): [text2sql] Generate table names by model batch pred…
Oct 24, 2023
c0ef67c
chore(components): update GCPC docstrings
connor-mccarthy Oct 24, 2023
04aac25
chore(components): add GCPC Python 3.7 EOL warning
connor-mccarthy Oct 24, 2023
c383eb6
chore(components): Update AutoML Vision data converter component
KCFindstr Oct 24, 2023
e3b1863
chore(sdk): add Python 3.7 EOL notice (#10139)
connor-mccarthy Oct 24, 2023
0d75611
feat(components): [endpoint_batch_predict] Initialize component
Oct 24, 2023
570e56d
fix(components): [text2sql] Turn model_inference_results_path to mode…
Oct 25, 2023
c83329f
chore(components): fix GCPC markdown docstrings rendering
Oct 25, 2023
7ab05d8
chore(sdk): Remove the ` (<type>)`from docstring args. (#10159)
rickyxie0929 Oct 26, 2023
2882fcf
chore(sdk): add pytest.ini file (#10160)
connor-mccarthy Oct 26, 2023
02e00e8
fix(sdk): type annotation for client credentials (#10158)
thesuperzapper Oct 26, 2023
03df9df
chore(sdk): fix local test failure (#10161)
connor-mccarthy Oct 26, 2023
52f5cf5
feat(backend): Support consuming parent DAG input artifact (#10162)
chensun Oct 26, 2023
1bee8be
feat(components): [text2sql] Generate column names by model batch pre…
Oct 26, 2023
c0093ec
feat(backend): Update driver and launcher images (#10164)
chensun Oct 27, 2023
58ce09e
chore(release): bumped version to 2.0.3
chensun Oct 27, 2023
ec8229b
sync 'kubeflow/pipelines' 2.0.3 into 2.0.x
yhwang Oct 27, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .cloudbuild.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -158,7 +158,7 @@ steps:
# * manifests/kustomize/base/metadata/base/metadata-grpc-deployment.yaml
# * test/tag_for_hosted.sh
- name: 'gcr.io/cloud-builders/docker'
args: ['pull', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.5.0']
args: ['pull', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.14.0']
id: 'pullMetadataServer'
- name: 'gcr.io/cloud-builders/docker'
args: ['pull', 'gcr.io/ml-pipeline/minio:RELEASE.2019-08-14T20-37-41Z-license-compliance']
Expand Down
2 changes: 1 addition & 1 deletion .github/stale.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,4 @@ markComment: >
# Comment to post when closing a stale issue. Set to `false` to disable
closeComment: >
This issue has been automatically closed because it has not had recent
activity. Please comment "/reopen" to reopen it.
activity. Please comment "/reopen" to reopen it.
39 changes: 39 additions & 0 deletions .github/workflows/stale.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
# This workflow warns and then closes issues and PRs that have had no activity for a specified amount of time.
#
# You can adjust the behavior by modifying this file.
# For more information, see:
# https://github.com/actions/stale
name: Mark stale issues and pull requests

on:
schedule:
- cron: '39 7 * * *'

jobs:
stale:

runs-on: ubuntu-latest
permissions:
issues: write
pull-requests: write

steps:
- uses: actions/stale@v5
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}
days-before-stale: -1
days-before-close: -1
days-before-issue-stale: 90
days-before-issue-close: 90
stale-issue-message: >
This issue has been automatically marked as stale because it has not had
recent activity. It will be closed if no further activity occurs. Thank you
for your contributions.
close-issue-message: >
This issue has been automatically closed because it has not had recent
activity. Please comment "/reopen" to reopen it.
stale-issue-label: 'lifecycle/stale'
exempt-issue-labels: lifecycle/frozen
exempt-pr-labels: lifecycle/frozen
# Learn more about operations: https://github.com/actions/stale#operations-per-run.
operations-per-run: 200
10 changes: 5 additions & 5 deletions .release.cloudbuild.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -259,14 +259,14 @@ steps:
# * manifests/kustomize/base/metadata/base/metadata-grpc-deployment.yaml
# * test/tag_for_hosted.sh
- name: 'gcr.io/cloud-builders/docker'
args: ['pull', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.5.0']
args: ['pull', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.14.0']
id: 'pullMetadataServer'
- name: 'gcr.io/cloud-builders/docker'
args: ['tag', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.5.0', 'gcr.io/ml-pipeline/google/pipelines/metadataserver:$TAG_NAME']
args: ['tag', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.14.0', 'gcr.io/ml-pipeline/google/pipelines/metadataserver:$TAG_NAME']
id: 'tagMetadataServerForMarketplace'
waitFor: ['pullMetadataServer']
- name: 'gcr.io/cloud-builders/docker'
args: ['tag', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.5.0', 'gcr.io/ml-pipeline/google/pipelines-test/metadataserver:$TAG_NAME']
args: ['tag', 'gcr.io/tfx-oss-public/ml_metadata_store_server:1.14.0', 'gcr.io/ml-pipeline/google/pipelines-test/metadataserver:$TAG_NAME']
id: 'tagMetadataServerForMarketplaceTest'
waitFor: ['pullMetadataServer']
- id: 'tagMetadataServerForMarketplaceMajorMinor'
Expand All @@ -276,8 +276,8 @@ steps:
args:
- -ceux
- |
docker tag gcr.io/tfx-oss-public/ml_metadata_store_server:1.5.0 gcr.io/ml-pipeline/google/pipelines/metadataserver:$(cat /workspace/mm.ver)
docker tag gcr.io/tfx-oss-public/ml_metadata_store_server:1.5.0 gcr.io/ml-pipeline/google/pipelines-test/metadataserver:$(cat /workspace/mm.ver)
docker tag gcr.io/tfx-oss-public/ml_metadata_store_server:1.14.0 gcr.io/ml-pipeline/google/pipelines/metadataserver:$(cat /workspace/mm.ver)
docker tag gcr.io/tfx-oss-public/ml_metadata_store_server:1.14.0 gcr.io/ml-pipeline/google/pipelines-test/metadataserver:$(cat /workspace/mm.ver)
docker push gcr.io/ml-pipeline/google/pipelines/metadataserver:$(cat /workspace/mm.ver)
docker push gcr.io/ml-pipeline/google/pipelines-test/metadataserver:$(cat /workspace/mm.ver)

Expand Down
155 changes: 155 additions & 0 deletions CHANGELOG.md

Large diffs are not rendered by default.

19 changes: 13 additions & 6 deletions OWNERS
Original file line number Diff line number Diff line change
@@ -1,8 +1,15 @@
approvers:
- chensun
- IronPan
- james-jwu
- zijianjoy
- ckadner
- Tomcli
- fenglixa
- pugangxa
- scrapcodes
- yhwang
reviewers:
- chensun
- zijianjoy
- ckadner
- Tomcli
- fenglixa
- pugangxa
- jinchihe
- scrapcodes
- yhwang
2 changes: 1 addition & 1 deletion VERSION
Original file line number Diff line number Diff line change
@@ -1 +1 @@
2.0.1
2.0.3
2 changes: 1 addition & 1 deletion backend/Dockerfile.driver
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.

FROM golang:1.20.4-alpine3.17 as builder
FROM golang:1.20.9-alpine3.17 as builder

WORKDIR /go/src/github.com/kubeflow/pipelines
COPY . .
Expand Down
2 changes: 1 addition & 1 deletion backend/Dockerfile.launcher
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
# See the License for the specific language governing permissions and
# limitations under the License.

FROM golang:1.20.4-alpine3.17 as builder
FROM golang:1.20.9-alpine3.17 as builder

WORKDIR /go/src/github.com/kubeflow/pipelines
COPY . .
Expand Down
2 changes: 1 addition & 1 deletion backend/Dockerfile.visualization
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
# and exporter.py files in the directory specified above.

# This image should be in sync with image in backend/src/apiserver/visualization/update_requirements.sh.
FROM tensorflow/tensorflow:2.5.1
FROM tensorflow/tensorflow:2.10.1

RUN apt-get update \
&& apt-get install -y wget curl tar openssl
Expand Down
12 changes: 11 additions & 1 deletion backend/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ CSV_PATH=backend/third_party_licenses
# Whenever build command for any of the binaries change, we should update them both here and in backend/Dockerfiles.

.PHONY: all
all: license_apiserver license_persistence_agent license_cache_server license_swf license_viewer
all: license_apiserver license_persistence_agent license_cache_server license_swf license_viewer license_driver license_launcher

.PHONY: clean
clean:
Expand All @@ -21,6 +21,10 @@ $(BUILD)/swf:
GO111MODULE=on go build -o $(BUILD)/swf github.com/kubeflow/pipelines/backend/src/crd/controller/scheduledworkflow
$(BUILD)/viewer:
GO111MODULE=on go build -o $(BUILD)/viewer github.com/kubeflow/pipelines/backend/src/crd/controller/viewer
$(BUILD)/driver:
GO111MODULE=on go build -o $(BUILD)/driver github.com/kubeflow/pipelines/backend/src/v2/cmd/driver
$(BUILD)/launcher:
GO111MODULE=on go build -o $(BUILD)/launcher github.com/kubeflow/pipelines/backend/src/v2/cmd/launcher-v2

# Update licenses info after dependencies changed.
# See README.md#updating-licenses-info section for more details.
Expand All @@ -39,6 +43,12 @@ license_swf: $(BUILD)/swf
.PHONY: license_viewer
license_viewer: $(BUILD)/viewer
cd $(MOD_ROOT) && go-licenses csv ./backend/src/crd/controller/viewer > $(CSV_PATH)/viewer.csv
.PHONY: license_driver
license_driver: $(BUILD)/driver
cd $(MOD_ROOT) && go-licenses csv ./backend/src/v2/cmd/driver > $(CSV_PATH)/driver.csv
.PHONY: license_launcher
license_launcher: $(BUILD)/launcher
cd $(MOD_ROOT) && go-licenses csv ./backend/src/v2/cmd/launcher-v2 > $(CSV_PATH)/launcher.csv

.PHONY: image_all
image_all: image_apiserver image_persistence_agent image_cache image_swf image_viewer image_visualization
Expand Down
10 changes: 4 additions & 6 deletions backend/OWNERS
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
approvers:
- chensun
- gkcalat
- Linchin
- Tomcli
- yhwang
reviewers:
- chensun
- gkcalat
- Linchin
- Tomcli
- yhwang
7 changes: 7 additions & 0 deletions backend/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,6 +55,13 @@ need to be regenerated and checked-in. Refer to [backend/api](./api/README.md) f
make all
```

## Updating python dependencies

[pip-tools](https://github.com/jazzband/pip-tools) is used to manage python
dependencies. To update dependencies, edit [requirements.in](requirements.in)
and run `./update_requirements.sh` to update and pin the transitive
dependencies.

# Visualization Server Instructions

## Updating python dependencies
Expand Down
4 changes: 2 additions & 2 deletions backend/api/v1beta1/python_http_client/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ This file contains REST API specification for Kubeflow Pipelines. The file is au

This Python package is automatically generated by the [OpenAPI Generator](https://openapi-generator.tech) project:

- API version: 2.0.1
- Package version: 2.0.1
- API version: 2.0.3
- Package version: 2.0.3
- Build package: org.openapitools.codegen.languages.PythonClientCodegen
For more information, please visit [https://www.google.com](https://www.google.com)

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@

from __future__ import absolute_import

__version__ = "2.0.1"
__version__ = "2.0.3"

# import apis into sdk package
from kfp_server_api.api.experiment_service_api import ExperimentServiceApi
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ def __init__(self, configuration=None, header_name=None, header_value=None,
self.default_headers[header_name] = header_value
self.cookie = cookie
# Set default User-Agent.
self.user_agent = 'OpenAPI-Generator/2.0.1/python'
self.user_agent = 'OpenAPI-Generator/2.0.3/python'
self.client_side_validation = configuration.client_side_validation

def __enter__(self):
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -351,8 +351,8 @@ def to_debug_report(self):
return "Python SDK Debug Report:\n"\
"OS: {env}\n"\
"Python Version: {pyversion}\n"\
"Version of the API: 2.0.1\n"\
"SDK Package Version: 2.0.1".\
"Version of the API: 2.0.3\n"\
"SDK Package Version: 2.0.3".\
format(env=sys.platform, pyversion=sys.version)

def get_host_settings(self):
Expand Down
2 changes: 1 addition & 1 deletion backend/api/v1beta1/python_http_client/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
from setuptools import setup, find_packages # noqa: H301

NAME = "kfp-server-api"
VERSION = "2.0.1"
VERSION = "2.0.3"
# To install the library, run the following
#
# python setup.py install
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"swagger": "2.0",
"info": {
"title": "Kubeflow Pipelines API",
"version": "2.0.1",
"version": "2.0.3",
"description": "This file contains REST API specification for Kubeflow Pipelines. The file is autogenerated from the swagger definition.",
"contact": {
"name": "google",
Expand Down
4 changes: 2 additions & 2 deletions backend/api/v2beta1/python_http_client/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@ This file contains REST API specification for Kubeflow Pipelines. The file is au

This Python package is automatically generated by the [OpenAPI Generator](https://openapi-generator.tech) project:

- API version: 2.0.1
- Package version: 2.0.1
- API version: 2.0.3
- Package version: 2.0.3
- Build package: org.openapitools.codegen.languages.PythonClientCodegen
For more information, please visit [https://www.google.com](https://www.google.com)

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@

from __future__ import absolute_import

__version__ = "2.0.1"
__version__ = "2.0.3"

# import apis into sdk package
from kfp_server_api.api.auth_service_api import AuthServiceApi
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ def __init__(self, configuration=None, header_name=None, header_value=None,
self.default_headers[header_name] = header_value
self.cookie = cookie
# Set default User-Agent.
self.user_agent = 'OpenAPI-Generator/2.0.1/python'
self.user_agent = 'OpenAPI-Generator/2.0.3/python'
self.client_side_validation = configuration.client_side_validation

def __enter__(self):
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -351,8 +351,8 @@ def to_debug_report(self):
return "Python SDK Debug Report:\n"\
"OS: {env}\n"\
"Python Version: {pyversion}\n"\
"Version of the API: 2.0.1\n"\
"SDK Package Version: 2.0.1".\
"Version of the API: 2.0.3\n"\
"SDK Package Version: 2.0.3".\
format(env=sys.platform, pyversion=sys.version)

def get_host_settings(self):
Expand Down
2 changes: 1 addition & 1 deletion backend/api/v2beta1/python_http_client/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
from setuptools import setup, find_packages # noqa: H301

NAME = "kfp-server-api"
VERSION = "2.0.1"
VERSION = "2.0.3"
# To install the library, run the following
#
# python setup.py install
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"swagger": "2.0",
"info": {
"title": "Kubeflow Pipelines API",
"version": "2.0.1",
"version": "2.0.3",
"description": "This file contains REST API specification for Kubeflow Pipelines. The file is autogenerated from the swagger definition.",
"contact": {
"name": "google",
Expand Down
2 changes: 1 addition & 1 deletion backend/metadata_writer/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# ml-metadata package depends on tensorflow package
FROM python:3.7
FROM python:3.8
COPY backend/metadata_writer/requirements.txt /kfp/metadata_writer/
RUN python3 -m pip install -r /kfp/metadata_writer/requirements.txt

Expand Down
3 changes: 1 addition & 2 deletions backend/metadata_writer/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,5 @@

[pip-tools](https://github.com/jazzband/pip-tools) is used to manage python
dependencies. To update dependencies, edit [requirements.in](requirements.in)
and run `../update_requirements.sh python:3.7 <requirements.in >requirements.txt` to update and pin the transitive
and run `./update_requirements.sh` to update and pin the transitive
dependencies.

2 changes: 1 addition & 1 deletion backend/metadata_writer/requirements.in
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
kubernetes>=8.0.0,<11.0.0
ml-metadata==1.5.0
ml-metadata==1.14.0
lru-dict>=1.1.7,<2.0.0
Loading