Pipelines Versions Save

Machine Learning Pipelines for Kubeflow

2.2.0

1 week ago

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

What's Changed

feat(components): Report TensorBoard metrics for preview.llm.rlhf_pipeline in real time by @copybara-service in https://github.com/kubeflow/pipelines/pull/10595
feat(kubernetes_platform): Update kubernetes_platform go package to include generic ephemerl volume by @abaland in https://github.com/kubeflow/pipelines/pull/10602
fix(metadata envoy): upgrade envoy and config from 1.12 to 1.27 by @freefood89 in https://github.com/kubeflow/pipelines/pull/10589
fix(components): Remove the unused resolve_data_paths from function_based by @copybara-service in https://github.com/kubeflow/pipelines/pull/10606
chore: Add Question issue template by @rimolive in https://github.com/kubeflow/pipelines/pull/10557
feat(kubernetes_platform): Update kubernetes_platform go package to include node affinities and pod (anti)affinities by @cjidboon94 in https://github.com/kubeflow/pipelines/pull/10583
chore(components): Add test machine spec support to preview.llm pipelines by @copybara-service in https://github.com/kubeflow/pipelines/pull/10616
fix(components): Ensure preview.llm.rlhf_pipeline runs if no tensorboard_id is provided by @copybara-service in https://github.com/kubeflow/pipelines/pull/10626
fix(components): Remove the unused functions from function_based by @copybara-service in https://github.com/kubeflow/pipelines/pull/10613
feat(components): Add model name preprocess component; Use publisher model if user uploaded model is non-tuned by @copybara-service in https://github.com/kubeflow/pipelines/pull/10620
feat(components): add task_type as a parameter to rlaif by @copybara-service in https://github.com/kubeflow/pipelines/pull/10607
feat(components): AutoSxS GA pending release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10628
fix(components): Update service account comment by @copybara-service in https://github.com/kubeflow/pipelines/pull/10636
chore(components): GCPC 2.12.0 Release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10635
fix(samples): Fix the loop_output.py example to handle the new parallel loop type requirement by @Tomcli in https://github.com/kubeflow/pipelines/pull/10637
feat(components): Added support for text-bison@002 to preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10641
chore(components): GCPC 2.13.0 Release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10644
fix(components): Make AutoSxS autorater_prompt_parameters required by @copybara-service in https://github.com/kubeflow/pipelines/pull/10621
docs(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10649
chore(components): Update kserve component to v0.12.0 by @Tomcli in https://github.com/kubeflow/pipelines/pull/10652
fix(backend): Update backend common code and integration tests with updated API Service Params by @gmfrasca in https://github.com/kubeflow/pipelines/pull/10640
fix(Backend + SDK): Add missing optional field to SecretAsVolume and … by @revit13 in https://github.com/kubeflow/pipelines/pull/10550
chore(manifests): refactor manifests for kustomize5 compatibility. Part of #10053 by @rawc0der in https://github.com/kubeflow/pipelines/pull/10087
fix(components): Fix model eval import error in text generation/classification eval pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10655
chore(components): GCPC 2.13.1 Release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10666
chore(deps): bump follow-redirects from 1.6.1 to 1.15.6 in /frontend by @dependabot in https://github.com/kubeflow/pipelines/pull/10575
chore(deps): bump pillow from 10.0.1 to 10.3.0 in /backend/src/apiserver/visualization by @dependabot in https://github.com/kubeflow/pipelines/pull/10658
fix(components): Remove the unused generate_default_instruction and resolve_upload_location from function_based by @copybara-service in https://github.com/kubeflow/pipelines/pull/10638
chore(deps): bump express from 4.18.2 to 4.19.2 in /frontend by @dependabot in https://github.com/kubeflow/pipelines/pull/10639
chore: Update argo images to 3.4.16 by @chensun in https://github.com/kubeflow/pipelines/pull/10618
feat(components): Use larger base reward model when tuning text and chat variants of bison@001 with the preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10663
chore(deps): bump follow-redirects from 1.5.10 to 1.15.6 in /frontend/server by @dependabot in https://github.com/kubeflow/pipelines/pull/10574
chore(sample): add note about secret needing to be pre-created by @gregsheremeta in https://github.com/kubeflow/pipelines/pull/10659
Chore(components): Clean up old ibm components by @Tomcli in https://github.com/kubeflow/pipelines/pull/10680
chore(components): Update AutoSxS and RLHF image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10683
feat(sdk+backend): Add support for generic ephemeral volume by @abaland in https://github.com/kubeflow/pipelines/pull/10605
feat(components): Use larger base reward model when tuning t5-xxl with the preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10665
chore(backend): Promote @rimolive as the backend reviewer by @Tomcli in https://github.com/kubeflow/pipelines/pull/10689
chore(sdk): release kfp-kubernetes 1.2.0 by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10692
chore(sdk): make kfp-kubernetes release instructions public by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10693
chore(kfp-kubernetes): change type of affinity weight to int32 by @cjidboon94 in https://github.com/kubeflow/pipelines/pull/10671
fix(components): Fix image version parameter in rl pipelines by @copybara-service in https://github.com/kubeflow/pipelines/pull/10698
docs(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10694
feat(backend): Merge kfp-tekton backend code by @rimolive in https://github.com/kubeflow/pipelines/pull/10678
feat(backend): Upgrade argo to v3.4.16 by @gmfrasca in https://github.com/kubeflow/pipelines/pull/10568
feat(backend): add namespace & prefix scoped credentials to kfp-launcher config for object store paths by @HumairAK in https://github.com/kubeflow/pipelines/pull/10625
chore(deps): bump sqlparse from 0.4.4 to 0.5.0 in /backend/src/apiserver/visualization by @dependabot in https://github.com/kubeflow/pipelines/pull/10700
feat(components): add resolve_reference_model_metadata to rlhf_preprocessor component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10612
feat(components): Move AutoSxS pipeline to v1 directory by @copybara-service in https://github.com/kubeflow/pipelines/pull/10701
feat(components): add resolve_machine_spec and resolve_refined_image_uri to rlhf_preprocessor component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10608
fix(components): remove default prediction column names in evaluation classification component to fix incorrect column names for bigquery data source by @copybara-service in https://github.com/kubeflow/pipelines/pull/10708
feat(components): Introduce placeholders: SERVICE_ACCOUNT_PLACEHOLDER, NETWORK_PLACEHOLDER, PERSISTENT_RESOURCE_ID_PLACEHOLDER and ENCYRPTION_SPEC_KMS_KEY_NAME_PLACEHOLDER. In addition, use PERSISTENT_RESOURCE_ID_PLACEHOLDER as the default value of persistent_resource_id for CustomTrainingJobOp and create_custom_training_job_op_from_component. With this change, custom job created without explicitly setting persistent_resource_id will inherit job level persistent_resource_id, if Persistent Resource is set as job level runtime by @copybara-service in https://github.com/kubeflow/pipelines/pull/10650
chore: Add kfp-tekton integration tests and manifests by @rimolive in https://github.com/kubeflow/pipelines/pull/10702
No public description by @copybara-service in https://github.com/kubeflow/pipelines/pull/10726
chore(components): Drop GCPC Python 3.7 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10730
feat(components): use rlhf_preprocessor to replace the current value_exists call in rlhf by @copybara-service in https://github.com/kubeflow/pipelines/pull/10584
chore(components): Drop support for Python 3.7 in GCPC by @copybara-service in https://github.com/kubeflow/pipelines/pull/10735
feat(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10707
feat(components): Expand regions supported by preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10710
chore(components): Update AutoSxS and RLHF image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10749
chore(components): Change the warning for Python 3.8 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10755
feat(components): migrate function_based resolve_num_microbatches to rlhf_preprocessor component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10604
chore(components): GCPC 2.14.0 Release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10754
feat(components): migrate function_based convert_to_delimited_string to rlhf_preprocessor component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10600
feat(components): Move ModelImportEvaluationOp component to preview namespace by @copybara-service in https://github.com/kubeflow/pipelines/pull/10712
chore(components): Update AutoSxS and RLHF image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10763
feat(components): migrate function_based resolve_regional_endpoint to rlhf_preprocessor component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10603
chore(backend): update kfp launcher and driver images by @chensun in https://github.com/kubeflow/pipelines/pull/10733

New Contributors

@freefood89 made their first contribution in https://github.com/kubeflow/pipelines/pull/10589
@cjidboon94 made their first contribution in https://github.com/kubeflow/pipelines/pull/10583
@gmfrasca made their first contribution in https://github.com/kubeflow/pipelines/pull/10640
@rawc0der made their first contribution in https://github.com/kubeflow/pipelines/pull/10087
@gregsheremeta made their first contribution in https://github.com/kubeflow/pipelines/pull/10659

Full Changelog: https://github.com/kubeflow/pipelines/compare/2.1.0...2.2.0

2.1.0

1 month ago

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

What's Changed

feat(components): Bump image tag used by preview.llm pipelines by @copybara-service in https://github.com/kubeflow/pipelines/pull/10295
feat(components): Add num_microbatches to _implementation.llm training components by @copybara-service in https://github.com/kubeflow/pipelines/pull/10248
chore(sdk): remove cleanup param in local init #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10293
feat(sdk): add local execution skeleton #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10292
fix(components): Use llama-2-7b for the base reward model when tuning llama-2-13 with the preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10249
feat(sdk): add local task dispatcher validation and ExecutorInput construction #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10298
test(sdk): install kfp-pipeline-spec from source in kfp sdk tests by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10300
fix(sdk): use kfp.dsl.types to replace kfp.components.types Fixes #10282 by @hsinhoyeh in https://github.com/kubeflow/pipelines/pull/10283
feat(components): Enable text generation pipeline to generate row based metrics by @copybara-service in https://github.com/kubeflow/pipelines/pull/10296
test(sdk): add placeholder_utils_test.py by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10301
feat(component): Migrate AutoSxS pipeline to preview and move related files to _implementation/llm directory to help Model Eval team use side by side metrics as part of their pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10294
feat(components): Release new LLM Eval image version 0.5 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10313
chore(components): release GCPC 2.7.0 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10303
fix(components): Add autosxs_pipeline to the all variable for the preview/model_evaluation directory by @copybara-service in https://github.com/kubeflow/pipelines/pull/10317
chore(components): release GCPC 2.8.0 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10316
feat(components): Add better docstrings for AutoSxS by @copybara-service in https://github.com/kubeflow/pipelines/pull/10320
test(components): INTERNAL by @copybara-service in https://github.com/kubeflow/pipelines/pull/10314
feat(sdk): add subprocess task handler #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10302
fix(components): Use large_model_reference as model_reference_name when uploading models from preview.llm.rlhf_pipeline instead of hardcoding value as text-bison@001 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10321
test(sdk): add kfp-kubernetes execution tests by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10304
fix(components): Resolve unique model display name on each preview.llm.rlhf_pipeline run instead of reusing cached result by @copybara-service in https://github.com/kubeflow/pipelines/pull/10322
fix(components): Upload the tuned adapter to Model Registry instead of model checkpoint from preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10323
feat(sdk): add local execution output collection #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10325
chore(sdk): fix use of invalid escape sequence in tests by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10310
feat(sdk): add local execution logging #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10326
chore(components): Fix argument description by @copybara-service in https://github.com/kubeflow/pipelines/pull/10327
feat(backend): preserve querystring in pipeline root (fixes #10318) by @TobiasGoerke in https://github.com/kubeflow/pipelines/pull/10319
feat(components): change output format to allow possible post eval by @copybara-service in https://github.com/kubeflow/pipelines/pull/10281
fix(frontend): Add disableParsingRawHTML option for markdown-to-jsx component by @zijianjoy in https://github.com/kubeflow/pipelines/pull/10315
feat(sdk): add DockerRunner #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10328
feat(sdk): add special dsl.OutputPath read logic #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10334
chore(sdk): write local execution logs to stdout #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10330
feat(sdk): support local Container Component execution #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10333
feat(components): Update RLHF env vars to handle empty string by @copybara-service in https://github.com/kubeflow/pipelines/pull/10331
feat(components): Output errors as a separate table from Arbiter by @copybara-service in https://github.com/kubeflow/pipelines/pull/10329
docs(components): Fix AutoSxS docstring formatting by @copybara-service in https://github.com/kubeflow/pipelines/pull/10341
chore(components): add json_escape placeholder util by @copybara-service in https://github.com/kubeflow/pipelines/pull/10351
fix(sdk): fix presentation of strings in local execution #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10353
fix(sdk): remove redundant newline character in local DockerRunner logs #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10354
test(sdk): improve KFP SDK local runner test safety #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10336
feat(backend): Enable logging for KFP components by @DharmitD in https://github.com/kubeflow/pipelines/pull/10288
feat(sdk): remove local execution feature flag #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10355
fix(sdk): permit empty local execution outputs #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10338
feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10348
test(sdk): add test for local execution of None default parameter #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10339
chore(sdk): release KFP SDK 2.5.0 by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10364
chore(sdk): depend on protobuf 4 in kfp-pipeline-spec by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10305
docs(components): Document AutoML Tables util functions by @copybara-service in https://github.com/kubeflow/pipelines/pull/10359
feat(components): Implement the feature store grounding pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10332
feat(components): update eval pipeline documentation to clarify the required pipeline parameters by @copybara-service in https://github.com/kubeflow/pipelines/pull/10366
docs(components): update BigqueryQueryJobOp docs on container args limit by @copybara-service in https://github.com/kubeflow/pipelines/pull/10380
chore(components): GCPC 2.8.1 release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10381
feat(kubernetes_platform): Update kubernetes_platform go package to include pod labels and annotations by @Tomcli in https://github.com/kubeflow/pipelines/pull/10357
chore(sdk): depend on protobuf 4 in kfp and kfp-kubernetes by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10307
feat(components): Implement new output format of inference component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10375
chore(components): rollback GCPC 2.8.1 release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10385
chore(sdk): release KFP SDK 2.6.0 by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10386
chore(components): Add v1.model.ModelGetOp components by @copybara-service in https://github.com/kubeflow/pipelines/pull/10226
chore(sdk): release kfp-kubernetes 1.1.0 by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10387
chore(sdk): update kfp-kubernetes docs versions and release scripts by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10388
docs(sdk): fix kfp-kubernetes docs build error by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10389
chore(components): Sync AutoML components by @copybara-service in https://github.com/kubeflow/pipelines/pull/10372
fix(components): Update base image for KFP lightweight component for VPC SC compliance by @copybara-service in https://github.com/kubeflow/pipelines/pull/10374
chore: Fix metrics visualization v2 sample by @rimolive in https://github.com/kubeflow/pipelines/pull/10399
docs(sdk): add kfp.local to reference docs #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10395
chore(components): migrate GCPC to protobuf 4; require KFP>=2.6.0 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10401
feat(components): Support scheduling and labels in utils.build_payload by @copybara-service in https://github.com/kubeflow/pipelines/pull/10408
chore(components): Sync AutoML components by @copybara-service in https://github.com/kubeflow/pipelines/pull/10415
feat(components): support aliases arg in ModelUploadOp by @copybara-service in https://github.com/kubeflow/pipelines/pull/10404
fix(sdk): fix string quotes by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10413
docs(components): Update AutoSxS pipeline to use "question_answering" as task name instead of "question_answer", where "question_answer" is still supported, but deprecated by @copybara-service in https://github.com/kubeflow/pipelines/pull/10361
fix(components): Update base image for KFP lightweight component for VPC SC compliance by @copybara-service in https://github.com/kubeflow/pipelines/pull/10421
chore(sdk): local task execution refactor + cleanup #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10420
fix(backend): MLMD pagination on getting executions of DAG by @hellojunha in https://github.com/kubeflow/pipelines/pull/10396
fix(components): Only run preview.llm.bulk_inference after tuning third-party models with RLHF by @copybara-service in https://github.com/kubeflow/pipelines/pull/10425
feat(components): Update LLM Evaluation Pipelines to use text-bison@002 model by default by @copybara-service in https://github.com/kubeflow/pipelines/pull/10428
chore(components): GCPC 2.9.0 Release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10432
chore(components): fix GCPC documentation dependencies issue by @copybara-service in https://github.com/kubeflow/pipelines/pull/10433
feat(components): Use a single inference component for AutoSxS by @copybara-service in https://github.com/kubeflow/pipelines/pull/10424
feat(sdk): support local pipeline execution #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10423
fix(components): Write model resource_name to the output of training pipeline remote runner by @copybara-service in https://github.com/kubeflow/pipelines/pull/10426
feat(sdk): support f-strings in local pipeline execution #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10435
feat(sdk): support for local execution of dsl.importer #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10431
fix(components): Update text generation pipeline input description by @copybara-service in https://github.com/kubeflow/pipelines/pull/10434
feat(sdk): support local execution of pipelines in pipelines #localexecution by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10440
fix(backend): correct run field map col names by @HumairAK in https://github.com/kubeflow/pipelines/pull/10430
chore(components): Create module containing AutoSxS and RLHF image tag by @copybara-service in https://github.com/kubeflow/pipelines/pull/10445
fix(components): Remove row_based_metric file path field in Model Evaluation resource's metadata when row based metrics is disabled by @copybara-service in https://github.com/kubeflow/pipelines/pull/10444
feat(sdk): Support dsl.ParallelFor over list of Artifacts by @KevinGrantLee in https://github.com/kubeflow/pipelines/pull/10441
feat(kubernetes_platform): Update kubernetes_platform go package to include ImagePullSecrets by @JosepSampe in https://github.com/kubeflow/pipelines/pull/10410
feat(kubernetes_platform): Update kubernetes_platform go package to include imagePullPolicy. by @revit13 in https://github.com/kubeflow/pipelines/pull/10416
chore(components): update image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10455
fix(sdk): fixes type issues for ParallelFor. Fixes #9366 by @rickyxie0929 in https://github.com/kubeflow/pipelines/pull/10436
feat(components): Add RLAIF pipeline to preview by @copybara-service in https://github.com/kubeflow/pipelines/pull/10377
fix(sdk): fix bug where dsl.OneOf with multiple consumers cannot be compiled by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10452
chore(components): Use new module for looking up ReFINED and AutoSxS image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10454
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support ImagePullSecrets by @JosepSampe in https://github.com/kubeflow/pipelines/pull/10427
Fix(backend): fix timeout for internal server error. Fixes #10267 by @abaland in https://github.com/kubeflow/pipelines/pull/10439
fix(backend): get pipeline by name is broken due to version typo, Fixes #9940 by @cybernagle in https://github.com/kubeflow/pipelines/pull/10268
feat(kubernetes_platform): Update kubernetes_platform go package to include ConfigMaps as volumes and as env variables. by @roytman in https://github.com/kubeflow/pipelines/pull/10400
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support pod labels and annotations by @Tomcli in https://github.com/kubeflow/pipelines/pull/10393
chore(components): Update AutoSxS and RLHF image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10472
feat(kubernetes_platform): Add ActiveDeadlineSeconds(timeout) to the kubernetes platform spec by @Tomcli in https://github.com/kubeflow/pipelines/pull/10464
chore(components): support jinja 3 in GCPC by @copybara-service in https://github.com/kubeflow/pipelines/pull/10479
test(components): Reduce sagemaker component test flakiness by @ananth102 in https://github.com/kubeflow/pipelines/pull/10225
chore(sdk): release KFP SDK 2.7.0 by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10461
fix(components): Use PipelineJob location in AutoSxS components, add init file by @copybara-service in https://github.com/kubeflow/pipelines/pull/10476
feat(kubernetes_platform): Add k8s FieldPath as env to the kubernetes_platform by @Tomcli in https://github.com/kubeflow/pipelines/pull/10485
chore: Add Tomcli as a backend approver by @chensun in https://github.com/kubeflow/pipelines/pull/10490
chore(components): Sync AutoML components by @copybara-service in https://github.com/kubeflow/pipelines/pull/10492
chore(README): Update Kubeflow Pipelines on Tekton blog by @Tomcli in https://github.com/kubeflow/pipelines/pull/10482
chore(components): Rename several _implementation.llm components by @copybara-service in https://github.com/kubeflow/pipelines/pull/10474
feat(kubernetes_platform): Update kubernetes_platform go package to i… by @droctothorpe in https://github.com/kubeflow/pipelines/pull/10442
docs(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10495
chore(components): bump highest support KFP SDK version in GCPC to KFP SDK 2.7.0 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10498
fix(backend): fixes "cannot save parameter" error message. Fixes #9678 by @hbelmiro in https://github.com/kubeflow/pipelines/pull/10459
fix(rlhf): Supporting adapter only output for reward model training by @copybara-service in https://github.com/kubeflow/pipelines/pull/10503
chore(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10511
docs(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10505
feat(components): Added experimental args to batch_prediction_pairwise component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10497
chore(components): release GCPC SDK 2.10.0 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10516
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support tolerations by @droctothorpe in https://github.com/kubeflow/pipelines/pull/10471
feat(components): Add configurable image prefix to llm utility method by @copybara-service in https://github.com/kubeflow/pipelines/pull/10513
chore(components): internal change by @copybara-service in https://github.com/kubeflow/pipelines/pull/10512
feat(components): Add CMEK support to preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10456
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support ConfigMaps as volumes and as env variables by @roytman in https://github.com/kubeflow/pipelines/pull/10483
feat(components): Release Forecasting training pipelines to V1 namespace by @copybara-service in https://github.com/kubeflow/pipelines/pull/10523
fix(sdk): Prevents dsl.ParallelFor over single parameter from compiling. by @KevinGrantLee in https://github.com/kubeflow/pipelines/pull/10494
fix(components): Pass tuned model checkpoint to inference pipeline after RLHF tuning by @copybara-service in https://github.com/kubeflow/pipelines/pull/10518
test: Add ParallelFor compile test over single artifact. by @KevinGrantLee in https://github.com/kubeflow/pipelines/pull/10531
fix(components): rename custom task calibration_score_rubric -> score_rubric by @copybara-service in https://github.com/kubeflow/pipelines/pull/10525
chore(components): Switch default machine type for LLM Text Generation Eval pipeline and components to e2-standard-4 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10522
fix(components): Propagate location to sub-components in AutoSxS by @copybara-service in https://github.com/kubeflow/pipelines/pull/10514
feat(backend + SDK): Add backend and SDK support to use Kubernetes FieldPath as env by @Tomcli in https://github.com/kubeflow/pipelines/pull/10496
chore(components): Change docker image URI used by preview.llm pipelines by @copybara-service in https://github.com/kubeflow/pipelines/pull/10536
fix(docs): Updated legal info due to migration from CLA to DCO by @hbelmiro in https://github.com/kubeflow/pipelines/pull/10501
feat(backend + SDK): Add Backend and SDK support for timeout in pod spec by @Tomcli in https://github.com/kubeflow/pipelines/pull/10481
fix(components): Return None as sliced feature attribution values for the classes which are not predicted in bp outputs by @copybara-service in https://github.com/kubeflow/pipelines/pull/10539
feat(components): Add CMEK validation to preview.llm.infer_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10519
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support ImagePullPolicy by @revit13 in https://github.com/kubeflow/pipelines/pull/10417
docs(components): fix create_custom_training_job_from_component docs rendering by @copybara-service in https://github.com/kubeflow/pipelines/pull/10541
feat(components): Implement the train time evaluation in reward model training. With the train time eval dataset available, the pipeline outputs the accuracy and cross entropy metrics to the log by @copybara-service in https://github.com/kubeflow/pipelines/pull/10369
fix(samples): Updated samples/core to V2 by @PratyushaRavi in https://github.com/kubeflow/pipelines/pull/9879
chore(components): Consolidate validation components in preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10543
feat(backend): Upgrade go version to 1.20 by @Tomcli in https://github.com/kubeflow/pipelines/pull/10502
docs(components): Modify the GetModel documentation by @copybara-service in https://github.com/kubeflow/pipelines/pull/10552
chore(components): Update AutoSxS and RLHF image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10551
fix(backend): Fixes response status of http error code when uploading duplicate pipeline [Fixes #10311] by @champon1020 in https://github.com/kubeflow/pipelines/pull/10546
chore: Change stalebot rules by @rimolive in https://github.com/kubeflow/pipelines/pull/10547
fix(kubernetes_platform): Add optional field to SecretAsVolume and ConfigMapAsVolume. Fixes #10548 by @revit13 in https://github.com/kubeflow/pipelines/pull/10549
feat(components): Add CMEK support to AutoSxS pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10555
feat(components): Update _LLM_EVAL_VERSION to v0.6 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10565
chore(components): update container image of endpoint batch predict component for vulnerability patch by @copybara-service in https://github.com/kubeflow/pipelines/pull/10566
chore(backend): Update kfp driver and launcher images by @chensun in https://github.com/kubeflow/pipelines/pull/10561
fix(components): Add relevant component and pipeline inputs/outputs to support creating ModelEvaluations as part of the AutoSxS Metrics component by @copybara-service in https://github.com/kubeflow/pipelines/pull/10554
feat(components): Release Forecasting training pipelines to V1 namespace by @copybara-service in https://github.com/kubeflow/pipelines/pull/10569
feat(components): Add location validation to preview.llm.rlhf_pipeline by @copybara-service in https://github.com/kubeflow/pipelines/pull/10542
chore(components): Testing fix by @copybara-service in https://github.com/kubeflow/pipelines/pull/10576
fix(samples): Update resource_spec, retry, secret samples to v2 pipelines by @junggil in https://github.com/kubeflow/pipelines/pull/9876
fix: Modified the comment/text for pipeline_version_id by @amadhusu in https://github.com/kubeflow/pipelines/pull/10581
chore(components): Update AutoSxS and RLHF image tags by @copybara-service in https://github.com/kubeflow/pipelines/pull/10582
chore: Update api-generator to use golang 1.20 by @chensun in https://github.com/kubeflow/pipelines/pull/10580
fix(docs): make full version dropdown show on all KFP SDK docs versions by @connor-mccarthy in https://github.com/kubeflow/pipelines/pull/10577
feat(components): Implement new component to preprocess and validate inputs for rlhf by @copybara-service in https://github.com/kubeflow/pipelines/pull/10480
chore(components): GCPC 2.11.0 Release by @copybara-service in https://github.com/kubeflow/pipelines/pull/10573
fix(components): Fix missing pipeline parameters by @copybara-service in https://github.com/kubeflow/pipelines/pull/10587
chore: Update release image by @chensun in https://github.com/kubeflow/pipelines/pull/10599
fix: Modified the swagger json files according to the modified proto files. by @amadhusu in https://github.com/kubeflow/pipelines/pull/10591
feat(components): Copy text generation eval and text classification evak pipelines from preview to v1 by @copybara-service in https://github.com/kubeflow/pipelines/pull/10586
docs(components): internal by @copybara-service in https://github.com/kubeflow/pipelines/pull/10556

New Contributors

@TobiasGoerke made their first contribution in https://github.com/kubeflow/pipelines/pull/10319
@rimolive made their first contribution in https://github.com/kubeflow/pipelines/pull/10399
@hellojunha made their first contribution in https://github.com/kubeflow/pipelines/pull/10396
@HumairAK made their first contribution in https://github.com/kubeflow/pipelines/pull/10430
@KevinGrantLee made their first contribution in https://github.com/kubeflow/pipelines/pull/10441
@JosepSampe made their first contribution in https://github.com/kubeflow/pipelines/pull/10410
@revit13 made their first contribution in https://github.com/kubeflow/pipelines/pull/10416
@cybernagle made their first contribution in https://github.com/kubeflow/pipelines/pull/10268
@roytman made their first contribution in https://github.com/kubeflow/pipelines/pull/10400
@hbelmiro made their first contribution in https://github.com/kubeflow/pipelines/pull/10459
@PratyushaRavi made their first contribution in https://github.com/kubeflow/pipelines/pull/9879
@champon1020 made their first contribution in https://github.com/kubeflow/pipelines/pull/10546
@amadhusu made their first contribution in https://github.com/kubeflow/pipelines/pull/10581

Full Changelog: https://github.com/kubeflow/pipelines/compare/2.0.5...2.1.0

sdk-2.7.0

2 months ago

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.7.0

For changelog, see release notes.

sdk-2.6.0

4 months ago

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.6.0

For changelog, see release notes.

sdk-2.5.0

4 months ago

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.5.0

For changelog, see release notes.

2.0.5

5 months ago

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

2.0.4

5 months ago

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

sdk-2.4.0

6 months ago

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.4.0

For changelog, see release notes.

2.0.3

6 months ago

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

2.0.2

7 months ago

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log