Kfserving Versions Save

Standardized Serverless ML Inference Platform on Kubernetes

v0.12.1

3 weeks ago

What's Changed

[release-0.12] Update fastapi to 0.109.1 and Support ray 2.10 by @sivanantha321 in https://github.com/kserve/kserve/pull/3609
[release-0.12] Pydantic 2 support by @cmaddalozzo in https://github.com/kserve/kserve/pull/3614
[release-0.12] Make the modelcar injection idempotent by @sivanantha321 in https://github.com/kserve/kserve/pull/3612
Prepare for release 0.12.1 by @sivanantha321 in https://github.com/kserve/kserve/pull/3610
release-0.12 pin back ray to 2.10 by @yuzisun in https://github.com/kserve/kserve/pull/3616
[release-0.12] Fix docker build failure for ARM64 by @sivanantha321 in https://github.com/kserve/kserve/pull/3627

Full Changelog: https://github.com/kserve/kserve/compare/v0.12.0...v0.12.1

v0.12.0

2 months ago

:rainbow: What's New?

Core Inference & Serving Runtimes

Implement HuggingFace model server by @yuzisun in https://github.com/kserve/kserve/pull/3334
eat: Add HuggingFace runtime out-of-the-box support by @terrytangyuan in https://github.com/kserve/kserve/pull/3395
Implement support for vllm as alternative backend by @gavrishp in https://github.com/kserve/kserve/pull/3415
Torchserve grpc v2 by @andyi2it in https://github.com/kserve/kserve/pull/3247
feat: CA bundle mount options for storage initializer by @Jooho in https://github.com/kserve/kserve/pull/3250
Add support for modelcars by @rhuss in https://github.com/kserve/kserve/pull/3110
Add compatibility for Istio CNI plugin by @israel-hdez in https://github.com/kserve/kserve/pull/3316
feat: Allow to disable ingress creation for raw deployment mode by @terrytangyuan in https://github.com/kserve/kserve/pull/3436

Advanced Inference

RawDeployment support for Inference Graph by @bmopuri in https://github.com/kserve/kserve/pull/3199, @bmopuri in https://github.com/kserve/kserve/pull/3194
Added custom request timeout for inferencegraph. by @andyi2it in https://github.com/kserve/kserve/pull/3173
Add regex support for propagating IG headers by @sivanantha321 in https://github.com/kserve/kserve/pull/3178

KServe Python SDK, Storage

Unpack archive files for hdfs by @sivanantha321 in https://github.com/kserve/kserve/pull/3093
feat: Support S3 transfer acceleration by @terrytangyuan in https://github.com/kserve/kserve/pull/3305

⚠️ What's Changed

Change the default value for enableDirectPvcVolumeMount to true by @Jooho in https://github.com/kserve/kserve/pull/3371
Add model arguments to API and update BERT inference example by @yuzisun in https://github.com/kserve/kserve/pull/3332

--model_name, --predictor_host, --predictor_use_ssl, --predictor_request_timeout_seconds are added to the kserve model server and no longer need to be defined in the custom predictor or transformer. --protocol is deprecated and superceded by --predictor_protocol. More details can be found on API reference doc.

🐛 What's Fixed

Removing update op from pod-mutator webhook by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3163
Fix quick install script by @dtrifiro in https://github.com/kserve/kserve/pull/3164
Fix self-signed-ca installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3165
Add S3_VERIFY_SSL to storage.py for S3 by @Jooho in https://github.com/kserve/kserve/pull/3172
Fix runtime not found for triton due to wrong default protocolVersion by @sivanantha321 in https://github.com/kserve/kserve/pull/3177
Make ModelServer to stop correctly when using more than 1 worker by @andyi2it in https://github.com/kserve/kserve/pull/3174
Fix serving runtime webhook cert namespace for kubeflow installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3188
Fix knative config-defaults values overrided by kserve by @sivanantha321 in https://github.com/kserve/kserve/pull/3130
Fix qpext metrics port by @yuzisun in https://github.com/kserve/kserve/pull/3209
Added async with postprocess method. by @andyi2it in https://github.com/kserve/kserve/pull/3204
Fix lightgbm model input conversion when input is list of lists by @sivanantha321 in https://github.com/kserve/kserve/pull/3226
Validation added for ensuring same model format has same priority for runtime by @andyi2it in https://github.com/kserve/kserve/pull/3181
Fix: Unexpected Panic in Inference graph when it fails to create http request by @HAO2167 in https://github.com/kserve/kserve/pull/3079
Support verify variable with storage-config json style (fix-3263) by @Jooho in https://github.com/kserve/kserve/pull/3267
s3 storage initializer: only set environment variables if variables are set in storage secret json by @dtrifiro in https://github.com/kserve/kserve/pull/3259
Fix tensorflow e2e test fails due to OOM error by @sivanantha321 in https://github.com/kserve/kserve/pull/3293
fix: Properly handle the creation and closure of success file in DownloadModel() by @terrytangyuan in https://github.com/kserve/kserve/pull/3295
fix: Surface errors when writing graphHandler response by @terrytangyuan in https://github.com/kserve/kserve/pull/3308
Fix qpext hangs during shutdown by @sivanantha321 in https://github.com/kserve/kserve/pull/3268
fix: Check if HPA has the same scaleTargetRef and behavior by @terrytangyuan in https://github.com/kserve/kserve/pull/3294
Updated quick_install script to temporarily fix 0.11.2 release install by @andyi2it in https://github.com/kserve/kserve/pull/3311
image_patch_dev.sh: set pipefail by @dtrifiro in https://github.com/kserve/kserve/pull/3274
Move pmml worker validation to runtime by @sivanantha321 in https://github.com/kserve/kserve/pull/3182
Introduce retry on resource conflict by @sivanantha321 in https://github.com/kserve/kserve/pull/3240
Fix inference request fails when sending with less number of features than the total model features on lightgbm by @sivanantha321 in https://github.com/kserve/kserve/pull/3313
Fix raw deployment service points to predictor container port instead of transformer container port in transformer collocation by @sivanantha321 in https://github.com/kserve/kserve/pull/3318
Restrict storage uri to predictor only in collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/3280
feat: Expose defaults for several batcher handler parameters by @terrytangyuan in https://github.com/kserve/kserve/pull/3301
fix: Properly close resources and handle errors in agent and storage. Fixes #3323 by @terrytangyuan in https://github.com/kserve/kserve/pull/3321
Handles s3 download for object name starts with folder name. by @andyi2it in https://github.com/kserve/kserve/pull/3205
chore: Remove unused timeout annotation and flag in batcher by @terrytangyuan in https://github.com/kserve/kserve/pull/3341
Pass missing infer parameters during conversion by @sivanantha321 in https://github.com/kserve/kserve/pull/3368
Add exception handler for model server and Add ability to specify custom handler by @sivanantha321 in https://github.com/kserve/kserve/pull/3405
fix: Add missing volume mount to transformer container when using modelcars by @rhuss in https://github.com/kserve/kserve/pull/3384
fix: Add 'model_version' to InferResponse in python library by @ajstewart in https://github.com/kserve/kserve/pull/3466
Fix v2 model ready url in kserve client by @sivanantha321 in https://github.com/kserve/kserve/pull/3403
Fix parameters value type conversion by pydantic by @sivanantha321 in https://github.com/kserve/kserve/pull/3430
Fix Raw Logger E2E by @israel-hdez in https://github.com/kserve/kserve/pull/3434
Expose qpext aggregate metrics port on container by @sivanantha321 in https://github.com/kserve/kserve/pull/3291
Fix dup metrics aggr port by @yuzisun in https://github.com/kserve/kserve/pull/3447
fix: HuggingFace predictor should not be recognized as multi-model server by @terrytangyuan in https://github.com/kserve/kserve/pull/3449
Fix: bugs for huggingface runtime template by @yuzisun in https://github.com/kserve/kserve/pull/3448
Fix: Add padding and truncation in huggingface tokenizer by @kevinmingtarja in https://github.com/kserve/kserve/pull/3450
Fix: vllm backend does not work with model_dir for huggingface runtime by @yuzisun in https://github.com/kserve/kserve/pull/3456
Fix azure workload identity federation by excluding azure client secret by @robbertvdg in https://github.com/kserve/kserve/pull/3390
Change certificate to ca_bundle in json style of s3 storageSecret by @Jooho in https://github.com/kserve/kserve/pull/3463

⬆️ Version Upgrade

Upgrade istio Api and migrate to v1beta1 Api version by @sivanantha321 in https://github.com/kserve/kserve/pull/3150
Bump torchserve version to 0.9.0 by @gavrishp in https://github.com/kserve/kserve/pull/3217
Allow ray >=2.7,<3 by @ddelange in https://github.com/kserve/kserve/pull/3075
Bump istio version to 1.19.4 by @sivanantha321 in https://github.com/kserve/kserve/pull/3258
Updated ray to 2.8.0 and removed detached flag to avoid deprecation error in future by @andyi2it in https://github.com/kserve/kserve/pull/3272
chore: Upgrade to XGBoost v2.0.2. Fixes #3310 by @terrytangyuan in https://github.com/kserve/kserve/pull/3309
chore: Upgrade Go to v1.21 by @terrytangyuan in https://github.com/kserve/kserve/pull/3296
Added 3.11 support for paddle in workflow. by @andyi2it in https://github.com/kserve/kserve/pull/3246
Upgraded poetry version to 1.7.1 by @andyi2it in https://github.com/kserve/kserve/pull/3271
Upgrade cloudevent to v2 by @homily707 in https://github.com/kserve/kserve/pull/3255
Update knative-serving by @spolti in https://github.com/kserve/kserve/pull/3362
Update google-cloud-storage dependecy to >=2.3.0,<3.0.0 and ray dependency to >=2.8.1, <3.0.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/3389

🔨 Project SDLC

chore: Add design doc template links to feature request template by @ckadner in https://github.com/kserve/kserve/pull/3155
Make storage initializer image configurable by @yuzisun in https://github.com/kserve/kserve/pull/3145
Increase pytest workers for kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3151
Restrict workflow concurrency by @vignesh-murugani2i in https://github.com/kserve/kserve/pull/3167
Generate client-go for StorageContainer CR by @sivanantha321 in https://github.com/kserve/kserve/pull/3152
Refractor v1 vs. v2 endpoint unit tests in kserve/test/test_server.py… by @guohaoyu110 in https://github.com/kserve/kserve/pull/3158
Verify codegen in CI by @sivanantha321 in https://github.com/kserve/kserve/pull/3189
Remove the redundant python lint check in CI environment by @nilakshi104 in https://github.com/kserve/kserve/pull/3184
Add default clusterstoragecontainer cr into resources by @homily707 in https://github.com/kserve/kserve/pull/3219
Add health check for controller manager by @sivanantha321 in https://github.com/kserve/kserve/pull/3289
chore: Add new PR reviewers and approvers by @ckadner in https://github.com/kserve/kserve/pull/3213
Updated Kserve version file path in pyproject.toml. by @andyi2it in https://github.com/kserve/kserve/pull/3225
Add a CI_USE_ISVC_HOST for testing with the ISVC hostname by @israel-hdez in https://github.com/kserve/kserve/pull/3324
ci: publish helm chart to ghcr by @davidspek in https://github.com/kserve/kserve/pull/3319
build: Switch to use kustomize in kubectl to simplify build process. Fixes #3314 by @terrytangyuan in https://github.com/kserve/kserve/pull/3315
chore: Update generated APIs and check generated manifests by @terrytangyuan in https://github.com/kserve/kserve/pull/3335
ci: Automate release process by @terrytangyuan in https://github.com/kserve/kserve/pull/3345
chore: Bump versions to prepare v0.12.0-rc1 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3352
Change version for helm charts in README by @gawsoftpl in https://github.com/kserve/kserve/pull/3353
Modified script for include all kserve poetry projects. by @andyi2it in https://github.com/kserve/kserve/pull/3350
align cloudevents/sdk-go dependency by @spolti in https://github.com/kserve/kserve/pull/3387
chore: Remove unused version update script for Python SDK by @terrytangyuan in https://github.com/kserve/kserve/pull/3394
Adding script for setting up Telepresence for local development by @rhuss in https://github.com/kserve/kserve/pull/3104
Fix no space left error in CI environment by @sivanantha321 in https://github.com/kserve/kserve/pull/3411
Streamline python release update script to scan multi-depth by @andyi2it in https://github.com/kserve/kserve/pull/3351
Fix no space left error on huggingface docker publisher workflow by @sivanantha321 in https://github.com/kserve/kserve/pull/3431
Reduce E2Es dependency on CI environment by @israel-hdez in https://github.com/kserve/kserve/pull/3435
build: Skip already downloaded Istio in quick_install.sh by @terrytangyuan in https://github.com/kserve/kserve/pull/3364
Publish v0.12.0 release by @sivanantha321 in https://github.com/kserve/kserve/pull/3458

CVE patches

Add go security scan for PRs and set it up to run on a regular schedule by @sivanantha321 in https://github.com/kserve/kserve/pull/3170
CVE-2023-44487 - qpext by @spolti in https://github.com/kserve/kserve/pull/3203
CVE-2023-44487 by @spolti in https://github.com/kserve/kserve/pull/3202
Sanitize a command line argument in agent by @israel-hdez in https://github.com/kserve/kserve/pull/3245
Remove deprecated protobuf packages by @sivanantha321 in https://github.com/kserve/kserve/pull/3328
fixes critical vulnerabilities on ray by @spolti in https://github.com/kserve/kserve/pull/3285
Fixes CVE-2023-48795 by @spolti in https://github.com/kserve/kserve/pull/3354
Fix Stack-based Buffer Overflow on protobuf by @spolti in https://github.com/kserve/kserve/pull/3358
Fixes vulnerabilities on the otelhttp dependency by @spolti in https://github.com/kserve/kserve/pull/3361
Go vulnerability fixes by @sivanantha321 in https://github.com/kserve/kserve/pull/3442
Python vulnerability fixes by @sivanantha321 in https://github.com/kserve/kserve/pull/3441

📝 Documentation Update

docs: fix some typos by @daixiang0 in https://github.com/kserve/kserve/pull/3214
Update qpext docs on image patch by @sivanantha321 in https://github.com/kserve/kserve/pull/3266
Update Istio-Dex docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3260
docs: Add link to OpenShift Container Platform instructions by @terrytangyuan in https://github.com/kserve/kserve/pull/3322
docs: Corrections and edits on release process document by @terrytangyuan in https://github.com/kserve/kserve/pull/3326
Update python model serving runtime API docstring by @yuzisun in https://github.com/kserve/kserve/pull/3338
feat: Automatically generate Helm Chart docs. Fixes #3356 by @terrytangyuan in https://github.com/kserve/kserve/pull/3363
docs: Update link to Slack instructions by @terrytangyuan in https://github.com/kserve/kserve/pull/3421

New Contributors

@dtrifiro made their first contribution in https://github.com/kserve/kserve/pull/3164
@Jooho made their first contribution in https://github.com/kserve/kserve/pull/3172
@vignesh-murugani2i made their first contribution in https://github.com/kserve/kserve/pull/3167
@guohaoyu110 made their first contribution in https://github.com/kserve/kserve/pull/3158
@bmopuri made their first contribution in https://github.com/kserve/kserve/pull/3194
@daixiang0 made their first contribution in https://github.com/kserve/kserve/pull/3214
@nilakshi104 made their first contribution in https://github.com/kserve/kserve/pull/3184
@gavrishp made their first contribution in https://github.com/kserve/kserve/pull/3217
@spolti made their first contribution in https://github.com/kserve/kserve/pull/3203
@HAO2167 made their first contribution in https://github.com/kserve/kserve/pull/3079
@homily707 made their first contribution in https://github.com/kserve/kserve/pull/3219
@rhuss made their first contribution in https://github.com/kserve/kserve/pull/3110
@gawsoftpl made their first contribution in https://github.com/kserve/kserve/pull/3353
@kevinmingtarja made their first contribution in https://github.com/kserve/kserve/pull/3450
@robbertvdg made their first contribution in https://github.com/kserve/kserve/pull/3390
@ajstewart made their first contribution in https://github.com/kserve/kserve/pull/3466

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.1...v0.12.0

v0.12.0-rc1

3 months ago

What's Changed

docs: Corrections and edits on release process document by @terrytangyuan in https://github.com/kserve/kserve/pull/3326
build: Switch to use kustomize in kubectl to simplify build process. Fixes #3314 by @terrytangyuan in https://github.com/kserve/kserve/pull/3315
feat: Expose defaults for several batcher handler parameters by @terrytangyuan in https://github.com/kserve/kserve/pull/3301
fix: Properly close resources and handle errors in agent and storage. Fixes #3323 by @terrytangyuan in https://github.com/kserve/kserve/pull/3321
Add model arguments to API and update BERT inference example by @yuzisun in https://github.com/kserve/kserve/pull/3332
chore: Update generated APIs and check generated manifests by @terrytangyuan in https://github.com/kserve/kserve/pull/3335
Update python model serving runtime API docstring by @yuzisun in https://github.com/kserve/kserve/pull/3338
Handles s3 download for object name starts with folder name. by @andyi2it in https://github.com/kserve/kserve/pull/3205
chore: Remove unused timeout annotation and flag in batcher by @terrytangyuan in https://github.com/kserve/kserve/pull/3341
ci: Automate release process by @terrytangyuan in https://github.com/kserve/kserve/pull/3345
fixes critical vulnerabilities on ray by @spolti in https://github.com/kserve/kserve/pull/3285
chore: Bump versions to prepare v0.12.0-rc1 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3352
Change version for helm charts in README by @gawsoftpl in https://github.com/kserve/kserve/pull/3353
Fixes CVE-2023-48795 by @spolti in https://github.com/kserve/kserve/pull/3354
Fix Stack-based Buffer Overflow on protobuf by @spolti in https://github.com/kserve/kserve/pull/3358
Update knative-serving by @spolti in https://github.com/kserve/kserve/pull/3362
Fixes vulnerabilities on the otelhttp dependency by @spolti in https://github.com/kserve/kserve/pull/3361
Change the default value for enableDirectPvcVolumeMount to true by @Jooho in https://github.com/kserve/kserve/pull/3371
feat: Automatically generate Helm Chart docs. Fixes #3356 by @terrytangyuan in https://github.com/kserve/kserve/pull/3363
Modified script for include all kserve poetry projects. by @andyi2it in https://github.com/kserve/kserve/pull/3350
RawDeployment support for Inference Graph by @bmopuri in https://github.com/kserve/kserve/pull/3199
Add compatibility for Istio CNI plugin by @israel-hdez in https://github.com/kserve/kserve/pull/3316
Pass missing infer parameters during conversion by @sivanantha321 in https://github.com/kserve/kserve/pull/3368
feat: Support S3 transfer acceleration by @terrytangyuan in https://github.com/kserve/kserve/pull/3305
Implement HuggingFace model server by @yuzisun in https://github.com/kserve/kserve/pull/3334
fix: Add missing volume mount to transformer container when using modelcars by @rhuss in https://github.com/kserve/kserve/pull/3384
align cloudevents/sdk-go dependency by @spolti in https://github.com/kserve/kserve/pull/3387

New Contributors

@gawsoftpl made their first contribution in https://github.com/kserve/kserve/pull/3353

Full Changelog: https://github.com/kserve/kserve/compare/v0.12.0-rc0...v0.12.0-rc1

v0.12.0-rc0

4 months ago

What's Changed

Make storage initializer image configurable by @yuzisun in https://github.com/kserve/kserve/pull/3145
chore: Add design doc template links to feature request template by @ckadner in https://github.com/kserve/kserve/pull/3155
Increase pytest workers for kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3151
Upgrade istio Api and migrate to v1beta1 Api version by @sivanantha321 in https://github.com/kserve/kserve/pull/3150
Unpack archive files for hdfs by @sivanantha321 in https://github.com/kserve/kserve/pull/3093
Removing update op from pod-mutator webhook by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3163
Fix quick install script by @dtrifiro in https://github.com/kserve/kserve/pull/3164
Fix self-signed-ca installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3165
Generate client-go for StorageContainer CR by @sivanantha321 in https://github.com/kserve/kserve/pull/3152
Add S3_VERIFY_SSL to storage.py for S3 by @Jooho in https://github.com/kserve/kserve/pull/3172
Allow disabling creation of the HPA in raw deployment mode by @andyi2it in https://github.com/kserve/kserve/pull/3086
Restrict workflow concurrency by @vignesh-murugani2i in https://github.com/kserve/kserve/pull/3167
Refractor v1 vs. v2 endpoint unit tests in kserve/test/test_server.py… by @guohaoyu110 in https://github.com/kserve/kserve/pull/3158
Fix runtime not found for triton due to wrong default protocolVersion by @sivanantha321 in https://github.com/kserve/kserve/pull/3177
Make ModelServer to stop correctly when using more than 1 worker by @andyi2it in https://github.com/kserve/kserve/pull/3174
Added custom request timeout for inferencegraph. by @andyi2it in https://github.com/kserve/kserve/pull/3173
Fix serving runtime webhook cert namespace for kubeflow installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3188
Add go security scan for PRs and set it up to run on a regular schedule by @sivanantha321 in https://github.com/kserve/kserve/pull/3170
Verify codegen in CI by @sivanantha321 in https://github.com/kserve/kserve/pull/3189
Fix knative config-defaults values overrided by kserve by @sivanantha321 in https://github.com/kserve/kserve/pull/3130
Fix qpext metrics port by @yuzisun in https://github.com/kserve/kserve/pull/3209
docs: fix some typos by @daixiang0 in https://github.com/kserve/kserve/pull/3214
chore: Add new PR reviewers and approvers by @ckadner in https://github.com/kserve/kserve/pull/3213
Added async with postprocess method. by @andyi2it in https://github.com/kserve/kserve/pull/3204
Remove the redundant python lint check in CI environment by @nilakshi104 in https://github.com/kserve/kserve/pull/3184
Move pmml worker validation to runtime by @sivanantha321 in https://github.com/kserve/kserve/pull/3182
Bump torchserve version to 0.9.0 by @gavrishp in https://github.com/kserve/kserve/pull/3217
CVE-2023-44487 - qpext by @spolti in https://github.com/kserve/kserve/pull/3203
Allow ray >=2.7,<3 by @ddelange in https://github.com/kserve/kserve/pull/3075
Fix lightgbm model input conversion when input is list of lists by @sivanantha321 in https://github.com/kserve/kserve/pull/3226
CVE-2023-44487 by @spolti in https://github.com/kserve/kserve/pull/3202
Sanitize a command line argument in agent by @israel-hdez in https://github.com/kserve/kserve/pull/3245
Validation added for ensuring same model format has same priority for runtime by @andyi2it in https://github.com/kserve/kserve/pull/3181
Fix: Unexpected Panic in Inference graph when it fails to create http request by @HAO2167 in https://github.com/kserve/kserve/pull/3079
Add default clusterstoragecontainer cr into resources by @homily707 in https://github.com/kserve/kserve/pull/3219
Support verify variable with storage-config json style (fix-3263) by @Jooho in https://github.com/kserve/kserve/pull/3267
Update qpext docs on image patch by @sivanantha321 in https://github.com/kserve/kserve/pull/3266
Added 3.11 support for paddle in workflow. by @andyi2it in https://github.com/kserve/kserve/pull/3246
Torchserve grpc v2 by @andyi2it in https://github.com/kserve/kserve/pull/3247
Bump istio version to 1.19.4 by @sivanantha321 in https://github.com/kserve/kserve/pull/3258
image_patch_dev.sh: set pipefail by @dtrifiro in https://github.com/kserve/kserve/pull/3274
s3 storage initializer: only set environment variables if variables are set in storage secret json by @dtrifiro in https://github.com/kserve/kserve/pull/3259
feat: CA bundle mount options for storage initializer by @Jooho in https://github.com/kserve/kserve/pull/3250
Fix tensorflow e2e test fails due to OOM error by @sivanantha321 in https://github.com/kserve/kserve/pull/3293
Update Istio-Dex docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3260
chore: Upgrade Go to v1.21 by @terrytangyuan in https://github.com/kserve/kserve/pull/3296
fix: Properly handle the creation and closure of success file in DownloadModel() by @terrytangyuan in https://github.com/kserve/kserve/pull/3295
Updated ray to 2.8.0 and removed detached flag to avoid deprecation error in future by @andyi2it in https://github.com/kserve/kserve/pull/3272
fix: Surface errors when writing graphHandler response by @terrytangyuan in https://github.com/kserve/kserve/pull/3308
Fix qpext hangs during shutdown by @sivanantha321 in https://github.com/kserve/kserve/pull/3268
chore: Upgrade to XGBoost v2.0.2. Fixes #3310 by @terrytangyuan in https://github.com/kserve/kserve/pull/3309
fix: Check if HPA has the same scaleTargetRef and behavior by @terrytangyuan in https://github.com/kserve/kserve/pull/3294
Updated quick_install script to temporarily fix 0.11.2 release install by @andyi2it in https://github.com/kserve/kserve/pull/3311
Remove deprecated protobuf packages by @sivanantha321 in https://github.com/kserve/kserve/pull/3328
Add health check for controller manager by @sivanantha321 in https://github.com/kserve/kserve/pull/3289
Introduce retry on resource conflict by @sivanantha321 in https://github.com/kserve/kserve/pull/3240
Updated Kserve version file path in pyproject.toml. by @andyi2it in https://github.com/kserve/kserve/pull/3225
docs: Add link to OpenShift Container Platform instructions by @terrytangyuan in https://github.com/kserve/kserve/pull/3322
Fix inference request fails when sending with less number of features than the total model features on lightgbm by @sivanantha321 in https://github.com/kserve/kserve/pull/3313
Add a CI_USE_ISVC_HOST for testing with the ISVC hostname by @israel-hdez in https://github.com/kserve/kserve/pull/3324
Upgraded poetry version to 1.7.1 by @andyi2it in https://github.com/kserve/kserve/pull/3271
ci: publish helm chart to ghcr by @davidspek in https://github.com/kserve/kserve/pull/3319
Fix raw deployment service points to predictor container port instead of transformer container port in transformer collocation by @sivanantha321 in https://github.com/kserve/kserve/pull/3318
Upgrade cloudevent to v2 by @homily707 in https://github.com/kserve/kserve/pull/3255
Restrict storage uri to predictor only in collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/3280
Add support for modelcars by @rhuss in https://github.com/kserve/kserve/pull/3110
Add regex support for propagating IG headers by @sivanantha321 in https://github.com/kserve/kserve/pull/3178
chore: Prepare v0.12.0-rc0 release by @terrytangyuan in https://github.com/kserve/kserve/pull/3325

New Contributors

@dtrifiro made their first contribution in https://github.com/kserve/kserve/pull/3164
@Jooho made their first contribution in https://github.com/kserve/kserve/pull/3172
@vignesh-murugani2i made their first contribution in https://github.com/kserve/kserve/pull/3167
@guohaoyu110 made their first contribution in https://github.com/kserve/kserve/pull/3158
@bmopuri made their first contribution in https://github.com/kserve/kserve/pull/3194
@daixiang0 made their first contribution in https://github.com/kserve/kserve/pull/3214
@nilakshi104 made their first contribution in https://github.com/kserve/kserve/pull/3184
@gavrishp made their first contribution in https://github.com/kserve/kserve/pull/3217
@spolti made their first contribution in https://github.com/kserve/kserve/pull/3203
@HAO2167 made their first contribution in https://github.com/kserve/kserve/pull/3079
@homily707 made their first contribution in https://github.com/kserve/kserve/pull/3219
@rhuss made their first contribution in https://github.com/kserve/kserve/pull/3110

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.1...v0.12.0-rc0

v0.11.2

6 months ago

What's Changed

Fix serving runtime webhook cert namespace for kubeflow installation by @sivanantha321 in https://github.com/kserve/kserve/pull/3190
[release-0.11] Fix qpext metrics port (#3209) by @houshengbo in https://github.com/kserve/kserve/pull/3210
[release-0.11] Fix lightgbm model input conversion when input is list of lists by @sivanantha321 in https://github.com/kserve/kserve/pull/3229
[release-0.11]Fix runtime not found for triton due to wrong default protocolVersion by @sivanantha321 in https://github.com/kserve/kserve/pull/3232
[release-0.11]Fix mlserver runtime priority for sklearn by @sivanantha321 in https://github.com/kserve/kserve/pull/3233
[release-0.11] Cherry-picks related to CVE-2023-44487 by @israel-hdez in https://github.com/kserve/kserve/pull/3242
Version bump to 0.11.2 by @israel-hdez in https://github.com/kserve/kserve/pull/3244

New Contributors

@houshengbo made their first contribution in https://github.com/kserve/kserve/pull/3210

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.1...v0.11.2

v0.11.1

7 months ago

What's Changed

[docker] reduction in the number of layers for controller image by @alekseyolg in https://github.com/kserve/kserve/pull/3070
document status conditions for RoutesReady and LatestDeploymentReady by @tessapham in https://github.com/kserve/kserve/pull/3069
Update indirect dependency golang.org/x/net/html by @israel-hdez in https://github.com/kserve/kserve/pull/3072
Fix kubeflow overlay kustomization by @sivanantha321 in https://github.com/kserve/kserve/pull/3083
Check sys platform before using SIGQUIT - fix windows development by @andyi2it in https://github.com/kserve/kserve/pull/3089
Use knative operator for installing knative in e2e tests by @sivanantha321 in https://github.com/kserve/kserve/pull/2984
Upgrade k8s to 1.27, istio 1.8 in test environment by @sivanantha321 in https://github.com/kserve/kserve/pull/3077
Introduce Storage container CRD by @greenmoon55 in https://github.com/kserve/kserve/pull/3060
List Models v2 REST API by @jvujjini in https://github.com/kserve/kserve/pull/2963
Introduce Priority field in ServingRuntime by @sivanantha321 in https://github.com/kserve/kserve/pull/3031
Storage initializer fix so that it downloads only specific file when provided uri is not a folder by @andyi2it in https://github.com/kserve/kserve/pull/3088
Inference Graph error response handling by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3039
Add doc.go for v1alpha1 API version by @sivanantha321 in https://github.com/kserve/kserve/pull/3118
Fixed torchserve e2e test. by @andyi2it in https://github.com/kserve/kserve/pull/3106
Fix: error response handling for splitter and switch nodes by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3116
Fix validation for custom storageUri by @greenmoon55 in https://github.com/kserve/kserve/pull/3134
Bumping version for 0.11.1 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/3141

New Contributors

@alekseyolg made their first contribution in https://github.com/kserve/kserve/pull/3070
@israel-hdez made their first contribution in https://github.com/kserve/kserve/pull/3072
@jvujjini made their first contribution in https://github.com/kserve/kserve/pull/2963

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.0...v0.11.1

v0.11.0

9 months ago

:rainbow: What's New?

Core Inference & Serving Runtimes

Feature enable ingress for path based routing by @kandrio in https://github.com/kserve/kserve/pull/2357
Allow multiple containers in ServingRuntime by @markwinter in https://github.com/kserve/kserve/pull/2321
Add disable ingress configuration for raw deployment by @andyi2it in https://github.com/kserve/kserve/pull/2773
Add support for collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/2873
Support setting labels and annotations on the component level by @lizzzcai in https://github.com/kserve/kserve/pull/2925
Add RoutesReady and LastDeploymentReady status conditions by @tessapham in https://github.com/kserve/kserve/pull/3008
Triton FasterTransformer LLM by @cmaddalozzo in https://github.com/kserve/kserve/pull/2836
Implement v2/open inference endpoints for kserve python runtimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2655
Support mixed input type for kserve python runtimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2789
Upgrade mlserver version to 1.3.2 by @sivanantha321 in https://github.com/kserve/kserve/pull/2910
TorchServe 0.8.0 for LLM support by @sivanantha321 in https://github.com/kserve/kserve/pull/2980
Bump triton server version to 23.05-py3 by @sivanantha321 in https://github.com/kserve/kserve/pull/2992

Advanced Inference

Allowing setting minReplicas for Inference Graph router. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2679
Adding pod affinity and resource requirements to IG Spec by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2711
add json mimetype header for IG response by @krazik-intuit in https://github.com/kserve/kserve/pull/2877

Storage Provider

Storage Initializer: Support virtual path style in S3 by @lizzzcai in https://github.com/kserve/kserve/pull/2887
Support Direct VolumeMount for PVC by @lizzzcai in https://github.com/kserve/kserve/pull/2738

KServe Python SDK

kserve 0.11.0 now uses poetry for dependency management, cloud storage dependencies are now made optional and you can run pip install kserve[storage] to install those dependencies.

Make storage dependency as an optional dependency by @andyi2it in https://github.com/kserve/kserve/pull/2700
Support parameters in InferInput and InferOutput by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2699
Dependency resolver using poetry by @andyi2it in https://github.com/kserve/kserve/pull/2602
Allow to override the UvicornServer's default log config by @elukey in https://github.com/kserve/kserve/pull/2782
Move cloud event decode logic from preprocess to decode method by @sivanantha321 in https://github.com/kserve/kserve/pull/2881
Allow using SSL between transformer and predictor/explainer by @greenmoon55 in https://github.com/kserve/kserve/pull/2911
Make postprocess interface consistent with V2 protocol by @cmaddalozzo in https://github.com/kserve/kserve/pull/2876
Add a KServe module level logger by @cmaddalozzo in https://github.com/kserve/kserve/pull/2884
Log exception stack for python runtimes by @yuzisun in https://github.com/kserve/kserve/pull/2939
Checked model readiness before attempting inference. by @andyi2it in https://github.com/kserve/kserve/pull/2917
Load Kubeconfig from python dict by @ShreehariVaasishta in https://github.com/kserve/kserve/pull/2924
Added response id based on request id. by @andyi2it in https://github.com/kserve/kserve/pull/3020

⚠️ What's Changed

Remove "default" suffix from generated component name - updated by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2508
Remove(AIX explainer): Remove AIX explainer API and SDK by @Tomcli in https://github.com/kserve/kserve/pull/2826
Fix raw deployment status.address.url displays wrong url by @sivanantha321 in https://github.com/kserve/kserve/pull/2830
Make status.address.url consistent across installations by @sivanantha321 in https://github.com/kserve/kserve/pull/2875
Added support to accept the request body/payload in any format (not just json) by @SatishBethi in https://github.com/kserve/kserve/pull/2524 ⚠️ Now, you are required to set content-type header to application/json for the server to recognize and decode the json type payload.

🐛 What's Fixed

Loosen protobuf and numpy dependency by @andyi2it in https://github.com/kserve/kserve/pull/2673
Fix dependency issue and remove pinned pip version in xgbserver by @dependabot in https://github.com/kserve/kserve/pull/2689
Fixing the dockerfile to run as non-root user by @chirag-orbittec in https://github.com/kserve/kserve/pull/2687
Add check for adding gpu tag suffix when image field is specified by @yuzisun in https://github.com/kserve/kserve/pull/2709
Use fork for multiprocessing mode by @yuzisun in https://github.com/kserve/kserve/pull/2718
Adjust order of types to default to float,int by @pascalwhoop in https://github.com/kserve/kserve/pull/2754
Fix trained model ready status by @andyi2it in https://github.com/kserve/kserve/pull/2774
Fix missing ingress config options in helm chart by @andyi2it in https://github.com/kserve/kserve/pull/2772
model_server.py: fix documentation for enable_latency_logging by @elukey in https://github.com/kserve/kserve/pull/2777
Handle file exist scenario for local storage by @sivanantha321 in https://github.com/kserve/kserve/pull/2794
Loosen tritonclient and azure storage blob dependencies by @sivanantha321 in https://github.com/kserve/kserve/pull/2815
Add RBAC for inferencegraphs/finalizers by @ReToCode in https://github.com/kserve/kserve/pull/2839
Do not create GRPCServer when grpc is not enabled by @greenmoon55 in https://github.com/kserve/kserve/pull/2878
Make Pod mutator idempotent to support fluid by @hclchimumu in https://github.com/kserve/kserve/pull/2896
Fix incorrect log message in transformer reconciliation by @leecs0503 in https://github.com/kserve/kserve/pull/2968
Reconcile when rollout duration is changed by @henrysecond1 in https://github.com/kserve/kserve/pull/2916
Fix status.address.url for networking layer other than istio by @sivanantha321 in https://github.com/kserve/kserve/pull/2908
Fix IngressReady condition by @tessapham in https://github.com/kserve/kserve/pull/2977
Use standard socket for single process by @yuzisun in https://github.com/kserve/kserve/pull/3000
Remove distutils from Python SDK by @xfu83 in https://github.com/kserve/kserve/pull/3010
Fix raw deployment service port by @sivanantha321 in https://github.com/kserve/kserve/pull/2967
Allow passthrough of InferRequest id by @markgeejw in https://github.com/kserve/kserve/pull/2945
Fix: if there is a symbol '?' in the path, force url. query as the mi… by @Wercurial in https://github.com/kserve/kserve/pull/3014

⬆️ Version Upgrade

Bump torch from 1.13.0 to 1.13.1 in /python/aixexplainer by @dependabot in https://github.com/kserve/kserve/pull/2802
Add support for k8s 1.26 by @sivanantha321 in https://github.com/kserve/kserve/pull/2835
Go 1.20 upgrade by @sivanantha321 in https://github.com/kserve/kserve/pull/2914
Bump the Go version to 1.20 for the builder image by @skonto in https://github.com/kserve/kserve/pull/2860
Update the OpenShift guide to version 4.12 and use OpenShift Serverless by @ReToCode in https://github.com/kserve/kserve/pull/2855
Added support for python 3.10 and removed python 3.7 references by @andyi2it in https://github.com/kserve/kserve/pull/2832
Poetry plugin should update pyproject.toml by @andyi2it in https://github.com/kserve/kserve/pull/2899
Python 3.11 support by @andyi2it in https://github.com/kserve/kserve/pull/2933
Add python 3.11 support for alibi explainer by @sivanantha321 in https://github.com/kserve/kserve/pull/3006

🔨 Project SDLC

Fix running out of disk space in e2e by @andyi2it in https://github.com/kserve/kserve/pull/2765
Updating Knative Serving and Istio to their latest version by @matzew in https://github.com/kserve/kserve/pull/2697
Fix formatting and controller tests by @yuzisun in https://github.com/kserve/kserve/pull/2783
Parametrized docker builds by @peterableda in https://github.com/kserve/kserve/pull/2666
Fix minimum k8s version in quick install by @sivanantha321 in https://github.com/kserve/kserve/pull/2791
Make deployment scheduling behavior configurable by @ddelange in https://github.com/kserve/kserve/pull/2627
Upgrade kustomization.yaml to support kustomize 5.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2841
Extract modelmesh part in helm chart by @hhk7734 in https://github.com/kserve/kserve/pull/2704
chown python virtual env path to runtime user by @ReToCode in https://github.com/kserve/kserve/pull/2845
Use buildkit for building docker images by @sivanantha321 in https://github.com/kserve/kserve/pull/2848
Implement dynamic versioning using poetry plugin by @andyi2it in https://github.com/kserve/kserve/pull/2869
Break down the Serving and net-istio artifact downloads into their own release trains by @matzew in https://github.com/kserve/kserve/pull/2890
Add poetry lockfile consistency check to CI environment by @sivanantha321 in https://github.com/kserve/kserve/pull/2905
Upgrade controller gen version to 0.12.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2912
Fix kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/2991
chore: Free up disk space on E2E test GHA runner node by @ckadner in https://github.com/kserve/kserve/pull/2972
Fix e2e workflow syntax typo that broke e2e tests by @andyi2it in https://github.com/kserve/kserve/pull/2998
Enable Triton e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3004
Added manual workflow trigger for release branch. by @andyi2it in https://github.com/kserve/kserve/pull/3002

📝 Documentation Update

update kserve model method signatures in docs by @andyi2it in https://github.com/kserve/kserve/pull/2713
update outlier detection example by @andyi2it in https://github.com/kserve/kserve/pull/2701
Feat: adds huggingface bloom example to torchserve by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2466
Iter8 canary and performance testing samples by @sriumcp in https://github.com/kserve/kserve/pull/2752
Fix Cifar10 drift detection example's InferenceService by @aliok in https://github.com/kserve/kserve/pull/2787
Update tutorial of inference logging with Knative Eventing by @aliok in https://github.com/kserve/kserve/pull/2792
Update feast transformer docs by @sivanantha321 in https://github.com/kserve/kserve/pull/2780
fix(samples): Update AIX examples to use custom explainer spec by @Tomcli in https://github.com/kserve/kserve/pull/2811
Add KServe Fluid example on LLMs by @lizzzcai in https://github.com/kserve/kserve/pull/2819
Update kafka example by @sivanantha321 in https://github.com/kserve/kserve/pull/2817
Add configmap docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3016
Updated onnx-example. by @andyi2it in https://github.com/kserve/kserve/pull/3001
add documentation about storage-initializer userid for istio-cni by @ReToCode in https://github.com/kserve/kserve/pull/3028

New Contributors

@nagar-ajay made their first contribution in https://github.com/kserve/kserve/pull/2662
@swapkh91 made their first contribution in https://github.com/kserve/kserve/pull/2609
@kandrio made their first contribution in https://github.com/kserve/kserve/pull/2357
@chirag-orbittec made their first contribution in https://github.com/kserve/kserve/pull/2687
@pascalwhoop made their first contribution in https://github.com/kserve/kserve/pull/2754
@matzew made their first contribution in https://github.com/kserve/kserve/pull/2697
@peterableda made their first contribution in https://github.com/kserve/kserve/pull/2666
@aliok made their first contribution in https://github.com/kserve/kserve/pull/2787
@Naegionn made their first contribution in https://github.com/kserve/kserve/pull/2797
@ReToCode made their first contribution in https://github.com/kserve/kserve/pull/2839
@hhk7734 made their first contribution in https://github.com/kserve/kserve/pull/2704
@skonto made their first contribution in https://github.com/kserve/kserve/pull/2860
@krazik-intuit made their first contribution in https://github.com/kserve/kserve/pull/2877
@SatishBethi made their first contribution in https://github.com/kserve/kserve/pull/2524
@taneem-ibrahim made their first contribution in https://github.com/kserve/kserve/pull/2907
@hclchimumu made their first contribution in https://github.com/kserve/kserve/pull/2896
@leecs0503 made their first contribution in https://github.com/kserve/kserve/pull/2968
@henrysecond1 made their first contribution in https://github.com/kserve/kserve/pull/2916
@ShreehariVaasishta made their first contribution in https://github.com/kserve/kserve/pull/2924
@fj-ochiai made their first contribution in https://github.com/kserve/kserve/pull/3017
@xfu83 made their first contribution in https://github.com/kserve/kserve/pull/3010
@markgeejw made their first contribution in https://github.com/kserve/kserve/pull/2945
@Wercurial made their first contribution in https://github.com/kserve/kserve/pull/3014

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.0...v0.11.0

v0.11.0-rc1

10 months ago

What's Changed

Replace unmaintained satori/go.uuid package by @sivanantha321 in https://github.com/kserve/kserve/pull/2932
Log exception stack for python runtimes by @yuzisun in https://github.com/kserve/kserve/pull/2939
Upgrade controller gen version to 0.12.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2912
Checked model readiness before attempting inference. by @andyi2it in https://github.com/kserve/kserve/pull/2917
moviesentiment storageUri updated. by @andyi2it in https://github.com/kserve/kserve/pull/2952
Python 3.11 support by @andyi2it in https://github.com/kserve/kserve/pull/2933
Update alibi explainer storage uri by @sivanantha321 in https://github.com/kserve/kserve/pull/2966
Updated storageUri for paddle example and e2e test. by @andyi2it in https://github.com/kserve/kserve/pull/2956
Decode avro cloud event by @sivanantha321 in https://github.com/kserve/kserve/pull/2929
Fix incorrect log message in transformer reconciliation by @leecs0503 in https://github.com/kserve/kserve/pull/2968
Reconcile when rollout duration is changed by @henrysecond1 in https://github.com/kserve/kserve/pull/2916
Support setting labels and annotations on the component level by @lizzzcai in https://github.com/kserve/kserve/pull/2925
Load Kubeconfig from python dict by @ShreehariVaasishta in https://github.com/kserve/kserve/pull/2924
Fix status.address.url for networking layer other than istio by @sivanantha321 in https://github.com/kserve/kserve/pull/2908
Fix kourier e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/2991
fix IngressReady condition by @tessapham in https://github.com/kserve/kserve/pull/2977
chore: Free up disk space on E2E test GHA runner node by @ckadner in https://github.com/kserve/kserve/pull/2972
Fix e2e workflow syntax typo that broke e2e tests by @andyi2it in https://github.com/kserve/kserve/pull/2998
Use standard socket for single process by @yuzisun in https://github.com/kserve/kserve/pull/3000
Bump torchserve version to 0.8.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2980
Fix params while loading kube config from dict by @ShreehariVaasishta in https://github.com/kserve/kserve/pull/3005
Add python 3.11 support for alibi explainer by @sivanantha321 in https://github.com/kserve/kserve/pull/3006
Enable Triton e2e test by @sivanantha321 in https://github.com/kserve/kserve/pull/3004
Bump triton server version to 23.05-py3 by @sivanantha321 in https://github.com/kserve/kserve/pull/2992
Update ModelMesh version to v0.11.0-rc0 by @rafvasq in https://github.com/kserve/kserve/pull/2969
Fix a typo docs/samples/metrics-and-monitoring/README.md by @fj-ochiai in https://github.com/kserve/kserve/pull/3017
Remove distutils from Python SDK by @xfu83 in https://github.com/kserve/kserve/pull/3010
Fix raw deployment service port by @sivanantha321 in https://github.com/kserve/kserve/pull/2967
Allow passthrough of InferRequest id by @markgeejw in https://github.com/kserve/kserve/pull/2945
Add configmap docs by @sivanantha321 in https://github.com/kserve/kserve/pull/3016
add ServiceReady status conditions by @tessapham in https://github.com/kserve/kserve/pull/3008
Updated onnx-example. by @andyi2it in https://github.com/kserve/kserve/pull/3001
Fixes for Integrating KServe with Openshift by @skonto in https://github.com/kserve/kserve/pull/2853
Added manual workflow trigger for release branch. by @andyi2it in https://github.com/kserve/kserve/pull/3002
fix: if there is a symbol '?' in the path, force url. query as the mi… by @Wercurial in https://github.com/kserve/kserve/pull/3014
Added response id based on request id. by @andyi2it in https://github.com/kserve/kserve/pull/3020
put back PredictorReady in living condition set by @tessapham in https://github.com/kserve/kserve/pull/3026
add documentation about storage-initializer userid for istio-cni by @ReToCode in https://github.com/kserve/kserve/pull/3028
publish RC1 version for v0.11.0 by @tessapham in https://github.com/kserve/kserve/pull/3027

New Contributors

@leecs0503 made their first contribution in https://github.com/kserve/kserve/pull/2968
@henrysecond1 made their first contribution in https://github.com/kserve/kserve/pull/2916
@ShreehariVaasishta made their first contribution in https://github.com/kserve/kserve/pull/2924
@tessapham made their first contribution in https://github.com/kserve/kserve/pull/2977
@fj-ochiai made their first contribution in https://github.com/kserve/kserve/pull/3017
@xfu83 made their first contribution in https://github.com/kserve/kserve/pull/3010
@markgeejw made their first contribution in https://github.com/kserve/kserve/pull/2945
@Wercurial made their first contribution in https://github.com/kserve/kserve/pull/3014

Full Changelog: https://github.com/kserve/kserve/compare/v0.11.0-rc0...v0.11.0-rc1

v0.10.2

10 months ago

What's Changed

Fix github workflow on release-0.10 by @greenmoon55 in https://github.com/kserve/kserve/pull/2892
Do not create GRPCServer when grpc is not enabled by @greenmoon55 in https://github.com/kserve/kserve/pull/2886
Cherry-pick: Add a KServe module level logger (#2884) by @yuzisun in https://github.com/kserve/kserve/pull/2940
Use standard socket to fix performance regression in kserve python server by @yuzisun https://github.com/kserve/kserve/pull/3000
Fix 0.10.1 cherry-pick merge issue by @yuzisun in https://github.com/kserve/kserve/pull/2999

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.1...v0.10.2

v0.11.0-rc0

11 months ago

:rainbow: What's New?

Core Inference

Feature enable ingress for path based routing by @kandrio in https://github.com/kserve/kserve/pull/2357
Support Direct VolumeMount for PVC by @lizzzcai in https://github.com/kserve/kserve/pull/2738
Allow multiple containers in ServingRuntime by @markwinter in https://github.com/kserve/kserve/pull/2321
Implement v2/open inference endpoints for OOTB python model servers by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2655
Support parameters in InferInput and InferOutput by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2699
Pass parameter in rest v2 infer by @Naegionn in https://github.com/kserve/kserve/pull/2797
Support mixed input type for kserve python runtimes by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2789
Add disable ingress feature for raw deployment by @andyi2it in https://github.com/kserve/kserve/pull/2773
python: allow to override the UvicornServer's default log config by @elukey in https://github.com/kserve/kserve/pull/2782
Add a KServe module level logger by @cmaddalozzo in https://github.com/kserve/kserve/pull/2884
Storage Initializer: Support virtual path style in S3 by @lizzzcai in https://github.com/kserve/kserve/pull/2887
Add support for collocation of transformer and predictor by @sivanantha321 in https://github.com/kserve/kserve/pull/2873
Move cloud event decode logic from preprocess to decode method by @sivanantha321 in https://github.com/kserve/kserve/pull/2881
Added support to accept the request body/payload in any format (not just json) by @SatishBethi in https://github.com/kserve/kserve/pull/2524
Allow using SSL between transformer and predictor/explainer by @greenmoon55 in https://github.com/kserve/kserve/pull/2911
Make postprocess interface consistent with V2 protocol by @cmaddalozzo in https://github.com/kserve/kserve/pull/2876
Make pod mutator idempotent to support fluid by @hclchimumu in https://github.com/kserve/kserve/pull/2896

Inference Graph

Allowing setting minReplicas for IG router. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2679
Adding podaffinity and resourcerequirments to IG Spec by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2711
Add RBAC for inferencegraphs/finalizers by @ReToCode in https://github.com/kserve/kserve/pull/2839
add json mimetype header for IG response by @krazik-intuit in https://github.com/kserve/kserve/pull/2877

What's Changed

Remove "default" suffix from generated component name - updated by @Suresh-Nakkeran in https://github.com/kserve/kserve/pull/2508
Remove(AIX explainer): Remove AIX explainer API and SDK by @Tomcli in https://github.com/kserve/kserve/pull/2826
Cleanup aix explainer by @sivanantha321 in https://github.com/kserve/kserve/pull/2889
Make status.address.url consistent across installations by @sivanantha321 in https://github.com/kserve/kserve/pull/2875

Poetry Dependency Management

Dependency resolver using poetry by @andyi2it in https://github.com/kserve/kserve/pull/2602
Make storage dependency as an optional dependency by @andyi2it in https://github.com/kserve/kserve/pull/2700
Implement dynamic versioning using poetry plugin by @andyi2it in https://github.com/kserve/kserve/pull/2869
Poetry plugin should update pyproject.toml by @andyi2it in https://github.com/kserve/kserve/pull/2899
Add poetry lockfile consistency check to CI environment by @sivanantha321 in https://github.com/kserve/kserve/pull/2905

🐛 What's Fixed

Fix KUBE_VERSION variable in quick_install.sh file by @nagar-ajay in https://github.com/kserve/kserve/pull/2662
Update quick install script to add Cluster Autoscaler and istiod memory leakage fix fields by @swapkh91 in https://github.com/kserve/kserve/pull/2609
Fixing the dockerfile to run as non-root user by @chirag-orbittec in https://github.com/kserve/kserve/pull/2687
Add check for adding gpu tag suffix when image field is specified by @yuzisun in https://github.com/kserve/kserve/pull/2709
Use fork for multiprocessing mode by @yuzisun in https://github.com/kserve/kserve/pull/2718
Fix knative installation failure in e2e test by @andyi2it in https://github.com/kserve/kserve/pull/2726
Adjust order of types to default to float,int by @pascalwhoop in https://github.com/kserve/kserve/pull/2754
Fix trained model ready status by @andyi2it in https://github.com/kserve/kserve/pull/2774
fix missing ingress config options in helm chart by @andyi2it in https://github.com/kserve/kserve/pull/2772
Handle file exist scenario for local storage by @sivanantha321 in https://github.com/kserve/kserve/pull/2794
Fix inferencegraphs/finalizers rbac by @sivanantha321 in https://github.com/kserve/kserve/pull/2858
Do not create GRPCServer when grpc is not enabled by @greenmoon55 in https://github.com/kserve/kserve/pull/2878
Fix raw deployment status.address.url displays wrong url by @sivanantha321 in https://github.com/kserve/kserve/pull/2830

Documentation Updates

update kserve model method signatures in docs by @andyi2it in https://github.com/kserve/kserve/pull/2713
update outlier detection example by @andyi2it in https://github.com/kserve/kserve/pull/2701
Feat: adds huggingface bloom example to torchserve by @jagadeeshi2i in https://github.com/kserve/kserve/pull/2466
Iter8 canary and performance testing samples by @sriumcp in https://github.com/kserve/kserve/pull/2752
model_server.py: fix documentation for enable_latency_logging by @elukey in https://github.com/kserve/kserve/pull/2777
Fix Cifar10 drift detection example's InferenceService by @aliok in https://github.com/kserve/kserve/pull/2787
Update tutorial of inference logging with Knative Eventing by @aliok in https://github.com/kserve/kserve/pull/2792
Update feast transformer docs by @sivanantha321 in https://github.com/kserve/kserve/pull/2780
Update AIX examples to use custom explainer spec by @Tomcli in https://github.com/kserve/kserve/pull/2811
Adding doc for release process v2 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2559
Add Triton FasterTransformer example by @cmaddalozzo in https://github.com/kserve/kserve/pull/2836
Add KServe Fluid example on LLMs by @lizzzcai in https://github.com/kserve/kserve/pull/2819
Point S3 example README.md to KServe website by @yuzisun in https://github.com/kserve/kserve/pull/2824
Update the OpenShift guide to version 4.12 and use OpenShift Serverless by @ReToCode in https://github.com/kserve/kserve/pull/2855
Point KServe example readme to website by @yuzisun in https://github.com/kserve/kserve/pull/2864
Update kafka example by @sivanantha321 in https://github.com/kserve/kserve/pull/2817

SDLC Changes

Parametrized docker builds by @peterableda in https://github.com/kserve/kserve/pull/2666
Make deployment scheduling behavior configurable by @ddelange in https://github.com/kserve/kserve/pull/2627
Extract modelmesh part in helm chart by @hhk7734 in https://github.com/kserve/kserve/pull/2704
chown python virtual env path to runtime user by @ReToCode in https://github.com/kserve/kserve/pull/2845
Add cherry pick github action by @yuzisun in https://github.com/kserve/kserve/pull/2707
Adding token for cherry-pick action. by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2716
Upgrading cherry pick action to v1.0.9 by @rachitchauhan43 in https://github.com/kserve/kserve/pull/2735
Use buildkit for building docker images by @sivanantha321 in https://github.com/kserve/kserve/pull/2848
Break down the Serving and net-istio artifact downloads into their own release trains by @matzew in https://github.com/kserve/kserve/pull/2890

Dependency Updates

Loosen protobuf and numpy dependency by @andyi2it in https://github.com/kserve/kserve/pull/2673
Bump pillow from 9.0.1 to 9.3.0 in /python/custom_transformer by @dependabot in https://github.com/kserve/kserve/pull/2677
Fix dependency issue and remove pinned pip version in xgbserver by @dependabot in https://github.com/kserve/kserve/pull/2689
Fix running out of disk space in e2e by @andyi2it in https://github.com/kserve/kserve/pull/2765
Updating Knative Serving and Istio to their latest version by @matzew in https://github.com/kserve/kserve/pull/2697
Fix formatting and controller tests by @yuzisun in https://github.com/kserve/kserve/pull/2783
Fix minimum k8s version in quick install by @sivanantha321 in https://github.com/kserve/kserve/pull/2791
Bump cryptography from 38.0.4 to 39.0.1 in /python/sklearnserver by @dependabot in https://github.com/kserve/kserve/pull/2803
Bump torch from 1.13.0 to 1.13.1 in /python/aixexplainer by @dependabot in https://github.com/kserve/kserve/pull/2802
Bump golang.org/x/net from 0.0.0-20220225172249-27dd8689420f to 0.7.0 in /qpext by @dependabot in https://github.com/kserve/kserve/pull/2805
Bump golang.org/x/crypto from 0.0.0-20200622213623-75b288015ac9 to 0.1.0 in /docs/samples/graph/bgtest/bgtest by @dependabot in https://github.com/kserve/kserve/pull/2806
Bump pillow from 9.0.1 to 9.3.0 in /python/custom_model by @dependabot in https://github.com/kserve/kserve/pull/2804
Bump opencv-python from 3.4.18.65 to 4.2.0.32 in /python/paddleserver by @dependabot in https://github.com/kserve/kserve/pull/2807
Bump golang.org/x/net from 0.4.0 to 0.7.0 by @dependabot in https://github.com/kserve/kserve/pull/2827
Loosen tritonclient and azure storage blob dependencies by @sivanantha321 in https://github.com/kserve/kserve/pull/2815
Upgrade kustomization.yaml to support kustomize 5.0 by @sivanantha321 in https://github.com/kserve/kserve/pull/2841
Add support for k8s 1.26 by @sivanantha321 in https://github.com/kserve/kserve/pull/2835
Bump the Go version for the builder image by @skonto in https://github.com/kserve/kserve/pull/2860
Added support for python 3.10 and removed python 3.7 references by @andyi2it in https://github.com/kserve/kserve/pull/2832
Upgrade mlserver version to 1.3.2 by @sivanantha321 in https://github.com/kserve/kserve/pull/2910
Go 1.20 upgrade by @sivanantha321 in https://github.com/kserve/kserve/pull/2914
Update makefile by @sivanantha321 in https://github.com/kserve/kserve/pull/2920

New Contributors

@nagar-ajay made their first contribution in https://github.com/kserve/kserve/pull/2662
@swapkh91 made their first contribution in https://github.com/kserve/kserve/pull/2609
@kandrio made their first contribution in https://github.com/kserve/kserve/pull/2357
@chirag-orbittec made their first contribution in https://github.com/kserve/kserve/pull/2687
@pascalwhoop made their first contribution in https://github.com/kserve/kserve/pull/2754
@matzew made their first contribution in https://github.com/kserve/kserve/pull/2697
@peterableda made their first contribution in https://github.com/kserve/kserve/pull/2666
@aliok made their first contribution in https://github.com/kserve/kserve/pull/2787
@sivanantha321 made their first contribution in https://github.com/kserve/kserve/pull/2791
@Naegionn made their first contribution in https://github.com/kserve/kserve/pull/2797
@ReToCode made their first contribution in https://github.com/kserve/kserve/pull/2839
@hhk7734 made their first contribution in https://github.com/kserve/kserve/pull/2704
@skonto made their first contribution in https://github.com/kserve/kserve/pull/2860
@krazik-intuit made their first contribution in https://github.com/kserve/kserve/pull/2877
@SatishBethi made their first contribution in https://github.com/kserve/kserve/pull/2524
@taneem-ibrahim made their first contribution in https://github.com/kserve/kserve/pull/2907
@hclchimumu made their first contribution in https://github.com/kserve/kserve/pull/2896

Full Changelog: https://github.com/kserve/kserve/compare/v0.10.0...v0.11.0-rc0