v2.5.4

IMPROVEMENTS

• add info logging for uploadObjectDiskParts and downloadObjectDiskParts operation

v2.5.3

BUG FIXES

• fixed Unknown setting base_backup for use_embedded_backup_restore: true and create --diff-from-remote, affected 2.5.0+ versions, fix 735

v2.5.2

BUG FIXES

• fixed issue after 865 we can't use create_remote --diff-from-remote for remote_storage: custom, affected versions 2.5.0, 2.5.1, fix 900

v2.5.1

BUG FIXES

• fixed issue when set both AWS_ROLE_ARN and S3_ASSUME_ROLE_ARN then S3_ASSUME_ROLE_ARN shall have more priority than AWS_ROLE_ARN fix 898

v2.5.0

IMPROVEMENTS

• complete removed support for legacy backups, created with version prior v1.0
• removed disable_progress_bar config option and related progress bar code
• added --delete-source parameter for upload and create_remote commands to explicitly delete local backup during upload, fix 777
• added support for --env ENV_NAME=value cli parameter for allow dynamically override any config parameter, fix 821
• added support for use_embedded_backup_restore: true with empty embedded_backup_disk value, tested on S3/GCS over S3/AzureBlobStorage, fix 695
• --rbac, --rbac-only, --configs, --configs-only now works with use_embedded_backup_restore: true -- --data for restore with use_embedded_backup_restore: true will use allow_non_empty_tables=true to allow fix 756
• added --diff-from-remote parameter for create command, will copy only new data parts object disk data, also allows to download properly object disk data from required backup during restore, fix 865
• added support of native Clickhouse incremental backup for use_embedded_backup_restore: true fix 735
• added GCS_CHUNK_SIZE config parameter, try to speedup GCS upload fix 874, thanks @dermasmid
• added --remote-backup cli parameter to tables command and GET /backup/table, fix 778
• added rbac_always_backup: true option to default config, will create backup for RBAC objects automatically, restore still require --rbac to avoid destructive actions, fix 793
• added rbac_conflict_resolution: recreate option for RBAC object name conflicts during restore, fix 851
• added upload_max_bytes_per_seconds and download_max_bytes_per_seconds config options to allow throttling without CAP_SYS_NICE, fix 817
• added clickhouse_backup_in_progress_commands metric, fix 836
• switched to golang 1.22
• updated all third-party SDK to latest versions
• added clickhouse/clickhouse-server:24.3 to CI/CD

BUG FIXES

• continue S3_MAX_PARTS_COUNT default value from 2000 to 4000 to continue decrease memory usage for S3
• changed minimal part size for multipart upload in CopyObject from 5Mb to 10Mb
• restore SQL UDF functions after restore tables
• execute ALTER TABLE ... DROP PARTITION instead of DROP TABLE for restore and restore_remote with parameters --data --partitions=..., fix 756
• fix wrong behavior for freeze_by_part + freeze_by_part_where, fix 855
• apply CLICKHOUSE_SKIP_TABLES_ENGINES during create command
• fixed behavior for upload / download when .inner. table missing for MATERIALIZED VIEW by table pattern, fix 765
• fixed ObjectDisks + CLICKHOUSE_USE_EMBEDDED_BACKUP_RESTORE: true - shall skip upload object disk content, fix 799
• fixed connection to clickhouse-server behavior when long clickhouse-server startup time and docker-entrypoint.d processing, will infinite reconnect each 5 seconds, until success, fix 857
• fixed USE_EMBEDDED_BACKUP_RESTORE=true behavior to allow use backup disk with type local, fix 882
• fixed wrong list command behavior, it shall scann all system.disks path not only default disk to find pratially created backups, fix 873
• fixed create --rbac behavior, don't create access folder if no RBAC objects is present
• fixed behavior when system.disks contains disk which not present in any storage_policies, fix 845

v2.4.35

IMPROVEMENTS

• set part size for s3:CopyObject minimum 128Mb, look details https://repost.aws/questions/QUtW2_XaALTK63wv9XLSywiQ/s3-sync-command-is-slow-to-start-on-some-data

v2.4.34

BUG FIXES

• fixed wrong behavior for CLICKHOUSE_SKIP_TABLES_ENGINES for engine=EngineName without parameters

v2.4.33

BUG FIXES

• fixed wrong anonymous authorization for service account for GCS, added GCS_SKIP_CREDENTIALS fix 848, fix 847, thanks @sanadhis

v2.4.32

IMPROVEMENTS

• added ability to make custom endpoint for GCS, fix 837, thanks @sanadhis

BUG FIXES

• fixed wrong config validation for object_disk_path even when no object disk present in backup during restore, fix 842

v2.4.31

IMPROVEMENTS

• add check_sum_algorithm parameter for s3 config section with "" default value, to avoid useless CPU usage during upload to S3 storage, additional fix 829
• upload will delete local backup if upload successful, fix 834

BUG FIXES

• fix miss checksum for CopyObject in s3, fix 835, affected 2.4.30
• fix wrong behavior for restore --rbac-only and restore --rbac for backups which not contains any schema, fix 832