Pgbackrest Versions Save

Bug Fixes:

• Fix incorrect time expiration being used for non-default repositories. (Reviewed by Stefan Fercot. Reported by Adam Brusselback.)
• Fix issue when listing directories recursively with a filter. (Reviewed by Stephen Frost. Reported by Efremov Egor.)

Features:

• Backup key/value annotations. (Contributed by Stefan Fercot. Reviewed by David Steele. Suggested by Adam Berlin.)

Improvements:

• Support --set in JSON output for info command. (Contributed by Stefan Fercot. Reviewed by David Steele. Suggested by Anton Kurochkin.)
• Allow upload chunk size to be configured for object stores. (Reviewed by Stefan Fercot. Suggested by Anton Glushakov.)
• Update archive.info timestamps after a successful backup. (Reviewed by Stefan Fercot. Suggested by Alex Richman.)
• Move standby timeline check after checkpoint. (Reviewed by Stefan Fercot, Keith Fiske. Suggested by Keith Fiske.)
• Improve warning message on backup resume. (Suggested by Cynthia Shang.)

Documentation Improvements:

• Add absolute path for kill in pgbackrest.service. (Suggested by Don Seiler.)

NOTE TO PACKAGERS: An experimental meson build has been added but packagers should continue to use the autoconf/make build for the foreseeable future.

Improvements:

• OpenSSL 3 support. (Reviewed by Stephen Frost.)
• Create snapshot when listing contents of a path. (Reviewed by John Morris, Stephen Frost.)
• Force target-timeline=current when restore type=immediate. (Reviewed by Stephen Frost.)
• Truncate files during delta restore when they are larger than expected. (Reviewed by Stephen Frost.)
• Disable incremental manifest save when resume=n. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Set backup percent complete to zero before copy start. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Use S3 IsTruncated flag to determine list continuation. (Reviewed by John Morris, Soulou. Suggested by Christian Montagne.)

Documentation Bug Fixes:

• Skip internal options in the configuration reference. (Reported by Francisco Miguel Biete.)

Documentation Improvements:

• Add link to PostgreSQL configuration in repository host section. (Reviewed by Stefan Fercot. Suggested by Julien Cigar.)

Test Suite Improvements:

• Add experimental Meson build. (Reviewed by Eli Schwartz, Sam Bassaly.)
• Allow any path to be passed to the --test-path option. (Contributed by Andrey Sokolov. Reviewed by David Steele.)
• Fix compile error when DEBUG_EXEC_TIME is defined without DEBUG. (Contributed by Andrey Sokolov. Reviewed by David Steele.)

Bug Fixes:

• Fix error thrown from FINALLY() causing an infinite loop. (Reviewed by Stephen Frost.)
• Error on all lock failures except another process holding the lock. (Reviewed by Reid Thompson, Geir Råness. Reported by Geir Råness.)

Features:

• Backup file bundling for improved small file support. (Reviewed by Reid Thompson, Stefan Fercot, Chris Bandy.)
• Verify command to validate the contents of a repository. (Contributed by Cynthia Shang, Reid Thompson. Reviewed by David Steele, Stefan Fercot.)
• PostgreSQL 15 support. (Reviewed by Stefan Fercot.)
• Show backup percent complete in info output. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Auto-select backup for restore command --type=lsn. (Contributed by Reid Thompson. Reviewed by Stefan Fercot, David Steele.)
• Suppress existing WAL warning when archive-mode-check is disabled. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Add AWS IMDSv2 support. (Contributed by Nuno Pires. Reviewed by David Steele.)

Improvements:

• Allow repo-hardlink option to be changed after full backup. (Reviewed by Reid Thompson.)
• Increase precision of percent complete logging for backup and restore. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Improve path validation for repo-* commands. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Improve stop command to honor stanza option. (Contributed by Reid Thompson. Reviewed by David Steele. Suggested by ragaoua.)
• Improve error message for invalid repo-azure-key. (Contributed by Reid Thompson. Reviewed by David Steele. Suggested by Seth Daniel.)
• Add hint to check the log on archive-get/archive-push async error. (Reviewed by Reid Thompson.)
• Add ClockError for unexpected clock skew and timezone changes. (Reviewed by Greg Sabino Mullane, Stefan Fercot. Suggested by Greg Sabino Mullane.)
• Strip extensions from history manifest before showing in error message. (Reviewed by Stefan Fercot.)
• Add user:group to lock permission error. (Reviewed by Reid Thompson.)

Documentation Bug Fixes:

• Fix incorrect reference to stanza-update in the user guide. (Fixed by Abubakar Mohammed. Reviewed by David Steele.)
• Fix example for repo-gcs-key-type option in configuration reference. (Reviewed by Reid Thompson.)
• Fix tls-server-auth example and add clarifications. (Reviewed by Reid Thompson.)

Documentation Improvements:

• Simplify messaging around supported versions in the documentation. (Reviewed by Stefan Fercot, Reid Thompson, Greg Sabino Mullane.)
• Add option type descriptions. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Add FAQ about backup types and restore speed. (Contributed by David Christensen. Reviewed by Reid Thompson.)
• Document required base branch for pull requests. (Contributed by David Christensen. Reviewed by Reid Thompson.)

IMPORTANT NOTE: Repository size reported by the info command is now entirely based on what pgBackRest has written to storage. Previously, in certain cases, pgBackRest could detect if additional compression was being applied by the storage but this is no longer supported.

Bug Fixes:

• Retry errors in S3 batch file delete. (Reviewed by Reid Thompson. Reported by Alex Richman.)
• Allow case-insensitive matching of HTTP connection header values. (Reviewed by Reid Thompson. Reported by Rémi Vidier.)

Features:

• Add support for AWS S3 server-side encryption using KMS. (Contributed by Christoph Berg. Reviewed by David Steele, Tharindu Amila.)
• Add archive-missing-retry option. (Reviewed by Stefan Fercot.)
• Add backup type filter to info command. (Contributed by Stefan Fercot. Reviewed by David Steele.)

Improvements:

• Retry on page validation failure during backup. (Reviewed by Stephen Frost, David Christensen.)
• Handle TLS servers that do not close connections gracefully. (Reviewed by Rémi Vidier, David Christensen, Stephen Frost.)
• Add backup LSNs to info command output. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Automatically strip trailing slashes for repo-ls paths. (Contributed by David Christensen. Reviewed by David Steele.)
• Do not retry fatal errors. (Reviewed by Reid Thompson.)
• Remove support for PostgreSQL 8.3/8.4. (Reviewed by Reid Thompson, Stefan Fercot.)
• Remove logic that tried to determine additional file system compression. (Reviewed by Reid Thompson, Stefan Fercot.)

Documentation Bug Fixes:

• Move repo options in TLS documentation to the global section. (Reported by Anton Kurochkin.)
• Remove unused backup-standby option from stanza commands. (Reported by Stefan Fercot.)
• Fix typos in help and release notes. (Fixed by Daniel Gustafsson. Reviewed by David Steele.)

Documentation Improvements:

• Add aliveness check to systemd service configuration. (Suggested by Yogesh Sharma.)
• Add FAQ explaining WAL archive suffix. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Note that replications slots are not restored. (Contributed by Reid Thompson. Reviewed by David Steele, Stefan Fercot. Suggested by Christophe Courtois.)

IMPORTANT NOTE: If the restore command is unable to find a backup that matches a specified time target then an error will be thrown, whereas before a warning was logged.

Bug Fixes:

• Fix restore delta link mapping when path/file already exists. (Reviewed by Reid Thompson. Reported by Younes Alhroub.)
• Fix socket leak on connection retries. (Reviewed by Reid Thompson. Reported by James Coleman.)

Features:

• Add TLS server. (Reviewed by Stephen Frost, Reid Thompson, Andrew L'Ecuyer.)
• Add --cmd option. (Contributed by Reid Thompson. Reviewed by Stefan Fercot, David Steele. Suggested by Virgile CREVON.)

Improvements:

• Check archive immediately after backup start. (Reviewed by Reid Thompson, David Christensen.)
• Add timeline and checkpoint checks to backup. (Reviewed by Stefan Fercot, Reid Thompson.)
• Check that clusters are alive and correctly configured during a backup. (Reviewed by Stefan Fercot.)
• Error when restore is unable to find a backup to match the time target. (Reviewed by Reid Thompson, Douglas J Hunley. Suggested by Douglas J Hunley.)
• Parse protocol/port in S3/Azure endpoints. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Add warning when checkpoint_timeout exceeds db-timeout. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Add verb to HTTP error output. (Contributed by Christoph Berg. Reviewed by David Steele.)
• Allow y/n arguments for boolean command-line options. (Contributed by Reid Thompson. Reviewed by David Steele.)
• Make backup size logging exactly match info command output. (Contributed by Reid Thompson. Reviewed by David Steele. Suggested by Mahomed Hussein.)

Documentation Improvements:

• Display size option default and allowed values with appropriate units. (Reviewed by Reid Thompson.)
• Fix typos and improve documentation for the tablespace-map-all option. (Reviewed by Reid Thompson. Suggested by Reid Thompson.)
• Remove obsolete statement about future multi-repository support. (Suggested by David Christensen.)

Bug Fixes:

• Allow "global" as a stanza prefix. (Reviewed by Stefan Fercot. Reported by Younes Alhroub.)
• Fix segfault on invalid GCS key file. (Reviewed by Stephen Frost. Reported by Henrik Feldt.)

Improvements:

• Allow link-map option to create new links. (Reviewed by Don Seiler, Stefan Fercot, Chris Bandy. Suggested by Don Seiler.)
• Increase max index allowed for pg/repo options to 256. (Reviewed by Cynthia Shang.)
• Add WebIdentity authentication for AWS S3. (Reviewed by James Callahan, Reid Thompson, Benjamin Blattberg, Andrew L'Ecuyer.)
• Report backup file validation errors in backup.info. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Add recovery start time to online backup restore log. (Reviewed by Tom Swartz, Stefan Fercot. Suggested by Tom Swartz.)
• Report original error and retries on local job failure. (Reviewed by Stefan Fercot.)
• Rename page checksum error to error list in info text output. (Reviewed by Stefan Fercot.)
• Add hints to standby replay timeout message. (Reviewed by Cynthia Shang, Stefan Fercot. Suggested by Leigh Downs.)

IMPORTANT NOTE: The log level for copied files in the backup/restore commands has been changed to detail. This makes the info log level less noisy but if these messages are required then set the log level for the backup/restore commands to detail.

Bug Fixes:

• Detect errors in S3 multi-part upload finalize. (Reviewed by Cynthia Shang, Marco Montagna. Reported by Marco Montagna, Lev Kokotov, Anderson A. Mallmann.)
• Fix detection of circular symlinks. (Reviewed by Stefan Fercot. Reported by Rohit Raveendran.)
• Only pass selected repo options to the remote. (Reviewed by David Christensen, Cynthia Shang. Reported by Greg Sabino Mullane, David Christensen.)

Improvements:

• Binary protocol. (Reviewed by Cynthia Shang.)
• Automatically create data directory on restore. (Contributed by Stefan Fercot. Reviewed by David Steele. Suggested by Chris Bandy.)
• Allow restore --type=lsn. (Contributed by Stefan Fercot. Reviewed by Cynthia Shang. Suggested by James Coleman.)
• Change level of backup/restore copied file logging to detail. (Reviewed by Stefan Fercot. Suggested by Jens Wilke.)
• Loop while waiting for checkpoint LSN to reach replay LSN. (Contributed by Stefan Fercot. Reviewed by David Steele. Suggested by Fatih Mencutekin.)
• Log backup file total and restore size/file total. (Reviewed by Cynthia Shang.)

Documentation Bug Fixes:

• Fix incorrect host names in user guide. (Reviewed by Stefan Fercot. Reported by Greg Sabino Mullane.)

Documentation Improvements:

• Update contributing documentation and add pull request template. (Contributed by Cynthia Shang. Reviewed by David Steele.)
• Rearrange backup documentation in user guide. (Reviewed by Cynthia Shang.)
• Clarify restore --type behavior in command reference. (Contributed by Cynthia Shang. Reviewed by David Steele.)
• Fix documentation and comment typos. (Contributed by Eric Radman. Reviewed by David Steele.)

Test Suite Improvements:

• Add check for test path inside repo path. (Reviewed by Greg Sabino Mullane. Suggested by Greg Sabino Mullane.)
• Add CodeQL static code analysis. (Reviewed by Cynthia Shang.)
• Update tests to use standard patterns. (Contributed by Cynthia Shang. Reviewed by David Steele.)

Bug Fixes:

• Fix issues with leftover spool files from a prior restore. (Reviewed by Cynthia Shang, Stefan Fercot, Floris van Nee. Reported by Floris van Nee.)
• Fix issue when checking links for large numbers of tablespaces. (Reviewed by Cynthia Shang, Avinash Vallarapu. Reported by Avinash Vallarapu.)
• Free no longer needed remotes so they do not timeout during restore. (Reviewed by Cynthia Shang. Reported by Francisco Miguel Biete.)
• Fix help when a valid option is invalid for the specified command. (Reviewed by Stefan Fercot. Reported by Cynthia Shang.)

Features:

• Add PostgreSQL 14 support. (Reviewed by Cynthia Shang.)
• Add automatic GCS authentication for GCE instances. (Reviewed by Jan Wieck, Daniel Farina.)
• Add repo-retention-history option to expire backup history. (Contributed by Stefan Fercot. Reviewed by Cynthia Shang, David Steele.)
• Add db-exclude option. (Contributed by Stefan Fercot. Reviewed by Cynthia Shang.)

Improvements:

• Change archive expiration logging from detail to info level. (Contributed by Cynthia Shang. Reviewed by David Steele.)
• Remove stanza archive spool path on restore. (Reviewed by Cynthia Shang, Stefan Fercot.)
• Do not write files atomically or sync paths during backup copy. (Reviewed by Stephen Frost, Stefan Fercot, Cynthia Shang.)

Documentation Improvements:

• Update contributing documentation. (Contributed by Cynthia Shang. Reviewed by David Steele, Stefan Fercot.)
• Consolidate RHEL/CentOS user guide into a single document. (Reviewed by Cynthia Shang.)
• Clarify that repo-s3-role is not an ARN. (Contributed by Isaac Yuen. Reviewed by David Steele.)

Bug Fixes:

• Fix option warnings breaking async archive-get/archive-push. (Reviewed by Cynthia Shang. Reported by Lev Kokotov.)
• Fix memory leak in backup during archive copy. (Reviewed by Cynthia Shang. Reported by Christian ROUX, Efremov Egor.)
• Fix stack overflow in cipher passphrase generation. (Reviewed by Cynthia Shang. Reported by bsiara.)
• Fix repo-ls / on S3 repositories. (Reviewed by Cynthia Shang. Reported by Lesovsky Alexey.)

Features:

• Multiple repository support. (Contributed by Cynthia Shang, David Steele. Reviewed by Stefan Fercot, Stephen Frost.)
• GCS support for repository storage. (Reviewed by Cynthia Shang.)
• Add archive-header-check option. (Reviewed by Stephen Frost, Cynthia Shang. Suggested by Hans-Jürgen Schönig.)

Improvements:

• Include recreated system databases during selective restore. (Contributed by Stefan Fercot. Reviewed by Cynthia Shang.)
• Exclude content-length from S3 signed headers. (Reviewed by Cynthia Shang. Suggested by Brian P Bockelman.)
• Consolidate less commonly used repository storage options. (Reviewed by Cynthia Shang.)
• Allow custom config-path default with ./configure --with-configdir. (Contributed by Michael Schout. Reviewed by David Steele.)
• Log archive copy during backup. (Reviewed by Cynthia Shang, Stefan Fercot.)

Documentation Improvements:

• Update reference to include links to user guide examples. (Contributed by Cynthia Shang. Reviewed by David Steele.)
• Update selective restore documentation with caveats. (Reviewed by Cynthia Shang, Stefan Fercot.)
• Add compress-type clarification to archive-copy documentation. (Reviewed by Cynthia Shang, Stefan Fercot.)
• Add compress-level defaults per compress-type value. (Contributed by Cynthia Shang. Reviewed by David Steele.)
• Add note about required NFS settings being the same as PostgreSQL. (Contributed by Cynthia Shang. Reviewed by David Steele.)

Bug Fixes:

• Fix resume after partial delete of backup by prior resume. (Reviewed by Cynthia Shang. Reported by Tom Swartz.)

Features:

• Add repo-ls command. (Reviewed by Cynthia Shang, Stefan Fercot.)
• Add repo-get command. (Contributed by Stefan Fercot, David Steele. Reviewed by Cynthia Shang.)
• Add archive-mode-check option. (Contributed by Stefan Fercot. Reviewed by David Steele, Michael Banck.)

Improvements:

• Improve archive-get performance. (Reviewed by Cynthia Shang.)