DataflowTemplates Versions Save

Release Week of 2024-03-06

Note: This release is being rolled out. It may not be in your region yet.

New Templates

• SourceDB to Spanner

Improvements

• Upgraded to use Beam 2.54.0.
• Terraform modules specific to each template
• Added At-least Once mode support to Streaming Templates

Bug Fixes

N/A

Contributors

@Abacn @aksharauke @bharadwaj-aditya @damondouglas @damccorm @Deep1998 @Dippatel98 @Polber @shunping

Release Week of 2024-02-20

Note: This release is being rolled out. It may not be in your region yet.

Contributors

• darshan-sj

Release Week of 2/12/2024

Improvements

• Reduce startup time for YamlTemplate
• Expose fetchSize option to DataplexJdbcIngestion template
• Add RpcPriority flag to DatastreamToSpanner Template

Bug Fixes

• Fix default value for At Least Once in Template Metadata
• Fix BigQueryDynamicDestination to properly fetch TableRow field names
• Add RpcPriority flag to Spanner Transaction
• Enfore csvFormat and delimiter as required parameters for GCS_CSV_to_BigQuery template

Contributors

• Ahmed Abualsaud
• Dippatel98
• Jeffrey Kinard
• Manit Gupta
• Yi Hu
• aksharau
• keyliug

Release Week of 2024-01-23

New Templates

Cloud Bigtable to Vector Embeddings template added

Improvements

BigQuery At Least Once flag is now hidden in the UI

Contributors

Bruno Volpato Ron Gal Dip Patel djagaluru