Aws Ddk Versions Save

🚀 Enhancements / Bug Fixes

Core:

• Enhancing AthenaSQLStage to handle both static and dynamic SQL Queries by @anmolsgandhi in https://github.com/awslabs/aws-ddk/pull/204
• Enhancement: adding queue_props to SqsToLambda by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/207
• Enhancement: adding rule_name parameter to DataPipeline.add_stage() by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/209
• Enhancing GlueTransform Stage for Stepfunction Crawler Task Retry by @anmolsgandhi in https://github.com/awslabs/aws-ddk/pull/208
• Enhancment: Adding additonal sfn props support to StateMachineStage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/210
• Fix bug for context_layer undefined and changing region_name derived from boto3 session by @anmolsgandhi in https://github.com/awslabs/aws-ddk/pull/211
• Enhancement: Allowing alarms to be disabled in stages by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/205

🙏 Thanks

We thank the following contributors/users for their work on this release: @anmolsgandhi , @malachi-constant

Full Changelog: https://github.com/awslabs/aws-ddk/compare/0.6.1...0.6.2

🚀 Enhancements / Dependency Upgrades

Core:

• Enhancement: Support additional pipeline attributes in CICDPipelineStack construct by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/184
• Enhancement: SqsToLambdaStage Adding support for fifo event target by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/185
• Enhancement: SDK for pandas layer lookup utility by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/186
• Dependencies: CDK Library Upgrade -> 2.54 by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/190

🙏 Thanks

We thank the following contributors/users for their work on this release:

@kukushking, @malachi-constant

Full Changelog: https://github.com/awslabs/aws-ddk/compare/0.6.0...0.6.1

🚀 Features // 💎 Enhancements // 🪲 Bug fixes

CLI:

• add stacks argument for 'ddk deploy' by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/129
• bug fix: windows ddk deploy Issue by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/180

Core:

• support pipeline_name parameter in CICDPipeline Construct by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/161
• bug fix: GlueTransformStage does not pass crawler name in to SFN by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/167
• additional resource level args in stages SqsToLambdaStage & GlueTransformStage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/170
• support Multiple S3 Prefixes in S3 Event Stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/171
• support Multiple Buckets by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/173
• bug fix: set the required Glue crawler permissions in GlueTransformStage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/172
• add add_wave support to CICDPipelineStack construct by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/176
• add max_batching_window to SqsToLambda Stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/179

Full Changelog: https://github.com/awslabs/aws-ddk/compare/0.5.1...0.6.0

🚀 Features / Bug fixes

CLI:

• add --all to ddk deploy by @jaidisido in https://github.com/awslabs/aws-ddk/pull/111

Core:

• Glue DataBrew Stage by @b-akhil in https://github.com/awslabs/aws-ddk/pull/123
• remove Glue log encryption by default from security config by @kukushking in https://github.com/awslabs/aws-ddk/pull/126

🙏 Thanks

We thank the following contributors/users for their work on this release:

@b-akhil, @jaidisido, @kukushking, @malachi-constant, @cnfait

Full Changelog: https://github.com/awslabs/aws-ddk/compare/0.4.0...0.5.1

🚀 Features / Bug fixes

Core:

• Add stage rshift operator by @kukushking in https://github.com/awslabs/aws-ddk/pull/92
• Refactor Stage construct to include Event, StateMachine and DataStage by @jaidisido in https://github.com/awslabs/aws-ddk/pull/104
• Dms S3<->S3 ingestion stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/105

CLI:

• Add alpha packages to cli requirements.txt template by @jaidisido in https://github.com/awslabs/aws-ddk/pull/107

Docs 📚

• How-to guide ddk configuration by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/99
• Expose configuration attributes for classes in documentation by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/91
• How-To Private Code Artifact and other enhancements by @jaidisido in https://github.com/awslabs/aws-ddk/pull/102

Full Changelog: https://github.com/awslabs/aws-ddk/compare/0.3.0...0.4.0

🙏 Thanks

We thank the following contributors/users for their work on this release:

@jaidisido, @kukushking, @malachi-constant, @cnfait

⚠️ Breaking changes

• Update CDK to v2.20.0 and pin the version #83 #72
• Replace CloudTrail with S3 EventBridge notifications in S3EventStage #83

🚀 Features / Bug fixes

Core:

• Add additional_role_policy_statements to state machine stages #82
• Expose state machine objects in stages #81
• Add state machine alarms #76
• Allow multiple CloudWatch alarms per stage #78
• Add lambda layers to SQSToLambdaStage #79
• Add security config to Glue factory #75
• Add firehose delivery ingestion stage #71 🚀
• Add CodeArtifact publish action #74
• Add AppFlow stage #68 🚀
• Add AthenaSQL stage #66 🚀
• Add glue factory and create glue job and crawler in stage #63
• Add data pipeline & stage alerting #55

CLI:

• Remove default AWS profile #61

Docs 📚

• Multi-account how-to #64

🙏 Thanks

We thank the following contributors/users for their work on this release:

@jaidisido, @kukushking, @malachi-constant, @cnfait

⚠️ Breaking changes

• Renamed aws_ddk_core.pipelines.Stage to aws_ddk_core.pipelines.DataStage and aws_ddk_core.pipelines.Pipeline to aws_ddk_core.pipelines.DataPipeline #33

🚀 Features / Bug fixes

• Enable event handling in SqsToLambdaStage #54
• Improve git commands in CLI create-repository #53
• Add StepFunctionFactory #48
• Use Step Functions service-sent events in GlueTransformStage #51
• Add escape hatches for SqsToLambdaStage #47
• Add security checks and test stages to CICD pipeline construct #28
• Add custom CodeBuild stage to CICD pipeline construct #37
• Add CICD pipeline notifications via SNS #43

Docs 📚

• Create your own DDK Data Stage How-to guide

🙏 Thanks

We thank the following contributors/users for their work on this release:

@jaidisido, @kukushking, @malachi-constant, @cnfait, @vemel, @NickCorbett

Initial release of core and cli packages. 🚀🚀🚀