Aws Ddk Versions Save

An open source development framework to help you build data workflows and modern data architecture on AWS.

v1.4.0

4 months ago

Fixes 🐛

feat: Adding clearer exception for invalid config by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/464

Dependencies

chore: upgrade aws-cdk-lib by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/484
chore: update semver vulnerability by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/461

Packages 🗳️

NPM
Python

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.3.1...v1.4.0

v1.3.1

6 months ago

Fixes 🐛

fix: Restrict MWAA Env to Two Subnets by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/456

Dependencies

chore(deps-dev): bump @babel/traverse from 7.22.6 to 7.23.2 by @dependabot in https://github.com/awslabs/aws-ddk/pull/446
chore: update dependencies by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/458

Packages 🗳️

NPM
Python

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.3.0...v1.3.1

v1.3.0

7 months ago

Features/Enhancements 🚀

feat: Allowing 'any' in configuration props by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/419
feat(cicd): adding install commands by @Rizxcviii in https://github.com/awslabs/aws-ddk/pull/424
feat: Update MWAATriggerDagsStage to pass json event to MWAA airflow dag by @devansh-gandhi in https://github.com/awslabs/aws-ddk/pull/430

Fixes

fix: Making 'configPath' optional in interfaces by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/418
fix: update Update MWAAEnviroment to create VPC and MWAAExecutionRole with resource prefix by @devansh-gandhi in https://github.com/awslabs/aws-ddk/pull/439

Packages 🗳️

NPM
Python

New Contributors

@Rizxcviii made their first contribution in https://github.com/awslabs/aws-ddk/pull/424
@devansh-gandhi made their first contribution in https://github.com/awslabs/aws-ddk/pull/430

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.2.0...v1.3.0

v1.2.0

9 months ago

Features/Enhancements 🚀

feat: New Construct EMRServerlessCluster by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/387
feat: EMR Serverless Stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/390

Packages 🗳️

NPM
Python

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.1.0...v1.2.0

v1.1.0

10 months ago

Features/Enhancements 🚀

feat: Airflow Data Pipeline Construct by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/349
feat: MWAA Stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/359
feat: Update StateMachineStage to use definitionBody instead of deprecated definition by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/372
feat: make crawler optional in GlueTransformStage() by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/378
feat: adding env to synth action props by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/379

Fixes 🛠️

chore: Security Remediation by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/364
chore: Update integ-tests structure by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/339
chore: upgrade deps for security fixes by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/380

Packages 🗳️

npm
pypi

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.0.1...v1.1.0

v1.0.1

11 months ago

1.0.1 (2023-06-13)

Fixes 🛠️

account/region determination in getStackSynthesizer (#347) (34dbe7e) by @malachi-constant
Adding cfnNagFailBuild parameter (#337) (a5c3264) by @malachi-constant
make 'configPath' optional (#343) (689c795) by @malachi-constant
removing default environment id from get stack synthesizer method (#352) (0fe3827) by @malachi-constant

Packages 🗳️

npm
pypi

v1.0.0

11 months ago

New functionality & Breaking Changes 🚀

Source code is now written in Typescript and uses JSII to package both python and typescript versions of the library. In the near future we will add support for all AWS CDK supported programming languages.
A new optional config construct Configurator() has been implemented to replace the required Config() construct from earlier verisons.
The DDK CLI has been deprectated. Projects that were bootstrapped using ddk bootstrap will still be supported.
New stages have been added
- RedshiftDataApiStage()
- SnsSqsToLambdaStage()

See upgrade guide for specifics on breaking changes: Upgrade Guide

Tutorials

See other guides here

Features/Enhancements 🚀

Updating AthenaSQL stage to handle multiple queries (#317) (0259ace)
getEnvironment() (#307) (98bd743)
Add support for RemovalPolicy in config (#306) (8799d19)
Add type interface for configuration (#308) (c5e6375)
CICDPipelineStack() updates (#283) (cca11f6)
Add data assertions for S3 -> SQS -> Lambda pipeline (#242) (57da74a)
Add FirehoseToS3Stage and tests (#151) (03216e5)
Add support for Python in JSII and upgrade CDK version (#148) (c6343fc)
Adding core.cicd (#139) (9e5a22b)
Adds glueJob and crawlerName to GlueTransform stage properties (#266) (18ca06d)
appflow ingestion stage (#222) (3b659ea)
appflow stage refactor (#230) (1c84169)
athena sql stage (#145) (f2594e9)
configuration by resource ids (#284) (6b0120f)
ddk configurator (#254) (9b7f48d), closes #247
resource naming refactor (#233) (9d0d76f)
Set up project metadata (#136) (3647747)
sns to lambda stage (#252) (709df57)
standardize defaults approach in ddk core (#258) (c2fa8ea)
Support local package path install in CICD synth action pre-public release (#160) (0e01da8)
Supporting minimal resource factories for 1.x.x (#290) (da9ee85)
syncing GlueTransformStage to main (#262) (8ce3623)
Typescript catchup -> 0.6.1 (#214) (a7bc0cc)
Typescript conversion of GlueTransformStage (#152) (041ad13)

Fixes 🛠️

athena integration test (#326) (bcb9940)
Configurator missing legacy ddk bootstrap values (#319) (300f0fc)
Beta Testing Fixes (#296) (e1db71c)
cicd environment support (#280) (dbc8bfc)
convert utility methods to static (#269) (77fdf71)
Fix typescript s3 event pattern (#149) (fb33536)
move getEnvConfig() to static method (#270) (06d19e1)
Remove whitespace from glue job sec configuration Id (#275) (3fa0ecd)
static method Configurator.getEnvConfig() (#282) (b2dc1f7)

Documentation 📚

Add documentation for the stages (#311) (2c8e3eb)
Fix documentation structure & add docs for BaseStack and CICDPipelineStack (#310) (11d5a1e)

Packages 🗳️

npm
pypi

Tests 🧪

Integration Testing (#235) (6c2ba10)
Integration Tests: Additional Coverage (#238) (fdad682)

New Contributors

@malachi-constant
@anmolsgandhi
@kukushking
@jaidisido
@cnfait
@LeonLuttenberger made their first contribution in https://github.com/awslabs/aws-ddk/pull/136
@EgorDm made their first contribution in https://github.com/awslabs/aws-ddk/pull/279

Full Changelog: https://github.com/awslabs/aws-ddk/compare/0.6.2...v1.0.0

v1.0.0-rc.0

1 year ago

Features & Enhancements 🚀

feat: Add documentation for stages by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/311
feat: Updating AthenaSQL stage to handle multiple queries by @anmolsgandhi in https://github.com/awslabs/aws-ddk/pull/317
chore: Configurator refactor by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/315
chore: Configurator: change return type of getEnvironment to cdk.Environment by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/318
chore: Minor fixes to homepage by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/320
chore: Fix IDs in custom stage tutorial by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/321
chore: Clarify acronym in Private Artifactory docs page by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/322
chore: Fix the code snippets for multi account deployments by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/323
chore: Fix language tabs & config json in configurator how-to by @kukushking in https://github.com/awslabs/aws-ddk/pull/324

Bug Fixes 🪲

fix: Fix documentation structure & add docs for BaseStack and CICDPipelineStack by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/310
fix: Configurator missing legacy ddk bootstrap values by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/319
fix: athena integration test by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/326

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.0.0-beta.1...v1.0.0-rc.0

Packages 🗳️

npm
pypi

v1.0.0-beta.1

1 year ago

Features & Enhancements 🚀

feat: getEnvironment() by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/307
feat: Add support for RemovalPolicy in config by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/306
feat: Add type interface for configuration by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/308

Bug Fixes 🪲

fix: Beta Testing Fixes by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/296

Full Changelog: https://github.com/awslabs/aws-ddk/compare/v1.0.0-beta.0...v1.0.0-beta.1

v1.0.0-beta.0

1 year ago

(Beta) Major Version Upgrade ☀️

The AWS DDK library is now written in typescript with JSII compatibility to support multiple CDK programming languages.
- Python 🐍 & Typescript ☕ will be supported initially with more languages to come soon.

Features & Enhancements 🎠

feat: Set up project metadata by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/136
feat: Created DataStage, DataPipeline and SQSToLambda constructs by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/138
feat: Adding core.cicd by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/139
feat: Implement S3EventStage in Typescript by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/143
feat: Implement BaseStack in Typescript by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/146
feat: athena sql stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/145
feat: Add support for Python in JSII and upgrade CDK version by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/148
feat: Revert "Implement BaseStack in Typescript (#146)" by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/153
feat: Typescript conversion of GlueTransformStage by @kukushking in https://github.com/awslabs/aws-ddk/pull/152
feat: Add FirehoseToS3Stage and tests by @jaidisido in https://github.com/awslabs/aws-ddk/pull/151
feat: Support local package path install in CICD synth action pre-public release by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/160
feat: Typescript catchup -> 0.6.1 by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/214
feat: Change GlueTransformStage to support creating job and crawler by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/217
feat: appflow ingestion stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/222
feat: DataBrewTranformStage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/224
feat: Add schedule support to DataPipeline.add_stage() by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/226
feat: Replace CustomTask with CallAwsService in GlueTransform stage by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/229
feat: appflow stage refactor by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/230
feat: resource naming refactor by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/233
feat: Integration Testing by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/235
feat: Integration Tests: Additional Coverage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/238
feat: Add data assertions for S3 -> SQS -> Lambda pipeline by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/242
feat: ddk configurator by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/254
feat: syncing GlueTransformStage to main by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/262
feat: syncing AthenaSqlStage to main by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/264
feat: standardize defaults approach in ddk core by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/258
feat: Adds glueJob and crawlerName to GlueTransform stage properties by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/266
feat: configuration by resource ids by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/284
feat: CICDPipelineStack() updates by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/283
feat: New Stage: Redshift Data API by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/285
feat: Supporting minimal resource factories for 1.x.x by @malachi-constant in https://github.com/awslabs/
feat: sns to lambda stage by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/252

Fixes & Refactoring 💫

fix: Fix typescript s3 event pattern by @kukushking in https://github.com/awslabs/aws-ddk/pull/149
chore: Setting up Prettier code formatting by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/154
fix: CICD: Presynth install commands -> optional by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/162
chore: Refactor creation of state machine by @LeonLuttenberger in https://github.com/awslabs/aws-ddk/pull/221
chore: Increase Coverage of tests by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/227
chore: Add CONTRIBUTING.md by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/228
chore: Integration fix s3 removal policy by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/260
fix: moving appflow stage lambda code inline by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/268
fix: convert utility methods to static by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/269
fix: move getEnvConfig() to static method by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/270
fix: getConfigAttribute condition by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/273
fix: Remove whitespace from glue job sec configuration Id by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/275
fix: Change default for state_machine_input to undefined by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/276
fix: cicd environment support by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/280
fix: static method Configurator.getEnvConfig() by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/282
chore: Configurator() resource id refactor by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/286 aws-ddk/pull/290
chore: dependency upgrade by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/292
chore: release 1.0.0 beta.0 by @malachi-constant in https://github.com/awslabs/aws-ddk/pull/293

New Contributors 🌱

@LeonLuttenberger made their first contribution in https://github.com/awslabs/aws-ddk/pull/136

Full Changelog: https://github.com/awslabs/aws-ddk/commits/v1.0.0-beta.0