Koku Versions Save

Summary:

Small bug fix around OCP on Cloud infrastructure matching for correlating OpenShift metrics with Cloud billing costs Updated dependencies and improving security around credentials

What's Changed

• update dependencies by @maskarb in https://github.com/project-koku/koku/pull/5035
• Bump sqlparse from 0.4.4 to 0.5.0 in the pip group across 1 directory by @dependabot in https://github.com/project-koku/koku/pull/5043
• Add dev doc about worker unallocated distribution by @myersCody in https://github.com/project-koku/koku/pull/5041
• COST-4807 mount aws credentials as volume by @maskarb in https://github.com/project-koku/koku/pull/5022
• update sqlparse and gunicorn by @maskarb in https://github.com/project-koku/koku/pull/5047
• COST-4947 Remove account and region from ProviderInfrastructureMap filter by @cgoodfred in https://github.com/project-koku/koku/pull/5049

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.04.16.0...r.2024.04.18.0

Summary:

• COST-4372 fix inflated PVC capacity count on reports/openshift/volumes/ endpoint by aggregating the max counts
• updates in preparation for a major Trino upgrade

What's Changed

• add smoke_test shell script back by @cgoodfred in https://github.com/project-koku/koku/pull/5036
• Mark smoke_test.sh as an executable file by @cgoodfred in https://github.com/project-koku/koku/pull/5037
• rename components to trino in smoke_test.sh by @cgoodfred in https://github.com/project-koku/koku/pull/5038
• COST-4372 Use Max for volume capacity count by @djnakabaale in https://github.com/project-koku/koku/pull/5032
• Update delayed resummary logic for ocp on cloud. by @myersCody in https://github.com/project-koku/koku/pull/5027
• COST-4626 strip acct from schema in parquet converter by @maskarb in https://github.com/project-koku/koku/pull/5039
• COST-4626 bump parquet converter version by @maskarb in https://github.com/project-koku/koku/pull/5040

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.04.15.0...r.2024.04.16.0

Summary:

• address numerous SAST results
• RBAC: enable OCP lower level access (project/node) when only the highest level (cluster) is enabled
• In this release, we've addressed an edge case concerning Worker unallocated distribution. Previously, the Worker unallocated cost was not negated after distributing costs for clusters whose worker nodes reported zero CPU capacity, resulting in inflated costs due to Worker unallocated costs counting twice.

What's Changed

• COST-4874 address shellcheck warnings by @maskarb in https://github.com/project-koku/koku/pull/5023
• Upgrade Codecov action by @samdoran in https://github.com/project-koku/koku/pull/5024
• COST-4807 Remove remove-stale from enabled tags masu endpoint options by @cgoodfred in https://github.com/project-koku/koku/pull/5007
• COST-4715 sentry -> glitchtip cleanup p2 by @maskarb in https://github.com/project-koku/koku/pull/5012
• COST-4764 Set lower level rbac roles when only top level are set for OpenShift cluster/node/project by @lcouzens in https://github.com/project-koku/koku/pull/5020
• COST-4757 Remove custom Unleash strategies by @lcouzens in https://github.com/project-koku/koku/pull/5021
• COST-4822 Remove cluster from OCPAWS tag matching SQL by @cgoodfred in https://github.com/project-koku/koku/pull/5026
• COST-4785 Worker unallocated cost not negated after distribution by @myersCody in https://github.com/project-koku/koku/pull/4999
• COST-3761 Add models for OCP node networking costs by @samdoran in https://github.com/project-koku/koku/pull/4968
• COST-4877 Report correct PostgreSQL version by @samdoran in https://github.com/project-koku/koku/pull/5019
• add provider-billing-source to sources masu endpoint by @maskarb in https://github.com/project-koku/koku/pull/4984
• rename variables for "COPY_PASTE_ERROR" by @maskarb in https://github.com/project-koku/koku/pull/5025
• chore(image): update base image by @github-actions in https://github.com/project-koku/koku/pull/5018
• Bump pillow from 10.2.0 to 10.3.0 by @dependabot in https://github.com/project-koku/koku/pull/5017
• COST-4895 create tmp dir for build-deploy by @maskarb in https://github.com/project-koku/koku/pull/5028
• COST-4736 Fix local strategies by @lcouzens in https://github.com/project-koku/koku/pull/5029
• rename presto -> trino in app-interface by @maskarb in https://github.com/project-koku/koku/pull/5030
• COST-4626 return pd.NaT instead of None for custom date converters by @maskarb in https://github.com/project-koku/koku/pull/5034
• chore(image): update base image by @github-actions in https://github.com/project-koku/koku/pull/5033

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.04.08.0...r.2024.04.15.0

Summary:

In this release, we've made some security improvements and other minor changes.

What's Changed

• Upgrade unleash for local development by @samdoran in https://github.com/project-koku/koku/pull/4996
• Add make target to run local snyk scan by @samdoran in https://github.com/project-koku/koku/pull/4906
• COST-4828 Handle 0 in divisor for cost distribution SQL by @cgoodfred in https://github.com/project-koku/koku/pull/5008
• COST-4715 sentry -> glitchtip cleanup p1 by @maskarb in https://github.com/project-koku/koku/pull/5010
• COST-4715 sentry -> glitchtip cleanup p1 by @maskarb in https://github.com/project-koku/koku/pull/5011
• COST-4704 Update django to 4.2.11 to address CVE-2024-27351 by @djnakabaale in https://github.com/project-koku/koku/pull/5009
• COST-4372 OCP: Fix capacity instance count by @djnakabaale in https://github.com/project-koku/koku/pull/4964
• COST-4835 validate tag uuids by @maskarb in https://github.com/project-koku/koku/pull/5014
• COST-4807 Make provider_uuid not a query param and parameterize bigquery queries by @cgoodfred in https://github.com/project-koku/koku/pull/5005
• chore(image): update base image by @github-actions in https://github.com/project-koku/koku/pull/5016
• COST-4775 add v3.2.1 commit shas by @maskarb in https://github.com/project-koku/koku/pull/4982

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.03.28.0...r.2024.04.08.0

What's Changed

• COST-4802 Add conversion field to kafka message for Subscriptions by @cgoodfred in https://github.com/project-koku/koku/pull/4995
• Revert "[COST-4794] Deduplicate parent keys for tag mapping." by @myersCody in https://github.com/project-koku/koku/pull/4997
• COST-4423 Fix which manifest is getting updated during summary flows specifically for OCP on Cloud tasks by @lcouzens in https://github.com/project-koku/koku/pull/5000
• COST-3607, COST-4627] create model for daily key metrics data by @maskarb in https://github.com/project-koku/koku/pull/4989
• COST-4814 Fix inconsistent ordering for tag mapping by @myersCody in https://github.com/project-koku/koku/pull/5004
• COST-4801 Added a tracing id to the delayed celery task by @myersCody in https://github.com/project-koku/koku/pull/4998
• COST-4759 Add unleash flag for all labels field by @myersCody in https://github.com/project-koku/koku/pull/5002
• COST-4807 rename constant to prevent CWE-547 false-positive by @maskarb in https://github.com/project-koku/koku/pull/5003

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.03.25.0...r.2024.03.28.0

Minor Changes

• COST-4390 OCP changing GB to GiB by @bacciotti in https://github.com/project-koku/koku/pull/4938
• COST-4394 Fixing OCI GB and TB calculations by @bacciotti in https://github.com/project-koku/koku/pull/4974
• COST-4219 Update masu manifest endpoint filters by @cgoodfred in https://github.com/project-koku/koku/pull/4944
• COST-4459 Normalize product IDs for subs variants by @cgoodfred in https://github.com/project-koku/koku/pull/4950
• COST-4121 OpenAPI spec update: new unit (GiB) used on OCP by @bacciotti in https://github.com/project-koku/koku/pull/4972
• COST-4578 Add v3.2.0 operator commit mapping by @maskarb in https://github.com/project-koku/koku/pull/4971
• COST-4423 Cluster info include timestamps by @lcouzens in https://github.com/project-koku/koku/pull/4970
• Increase gunicorn workers for sources client by @samdoran in https://github.com/project-koku/koku/pull/4988
• Add populate exchange rates make command by @maskarb in https://github.com/project-koku/koku/pull/4990

Bug Fixes

• COST-4714 Explicitly check for Tenant existence in KokuTenantSchemaExistsMiddleware by @maskarb in https://github.com/project-koku/koku/pull/4941
• COST-4537 Update crytography and oci by @samdoran in https://github.com/project-koku/koku/pull/4962
• COST-4643 Use cascade_delete to remove expired CostUsageReportManifest by @maskarb in https://github.com/project-koku/koku/pull/4969
• COST-4730 Fixing pagination to paginate by parent instead of by children by @bacciotti in https://github.com/project-koku/koku/pull/4965
• COST-4750 Fix regression caused by bad cast in trino by @myersCody in https://github.com/project-koku/koku/pull/4977
• COST-4765 Fix org unit join by @maskarb in https://github.com/project-koku/koku/pull/4973
• COST-4423 Fix OCP-GCP summary timestamp issue by @lcouzens in https://github.com/project-koku/koku/pull/4978
• Catch non-existent manifest for ocp-on-cloud infra provider by @maskarb in https://github.com/project-koku/koku/pull/4993

Upcoming Features

Tag Mapping

• COST-4686 Handling tag rates in tag mapping by @myersCody in https://github.com/project-koku/koku/pull/4939
• COST-4729 Fix ordering for tag mapping API by @myersCody in https://github.com/project-koku/koku/pull/4957
• COST-4716 Prevent removal of stale tags linked to a mapping by @myersCody in https://github.com/project-koku/koku/pull/4948
• COST-4750 OCP Scrub disabled tags in trino by @myersCody in https://github.com/project-koku/koku/pull/4961
• COST-4752 Azure scrub disabled tags in trino by @myersCody in https://github.com/project-koku/koku/pull/4967
• COST-4772 Tag mapping multiple filter functionality by @myersCody in https://github.com/project-koku/koku/pull/4976
• COST-4794 Deduplicate parent keys for tag mapping by @myersCody in https://github.com/project-koku/koku/pull/4991
• COST-4751 GCP Scrub disabled tags in Trino by @myersCody in https://github.com/project-koku/koku/pull/4966

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.03.05.0...r.2024.03.25.0

Summary:

In this release, we've focused on addressing various bug fixes, a few enhancements, and laid the groundwork for upcoming features, such as updating the OCI summary table for tag mappings and fixing tag mapping parent-child filters. Bug fixes include resolving issues related to Azure subscription names, a missed migration, and ensuring correct annotation for AWS Group By ranks. Enhancements include mapping Azure columns and improving observability.

What's Changed

Bug Fixes

• [COST-4313] - Fix azure subscription_name issue by @lcouzens in https://github.com/project-koku/koku/pull/4935
• [COST-4313] - subscription_name migrations by @lcouzens in https://github.com/project-koku/koku/pull/4934
• [COST-4295] AWS Group by ranks only annotate if account in group by by @cgoodfred in https://github.com/project-koku/koku/pull/4949
• [COST-4713] Azure OpenShift daily trino migration by @cgoodfred in https://github.com/project-koku/koku/pull/4958

Enhancement

• [COST-4662] Map Azure columns to expected names from TRINO_REQUIRED_COLUMNS by @cgoodfred in https://github.com/project-koku/koku/pull/4930
• [COST-4604] - Catch more failures correctly for observability by @lcouzens in https://github.com/project-koku/koku/pull/4951

Others

• [COST-4728] Log the AWS region by @samdoran in https://github.com/project-koku/koku/pull/4955
• Set pr-check timeouts based on label by @esebesto in https://github.com/project-koku/koku/pull/4956

Upcoming Features:

Tag Mapping

• [COST-4592] Update OCI summary table for tag mappings by @bacciotti in https://github.com/project-koku/koku/pull/4945
• [COST-4727] Fix tag mapping parent child filters. by @myersCody in https://github.com/project-koku/koku/pull/4954

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.03.04.0...r.2024.03.05.0

Summary:

• Bug Fixes
• Enhancements
• Upcoming Features

What's Changed

Bug Fixes

• [COST-4423] - update missed sql file for cluster info by @lcouzens in https://github.com/project-koku/koku/pull/4942
• Fix leap year unittest failures. by @myersCody in https://github.com/project-koku/koku/pull/4953
• [COST-4713] Handle Azure billingcurrency column by @esebesto in https://github.com/project-koku/koku/pull/4946

Enhancement

• [COST-4715] add glitchtip config by @maskarb in https://github.com/project-koku/koku/pull/4952

Upcoming Features

Cluster Info

• [COST-4623] - Migration to remove old fields by @lcouzens in https://github.com/project-koku/koku/pull/4882
• [COST-4423] - Migration to add account & region to infra map. by @lcouzens in https://github.com/project-koku/koku/pull/4932
• [COST-4423] - Initial work for cluster/source info page by @lcouzens in https://github.com/project-koku/koku/pull/4924

Tag Mapping

• [COST-4644] OCP tag key mapping. by @myersCody in https://github.com/project-koku/koku/pull/4927
• [COST-4571] Add env vars for delayed summary. by @myersCody in https://github.com/project-koku/koku/pull/4943
• [COST-4571] Migrations for delayed celery task table by @myersCody in https://github.com/project-koku/koku/pull/4940
• [COST-3830] Prevent disabling mapped tags. by @myersCody in https://github.com/project-koku/koku/pull/4947
• [COST-4571] Mechanism to delay summary for settings by @myersCody in https://github.com/project-koku/koku/pull/4933

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.02.26.0...r.2024.03.04.0

Summary:

• Django 4 upgrade
• Initial work on tag mapping feature for Azure, OCP on Azure, GCP and OCP on GCP providers
• Numerous bug fixes and code cleanups

What's Changed

• [COST-2231] Upgrade to Django 4 by @djnakabaale in https://github.com/project-koku/koku/pull/4844
• add operator versions by @maskarb in https://github.com/project-koku/koku/pull/4925
• OCI: Making unit conversion CASE statement cleaner. by @bacciotti in https://github.com/project-koku/koku/pull/4922
• [COST-4423] - Finish removing dead code by @lcouzens in https://github.com/project-koku/koku/pull/4926
• chore(image): update base image by @github-actions in https://github.com/project-koku/koku/pull/4928
• [COST-4590] Azure, OCP on Azure tag key mapping. by @myersCody in https://github.com/project-koku/koku/pull/4916
• Go back to using django-redis by @samdoran in https://github.com/project-koku/koku/pull/4931
• [COST-4591] GCP, OCP on GCP tag mapping. by @myersCody in https://github.com/project-koku/koku/pull/4921
• [COST-4682] fix "Infastructure" typo by @maskarb in https://github.com/project-koku/koku/pull/4936
• chore(image): update base image by @github-actions in https://github.com/project-koku/koku/pull/4937
• [COST-4588] Optimize AWS tag mapping sql by @myersCody in https://github.com/project-koku/koku/pull/4923

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.02.19.0...r.2024.02.26.0

Summary:

• Add new report status information for monitoring ingest process for a provider
• New masu endpoint to make use of new report status info
• Add initial tag mapping work for OCP on AWS tag key mappings
• Numerous bug fixes and enhancements.

What's Changed

• Update ocp-smoke-tests by @esebesto in https://github.com/project-koku/koku/pull/4891
• [COST-4603] - Adding enhanced report status info by @lcouzens in https://github.com/project-koku/koku/pull/4896
• [COST-4603] - Minor fix to handle manifest state as null by @lcouzens in https://github.com/project-koku/koku/pull/4914
• chore(image): update base image by @github-actions in https://github.com/project-koku/koku/pull/4895
• [COST-3829] API to read/update source/target tag mappings by @bacciotti in https://github.com/project-koku/koku/pull/4905
• [COST-4588] Aws, OCP on Aws tag key mapping. by @myersCody in https://github.com/project-koku/koku/pull/4901
• [COST-3749] GCP credits not included in OCP on ALL costs by project by @myersCody in https://github.com/project-koku/koku/pull/4915
• [COST-4601] Masu manifest endpoint to utilize new manifest fields by @cgoodfred in https://github.com/project-koku/koku/pull/4911
• [COST-4394] Inserting the 'TB_MS' clause in WHEN by @bacciotti in https://github.com/project-koku/koku/pull/4917
• [COST-4602] remove redundant code prior to migration by @lcouzens in https://github.com/project-koku/koku/pull/4912
• [COST-4219] - Fix wrongly updated manifest state by @lcouzens in https://github.com/project-koku/koku/pull/4919
• [COST-4394] Removing unrelated unit test by @bacciotti in https://github.com/project-koku/koku/pull/4918
• Remove aws org unit load from load-test-customer-data. by @myersCody in https://github.com/project-koku/koku/pull/4920
• [COST-4589] Correctly get end of month data for Azure Metering by @cgoodfred in https://github.com/project-koku/koku/pull/4897

Full Changelog: https://github.com/project-koku/koku/compare/r.2024.02.13.0...r.2024.02.19.0