Poseidon Typhoon Versions Save

• Kubernetes v1.25.1
• Update etcd from v3.5.4 to v3.5.5
• Update Cilium from v1.12.1 to v1.12.2
• Update Calico from v3.23.3 to v3.24.1
• Revert Kubelet Graceful Node Shutdown on worker nodes (#1227)
  • Fix issue where non-critical pods are left in Error/Completed state on node shutdown
• Remove feature flag disable workaround for kubernetes/kubernetes#112081
  • Kubernetes reverted LocalStorageCapacityIsolationFSQuotaMonitoring back to alpha
• Remove workaround for preventing search . propagation in kubernetes/kubernetes#112135
  • Upstream Kubernetes fix

Addons

• Update kube-state-metrics from v2.5.0 to v2.6.0
• Update ingress-nginx from v1.3.0 to v1.3.1
• Update Grafana from v9.1.0 to v9.1.6

• Kubernetes v1.25.0
  • Disable LocalStorageCapacityIsolationFSQuotaMonitoring feature gate (#1220, fixes kubernetes#112081)
  • Add workaround to revert adding "search ." to containers' /etc/resolv.conf (#1224, fixes kubernetes#112135)
• Migrate most Kubelet flags to KubeletConfiguration file (#1219)
• Configure Kubelet Graceful Node Shutdown (#1222)
  • Allow up to 30s for critical pods to gracefully shutdown on node shutdown
  • Allow up to 15s for regular pods to gracefully shutdown on node shutdown
  • Mark node NotReady promptly on node shutdown
  • Lengthen systemd inhibitor lock max delay from 5s to 45s

Fedora CoreOS

• Change Podman log-driver from journald to k8s-file (#1221)
  • Fix etcd-member and Kubelet systemd service log lines appearing twice in journal logs

• Kubernetes v1.24.4
• Update CoreDNS from v1.8.6 to v1.9.3
• Update Cilium from v1.11.7 to v1.12.1
• Update Calico from v3.23.1 to v3.23.3
• Switch Kubernetes registry from k8s.gcr.io to registry.k8s.io (#1206)
• Remove use of deprecated Terraform template provider (#1194)

Flatcar Linux

• Migrate Flatcar Linux from Ignition spec v2.3.0 to v3.3.0 (#1196) (action required)
  • Flatcar Linux 3185.0.0+ supports Ignition v3.x specs (which are rendered from Butane Configs, like Fedora CoreOS)
  • poseidon/ct v0.11.0 supports the flatcar Butane Config variant
  • Require poseidon/ct v0.11+ and Flatcar Linux 3185.0.0+
• Please modify any Flatcar Linux snippets to use the Butane Config format (action required)

variant: flatcar
version: 1.0.0
...

Fedora CoreOS

• Remove ineffective /etc/fedora-coreos/iptables-legacy.stamp (#1201)
  • Typhoon already uses iptables v1.8.7 (nf_tables) since FCOS 36
  • Staying on legacy iptables required a file in /etc/coreos instead

AWS

• Refresh instances in autoscaling group when launch configuration changes (#1208) (docs, important)
  • Worker launch configuration changes start an autoscaling group instance refresh to replace instances
  • Instance refresh creates surge instances, waits for a warm-up period, then deletes old instances
  • Changing worker_type, disk_*, worker_price, worker_target_groups, or Butane worker_snippets on existing worker nodes will replace instances
  • New AMIs or changing os_stream will be ignored, to allow Fedora CoreOS or Flatcar Linux to keep themselves updated
  • Previously, new launch configurations were made in the same way, but not applied to instances unless manually replaced
• Rename worker autoscaling group ${cluster_name}-worker (#1202)
  • Rename launch configuration ${cluster_name}-worker instead of a random id

Google

• Roll instance template changes to worker managed instance groups (#1207) (docs, important)
  • Worker instance template changes roll out by gradually replacing instances
  • Automatic rollouts create surge instances, wait for health checks, then delete old instances (0 unavailable instances)
  • Changing worker_type, disk_size, worker_preemptible, or Butane worker_snippets on existing worker nodes will replace instances
  • New compute images or changing os_stream will be ignored, to allow Fedora CoreOS or Flatcar Linux to keep themselves updated
  • Previously, new instance templates were made in the same way, but not applied to instances unless manually replaced
• Add health checks to worker managed instance groups (i.e. "autohealing") (#1207)
  • Use health checks to probe kube-proxy every 30s
  • Replace worker nodes that fail the health check 6 times (3min)
• Name kube-apiserver and worker health checks consistently (#1207)
  • Use name ${cluster_name}-apiserver-health and ${cluster_name}-worker-health
• Rename managed instance group from ${cluster_name}-worker-group to ${cluster_name}-worker (#1207)
• Fix bug provisioning clusters with multiple controller nodes (#1195)

Addons

• Update Prometheus from v2.37.0 to v2.38.0
• Update Grafana from v9.0.3 to v9.1.0

• Kubernetes v1.24.3
• Update Cilium from v1.11.6 to v1.11.7

Addons

• Update ingress-nginx from v1.2.1 to v1.3.0
• Update Prometheus from v2.36.1 to v2.37.0
• Update Grafana from v8.5.6 to v9.0.3

Notes

• Poseidon repos will soon change their default branch from master to main

• Kubernetes v1.24.2
• Update Cilium from v1.11.5 to v1.11.6
• Update Calico from v3.22.2 to v3.23.1

Addons

• Update Prometheus from v2.36.0 to v2.36.1
• Update Grafana from v8.5.3 to v8.5.6
• Update kube-state-metrics from v2.4.2 to v2.5.0

Known Issues

• Skip AWS Terraform provider v4.17.0 to v4.19.0, which had a regression affecting workers joining (#1173)

• Kubernetes v1.24.1
• Update Cilium from v1.11.4 to v1.11.5

Addons

• Update Prometheus from v2.35.0 to v2.36.0
• Update Grafana from v8.5.1 to v8.5.3
• Update nginx-ingress from v1.2.1 to v1.2.1

• Kubernetes v1.24.0
• Update etcd from v3.5.2 to v3.5.4
• Add Kubelet mounts to enable relabeling workload volumes (#1152)
  • StorageClass no longer require explicit SELinux mount contexts

Addons

• Update nginx-ingress from v1.1.3 to v1.2.0
• Update Prometheus from v2.34.0 to v2.35.0
• Update Grafana from v8.4.5 to v8.5.1

• Kubernetes v1.23.6
• Update Cilium from v1.11.2 to v1.11.4
• Rename Cilium DaemonSet from cilium-agent to cilium to match Cilium CLI tools (#303)
• Update Calico from v3.22.1 to v3.22.2
• Mount /etc/machine-id from host into Kubelet (#1143)
• Remove deprecated use of key_algorithm in hashicorp/tls resources

Azure

• Allow upgrading Azure Terraform provider to v3.x (#1144)
• Rename worker_address_prefix output to worker_address_prefixes

Google Cloud

• Fix issue on Flatcar Linux with controller nodes not ignoring os image changes (#1149)
  • Nodes will auto-update, Terraform should not attempt to delete/recreate them

Addons

• Update nginx-ingress from v1.1.2 to v1.1.3
• Update Prometheus from v2.33.5 to v2.34.0
• Update Grafana from v8.4.4 to v8.4.5

• Kubernetes v1.23.5
• Update Cilium from v1.11.1 to v1.11.2
• Update Calico from v3.21.2 to v3.22.1
  • Fix calico#5011, broken since v1.23.0

Addons

• Refresh Prometheus rules and Grafana dashboards (#1136)
• Update nginx-ingress from v1.1.1 to v1.1.2
• Update Prometheus from v2.33.3 to v2.33.5
• Update Grafana from v8.4.1 to v8.4.3
• Update kube-state-metrics from v2.3.0 to v2.4.2

• Kubernetes v1.23.4
• Update etcd from v3.5.1 to v3.5.2
• Change default CNI networking provider from calico to cilium (#1114)

AWS

• Allow upgrading AWS Terraform Provider to v4.x

Addons

• Align nginx-ingress --controller-class with IngressClass
  • Watch only public IngressClass objects, better example
• Update Prometheus from v2.32.1 to v2.33.3
• Update Grafana from v8.3.6 to v8.4.1