Akvorado Versions Save

• 🩹 orchestrator: do not use AS names from GeoIP as tenant for networks
• 🩹 inlet: fix sampling rate parsing for IPFIX packets using "packet interval"
• 🩹 inlet: fix inlet→metadata→providers→targets for gNMI provider

Docker image: docker pull ghcr.io/akvorado/akvorado:1.10.2 Full changelog: https://github.com/akvorado/akvorado/compare/v1.10.1...v1.10.2

• 🩹 inlet: fix versioning of metadata cache
• 🩹 orchestrator: fix panic in networks CSV refresher

Docker image: docker pull ghcr.io/akvorado/akvorado:1.10.1 Full changelog: https://github.com/akvorado/akvorado/compare/v1.10.0...v1.10.1

On this release, geo IP is now performed in ClickHouse instead of inlet. When using the standard docker compose setup, the configuration should be automatically migrated from the inlet component to the clickhouse component. This also changes how geo IP is used for AS numbers: geo IP is used as last resort when configured. It also increases memory usage (1.3GB for ClickHouse).

Another new feature is the ability to use a ClickHouse cluster deployment. This is enabled when specifying a cluster name in clickhouse→cluster. There is no automatic migration of an existing database. You should start from scratch and copy data from the previous setup. Do not try to enable the cluster mode on existing setup!

New installations should also get better compression and performance from the main table, due to a change to the primary key used for this table. Check this Altinity article if you want to apply the change on your installation.

Support for Docker Compose V1 (docker-compose command) has been removed in favor of Docker Compose V2 (docker compose command). On Ubuntu/Debian systems, this means you can no longer use the docker-compose package. On Ubuntu, you can install the docker-compose-v2 package. For other options, check the documentation for installing the Compose plugin.

• 💥 inlet: GeoIP data is moved from inlets to ClickHouse, add city and region
• 💥 console: persist console database on the default docker compose setup
• 💥 docker: remove support for docker-compose V1
• ✨ orchestrator: add support for ClickHouse clusters
• ✨ inlet: add gNMI metadata provider
• ✨ inlet: static metadata provider can provide exporter and interface metadata
• ✨ inlet: static metadata provider can fetch its configuration from an HTTP endpoint
• ✨ inlet: metadata can be fetched from multiple providers (eg, static, then SNMP)
• ✨ inlet: add support for several SNMPv2 communities
• ✨ inlet: timestamps for Netflow/IPFIX can now be retrieved from packet content, see inlet→flow→inputs→timestamp-source
• 🩹 cmd: fix parsing of inlet→metadata→provider→ports
• 🩹 console: fix use of InIfBoundary and OutIfBoundary as dimensions
• 🌱 orchestrator: add TLS support to connect to ClickHouse database
• 🌱 docker: update to Redis 7.2, Kafka 3.7, Kafka UI 0.7.1, and Zookeeper 3.8 (not mandatory)
• 🌱 orchestrator: improved ClickHouse schema to increase performance

Docker image: docker pull ghcr.io/akvorado/akvorado:1.10.0 Full changelog: https://github.com/akvorado/akvorado/compare/v1.9.3...v1.10.0

• 💥 inlet: many metrics renamed to match Prometheus best practices
• ✨ inlet: add the following collected data (disabled by default): MPLSLabels, MPLS1stLabel, MPLS2ndLabel, MPLS3rdLabel, and MPLS4thLabel
• 🩹 inlet: fix static metadata provider configuration validation
• 🩹 inlet: fix a performance regression when enriching flows
• 🩹 inlet: do not decode L4 header if IP packet is fragmented
• 🩹 inlet: handle exporters using several sampling rates
• 🌱 docker: update ClickHouse to 23.8 (this is not mandatory)
• 🌱 orchestrator: add orchestrator→clickhouse→prometheus-endpoint to configure an endpoint to expose metrics to Prometheus

Docker image: docker pull ghcr.io/akvorado/akvorado:1.9.3 Full changelog: https://github.com/akvorado/akvorado/compare/v1.9.2...v1.9.3

This is a bugfix release to workaround a change in ClickHouse Docker image where the init script is executed only once. It affects you if you modify the Akvorado's schema or ClickHouse settings.

• 🩹 docker: ensure ClickHouse init script is executed even when database already exists

Docker image: docker pull ghcr.io/akvorado/akvorado:1.9.2 Full changelog: https://github.com/akvorado/akvorado/compare/v1.9.1...v1.9.2

• 🌱 console: add filtering support for custom columns
• 🌱 inlet: update Expr, the language behind the classifiers: support for variables
• 🌱 inlet: support for RFC 7133 for IPFIX
• 🌱 orchestrator: improve performance when looking up for SrcNetPrefix and DstNetPrefix when these columns are materialized

Docker image: docker pull ghcr.io/akvorado/akvorado:1.9.1 Full changelog: https://github.com/akvorado/akvorado/compare/v1.9.0...v1.9.1

• 💥 cmd: use AKVORADO_CFG_ as a prefix for environment variables used to modify configuration (AKVORADO_CFG_ORCHESTRATOR_HTTP_LISTEN instead of AKVORADO_ORCHESTRATOR_HTTP_LISTEN)
• 💥 inlet: inlet→metadata→provider(snmp)→ports is now a map from exporter subnets to ports, instead of a map from agent subnets to ports. This is aligned with how communities and security-parameters options behave.
• ✨ inlet: support for IPinfo geo IP database and use it by default
• ✨ inlet: metadata retrieval is now pluggable. In addition to SNMP, it is now possible to set exporter names, interface names and descriptions directly in the configuration file. See inlet→metadata.
• ✨ inlet: routing information is now pluggable. See inlet→routing.
• ✨ inlet: BioRIS provider to retrieve routing information
• ✨ inlet: allow extraction of prefix length from routing information. See inlet→core→net-providers.
• ✨ inlet: add the following collected data (disabled by default):
  • IPTTL
  • IPTos
  • FragmentID and FragmentOffset
  • TCPFlags
  • ICMPv4Type, ICMPv4Code, ICMPv6Type, ICMPv6Code, ICMPv4, and ICMPv6
  • NextHop
• ✨ orchestrator: add custom dictionaries for additional flow hydration. See orchestrator→schema→custom-dictionaries. Currently, filtering on the generated data is not available.
• 🩹 inlet: fix Netflow processing when template is received with data
• 🩹 inlet: use sampling rate in Netflow data packet if available
• 🩹 console: fix display when using “%” units and interface speed is 0
• 🩹 orchestrator: create flows table with allow_suspicious_low_cardinality_types to ensure we can use LowCardinality(IPv6).
• 🌱 inlet: update Expr, the language behind the classifiers: new builtins are available
• 🌱 build: minimum supported Node version is now 16
• 🌱 docker: move Docker-related files to docker/
• 🌱 docker: update ClickHouse to 23.3 (not mandatory)
• 🌱 docker: update to Zookeeper 3.8 (not mandatory)
• 🌱 docker: update to Kafka 3.5 (not mandatory, but there is also a configuration change)
• 🌱 docker: add healthchecks for Redis and Zookeeper
• 🌱 console: emphasize trajectory on Sankey graphs

Docker image: docker pull ghcr.io/akvorado/akvorado:1.9.0 Full changelog: https://github.com/akvorado/akvorado/compare/v1.8.3...v1.9.0

This release only contains the change about the Docker image for Kafka and is targeted for new installs. You don't need to upgrade. See #832 for more details.

• 🩹 docker: pin Kafka Docker image

Docker image: docker pull ghcr.io/akvorado/akvorado:1.8.4 Full changelog: https://github.com/akvorado/akvorado/compare/v1.8.3...v1.8.4

• 🩹 docker: ensure Kafka is not using KRaft by default
• 🩹 console: fix SrcVlan and DstVlan as a dimension
• 🌱 orchestrator: add method and headers to specify HTTP method and additional headers to use when requesting a network source

Docker image: docker pull ghcr.io/akvorado/akvorado:1.8.3 Full changelog: https://github.com/akvorado/akvorado/compare/v1.8.2...v1.8.3

• ✨ orchestrator: add an option to materialize a column instead of using an alias
• 🩹 inlet: fix caching when setting interface name or description

Docker image: docker pull ghcr.io/akvorado/akvorado:1.8.2 Full changelog: https://github.com/akvorado/akvorado/compare/v1.8.1...v1.8.2