CLI & Core

• Add parallel action for making parallel requests in HTTP tests

Fargate

• Add ability to suppress metrics output with --quiet flag (https://github.com/artilleryio/artillery/pull/2639) - docs
• Add eu-north-1 to supported regions (https://github.com/artilleryio/artillery/pull/2646)

Lambda

• Add ability to suppress metrics output with --quiet flag (https://github.com/artilleryio/artillery/pull/2639) - docs

Playwright

• Fix issue preventing stack traces for errors from being displayed (https://github.com/artilleryio/artillery/pull/2643)
• Update Playwright version to 1.43.1 (https://github.com/artilleryio/artillery/pull/2644) - docs

Publish Metrics

• Make reporters using OpenTelemetry compatible with parallel requests (https://github.com/artilleryio/artillery/pull/2628)

---

This release brought to you by @hassy @InesNi @bernardobridge

Publish Metrics

• Sending traces to AWS X-Ray is now available through the CloudWatch reporter (https://github.com/artilleryio/artillery/pull/2555) - Docs
• Allow replacing of all tracing span names with replaceSpanNameRegex config option (https://github.com/artilleryio/artillery/pull/2607) - Docs
• Fix bug in Datadog reporter causing last batches of traces to occasionally drop (https://github.com/artilleryio/artillery/pull/2610)
• Fix errors happening when sampleRate tracing option set (https://github.com/artilleryio/artillery/pull/2601)
• Fix errors in tracing happening when using HTTP streaming (https://github.com/artilleryio/artillery/pull/2601)
• Display number of spans exported in the Artillery report (plugins.publish-metrics.spans.exported ) when tracing is enabled. (https://github.com/artilleryio/artillery/pull/2597)

CLI & Core

• Fix incorrectly declared dependencies in Artillery CLI (https://github.com/artilleryio/artillery/pull/2549)

---

This release brought to you by @InesNi @95th

Artillery Cloud

• Fix issue preventing ARTILLERY_CLOUD_API_KEY environment variable from being picked up by tests on Fargate when using --dotenv (https://github.com/artilleryio/artillery/pull/2585)

Metrics by Endpoint

• Report request URLs for requests that resulted in a network error such as ETIMEOUT or ECONNRESET (https://github.com/artilleryio/artillery/pull/2574) - docs

CLI and Core

• Fix issue causing some intermediate reports to not be reported (https://github.com/artilleryio/artillery/pull/2565)
• Fix issue with incorrect formatting of time units in “phase started” messages (https://github.com/artilleryio/artillery/pull/2581)

---

This release brought to you by @hassy @bernardobridge

CLI and Core

• Add support for loading custom code from ES modules (#2522) - docs
• Add support for using async functions as hooks (#2522) - docs

Playwright

• Update Playwright version to 1.42.1
• Fix bug that prevented traces from Playwright tests from being sent to Datadog and Honeycomb (#2533)

AWS Fargate

• Tests running in Fargate will now use AWS Distro for OpenTelemetry instead of Datadog Agent for sending traces to Datadog (#2481) - docs
• Fix bug that prevented setting CPU and memory allocation with the --launch-config flag (#2526)

---

This release brought to you by @hassy @bernardobridge @InesNi

Playwright

• Make expect from @playwright/test work with Typescript support (https://github.com/artilleryio/artillery/pull/2488) - Documentation
• Playwright’s baseURL is now set from target (https://github.com/artilleryio/artillery/pull/2493) - Documentation
• Update Playwright version to 1.41.2 (https://github.com/artilleryio/artillery/pull/2492) - Documentation

Artillery Cloud

• Load phases are now shown in Artillery Dashboard for Fargate tests (https://github.com/artilleryio/artillery/pull/2485)

CLI & Core

• Improve Typescript support to work with more packages, by exposing config.bundling.external to set packages that can’t be bundled as external (https://github.com/artilleryio/artillery/pull/2488) - Documentation
• Make test run id available to test runs via {{ $testId }} in scenarios/config and vuContext.vars.$testId in custom code (https://github.com/artilleryio/artillery/pull/2499)
• Routine dependency updates (https://github.com/artilleryio/artillery/pull/2500)

Publish Metrics

• Add test_id attribute to metrics and traces sent via the OpenTelemetry reporter (https://github.com/artilleryio/artillery/pull/2505) - Documentation

Fargate

• Improve error message and handling when setting CloudWatch retention policy (https://github.com/artilleryio/artillery/pull/2489)

---

This release brought to you by @bernardobridge, @InesNi, @hassy

New release cadence

A new stable version of the Artillery CLI will now be released twice a month - on the first and third Monday of the month. Canary releases will continue being released from the main branch.

AWS Fargate

• Add support for running tests with Fargate Spot (https://github.com/artilleryio/artillery/pull/2464) - Documentation
• Set default bucket lifecycle policy for the S3 bucket containing artifacts from test runs (https://github.com/artilleryio/artillery/pull/2434) - Documentation
• Fix issue with traces sent via the OpenTelemetry reporter causing spans to go missing or be formatted incorrectly (https://github.com/artilleryio/artillery/pull/2439)
• Set default retention policy on CloudWatch logs (https://github.com/artilleryio/artillery/pull/2446) - Documentation
• Force headless mode for Playwright tests running on Fargate (https://github.com/artilleryio/artillery/pull/2455)
• Fix bug causing Fargate tests triggered on Windows to crash when running with custom JS code (https://github.com/artilleryio/artillery/pull/2431)
• Fix bug that would cause Fargate workers to crash on startup (https://github.com/artilleryio/artillery/pull/2428, https://github.com/artilleryio/artillery/pull/2459)

Playwright

• Track and report the INP Core Web Vitals metrics (https://github.com/artilleryio/artillery/pull/2461) - Documentation
• Add support for configuring Playwright’s testIdAttribute setting (https://github.com/artilleryio/artillery/pull/2441) - Documentation
• Update Playwright version used by Artillery to v1.41.0 (https://github.com/artilleryio/artillery/pull/2425) - Documentation

publish-metrics plugin

• Add tracing support for the Datadog, New Relic and Dynatrace reporters using OpenTelemetry (https://github.com/artilleryio/artillery/pull/2418, https://github.com/artilleryio/artillery/pull/2466)
• Improve traces sent to Honeycomb to include full metadata, exceptions, and events (https://github.com/artilleryio/artillery/pull/2418, https://github.com/artilleryio/artillery/pull/2466)

AWS Lambda

• Disable artillery-plugin-publish-metrics on Lambda (https://github.com/artilleryio/artillery/pull/2457). This is a temporary workaround to get tests to run on Lambda reliably again
• Add default bucket lifecycle policy for S3 bucket containing artifacts from test runs (https://github.com/artilleryio/artillery/pull/2434) - Documentation

CLI & Core

• Fix $randomString(length) utility to return correct number of characters and allow length larger than 10 (https://github.com/artilleryio/artillery/pull/2342)

Artillery Cloud

• Fix bug that prevented CloudWatch logs for all workers from being shown on test reports (https://github.com/artilleryio/artillery/pull/2421)

---

This release brought to you by @InesNi, @hassy, @bernardobridge, @Georgegriff

Fargate

• Enable support for 12 more AWS regions (eu-west-2, eu-west-3, us-east-2, us-west-2, ca-central-1, ap-east-1, ap-northeast-2, ap-southeast-1, ap-southeast-2, ap-northeast-1, me-south-1, sa-east-1 ) (https://github.com/artilleryio/artillery/pull/2358, https://github.com/artilleryio/artillery/commit/29a4861d36ca4035e2d0269b0d4154c2fa7072b8)
• Add support for sending Playwright and HTTP traces to Datadog APM (https://github.com/artilleryio/artillery/pull/2381 and https://github.com/artilleryio/artillery/pull/2393) - Documentation
• Add support for --variables flag in run-fargate command (https://github.com/artilleryio/artillery/pull/2391) - Documentation
• Show supported regions when using the --region flag (https://github.com/artilleryio/artillery/commit/960b5ae505221bf0cbf7f840a5c5562923af65c6)

CLI & Core

• Add TypeScript support for custom code for tests running locally or on AWS Fargate. This is an experimental feature. (https://github.com/artilleryio/artillery/pull/2360) - Documentation

Playwright

• VUs will now run in isolated browsers contexts rather than new browser instances by default for better performance. (https://github.com/artilleryio/artillery/pull/2382) - Documentation
• HTTP status codes are now tracked and reported through the browser.page.codes.<code> metric (https://github.com/artilleryio/artillery/pull/2383) - Documentation
• Fix bug in before/ after hooks that prevented the Playwright engine from working (https://github.com/artilleryio/artillery/pull/2396) - Documentation
• Add experimental TypeScript support. See the docs for current limitations. (https://github.com/artilleryio/artillery/pull/2382) - Documentation

OpenTelemetry

• Fix issue with virtual users not failing when using test.step() with OpenTelemetry Playwright tracing enabled (https://github.com/artilleryio/artillery/pull/2368)
• OpenTelemetry tracing can now be used to send HTTP and Playwright engine traces to Datadog in Fargate tests (https://github.com/artilleryio/artillery/pull/2381 and https://github.com/artilleryio/artillery/pull/2393) - Documentation
• Add support for smart sampling when using HTTP tracing with the OpenTelemetry reporter (https://github.com/artilleryio/artillery/pull/2343)

---

This release brought to you by @InesNi @hassy @bernardobridge

Fixes & Improvements

• Fix a bug that prevented tests from running on AWS Lambda (#2355)
• Fix a bug that prevented tests from running on AWS Fargate (#2354)

• Tests running locally or on AWS ECS/Fargate can be stopped through Artillery Cloud now

CLI & Core

• Add time unit support for think steps in scenarios (#2272)
• metrics-by-endpoint plugin is now enabled by default to capture per-URL metrics in HTTP tests. The metrics will be available only in the JSON report and not output to the console, unless the plugin is loaded explicitly by the user. (#2274)
• Configure CPU and memory for Fargate tests with --cpu and --memory flags (#2301)
• Fix issue with $env not resolving correctly in the config section (#2265)
• Fix an issue with --scenario-name not picking up the correct scenario (#2314)
• Add a new fake-data plugin to allow for realistic test data to be generated in your tests (#2318) (docs)
• Fix handling of metrics with non-alphanumeric characters in ensure checks (#2284)
• Improve error handling in the expect plugin (#2298)

OpenTelemetry

• Add experimental tracing support for Playwright tests, with tracing of test.step() calls, page navigation events, and Core Web Vitals metrics (#2259)
• Improve conformance to OTel semantic conventions:
  • Include error messages for spans with HTTP response codes of 400 or higher (#2285)
  • Include HTTP_REQUEST_CONTENT_LENGTH, HTTP_USER_AGENT and HTTP_FLAVOR attributes (#2285)
• Fix issue with virtual user ID attribute (vu.uuid) not always being set correctly
• Fix inconsistencies in error handling (#2298 & #2285)

Playwright

• Add experimental tracing support via OpenTelemetry with publish-metrics plugin (#2259)
• Fix FID Core Web Vital metric not being emitted as expected

ECS/Fargate

• Configure CPU and memory for Fargate tests with --cpu and --memory flags (#2301)

Socket.IO

• Allow validation of any number of arguments in response/acknowledge with new args/on options (#2171)
• More flexible validations with ability to wait for multiple responses (#2139)
• Fix issue with displaying match errors in the report

---

This release brought to you by @bernardobridge @InesNi @josh-coderpad @hassy