MarathonLabs Marathon Versions Save

Cross-platform test runner

0.10.0

2 months ago

What's Changed

Breaking changes:

fix(core): add maxFilename limit for outputConfiguration by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/889
fix(android): support ':' characters in annotation values for remote parser (requires adam 0.5.4) by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/892

Features:

feat(apple): rework apple to support macOS, iOS, iPadOS, tvOS, watchOS, visionOS testing by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): verify supported platform for Apple bundles by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): use provided xcuitest runner app if specified in testApplication by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): reconnect to device after ssh connection expires by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): support non-unique UDIDs by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): properly detect apple binaries via header magic by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): xcresult augmentation should fail gracefully by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(apple): log exception when connection times out by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
feat(ios): hidden option for user-tracking permissions grant by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
fix(android): support recovery of am test parser in case process crashes due to misconfiguration of listener by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/893
feat(apple): support arbitrary strings in TestRunProgressParser as identifiers by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/894
feat(analytics): configurable missing analytics values by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/905

Bug fixes:

fix(configuration): allow ANY_SUCCESS and count sharding strategy with count 1 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/888
fix(apple): fix for using DYLD_INSERT_LIBRARIES in xctestrunEnv by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/900
fix(apple): properly detect output timeout across stdout and stderr by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901
fix(core): don't schedule retries according to RetryStrategy if test reached terminal state by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901/commits/6f0f681fc5d680888a5c4a2e3a47a1e98f13e29f
fix(core): influxdb2 write failure should not destroy the device actor by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/901/commits/584ee5e687d28fffb2440f9c5da924cb9dacccb5

Other:

docs(docs): add 0.9.1 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/890
feat(cd): autorelease homebrew formula by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/891

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.9.1...0.10.0

0.9.1

3 months ago

What's Changed

Features:

feat(ios): add checkReachability for ssh transport by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/869
feat(raw_json_meta): meta properties like test annotations were added… by @matzuk in https://github.com/MarathonLabs/marathon/pull/873
feat(android): remote test parser should gracefully handle invalid test listener by @matzuk in https://github.com/MarathonLabs/marathon/pull/877
feat(ios): xctestparser failure log by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/884
feat(cli): add --include-flaky-tests to parsing by @matzuk in https://github.com/MarathonLabs/marathon/pull/878
feat(ci): telegram notification should contain new version by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/886

Bug fixes:

fix(billing): proper calculation of flakiness by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/867
fix(ios): use extracted application for test bundle by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/868
fix(ios): missing create directories for shared artifacts in xctest parser by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/874
fix(ios): support flutter via patrol's only-testing option by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/879
fix(android): AmInstrumentTestParser should prepare device once per p… by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/881
fix(core): propagate meta properties into final TestResult by @matzuk in https://github.com/MarathonLabs/marathon/pull/875
fix(android): fix ConcurrentModificationException in AdamAndroidDevice by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/883

Other:

docs(runner): add 0.9.0 + report demos + prepare for 0.9.1 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/864
docs(android): add Kakao mention by @Vacxe in https://github.com/MarathonLabs/marathon/pull/866
chore(deps): update to latest by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/885

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.9.0...0.9.1

0.9.0

6 months ago

What's Changed

Breaking changes:

feat(configuration): move testClassRegex to parser configuration by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/851

Features:

feat(ios): add xctest parser by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/848
feat(ios): implement xcodebuildTestArgs by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/837
feat(ios): use shared artifacts for multiple simulators by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/840
feat(ios): add dataContainerClear by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/839
feat(android): support boot timeout by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/836
feat(android): print string version of output for screenrecorder, not… by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/846
feat(android): test plugin support by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/862
feat(core): add failure message to uncompleted test result by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/859
feat(configuration): hide sensitive info from analytics configuration by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/845
feat(analytics): add success, flakiness and run duration by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/861

Bug fixes:

fix(core): remove erroneous $ in flakiness overhead by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/826
fix(android): screenrecorder pid parsing should validate the output f… by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/828
Fix ignoreFailure exit code missmatch by @dalapenko in https://github.com/MarathonLabs/marathon/pull/831
fix(core): subtraction should apply first filter and negate others by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/834
fix(core): warn about missing metrics only once by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/833
fix(ios): removing unsupported arch added by @deushev in https://github.com/MarathonLabs/marathon/pull/850
fix(android): fail early on missing input files by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/857
Enable video record through screenrecord binary on Genymotion devices by @kartik1o in https://github.com/MarathonLabs/marathon/pull/854

Other:

Update ADOPTERS.md by @trevjonez in https://github.com/MarathonLabs/marathon/pull/832
docs(android): remove vendor adam from versions that removed ddmlib by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/841
Add new adopter by @benjx1990 in https://github.com/MarathonLabs/marathon/pull/838
chore(deps): update dependencies by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/858
docs(split): Cloud documentation was moved to a separate tab. by @austyh in https://github.com/MarathonLabs/marathon/pull/856
docs(docs): multiple clarifications by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/860
fix(docs): css fix for text align by @austyh in https://github.com/MarathonLabs/marathon/pull/863

New Contributors

@dalapenko made their first contribution in https://github.com/MarathonLabs/marathon/pull/831
@benjx1990 made their first contribution in https://github.com/MarathonLabs/marathon/pull/838
@deushev made their first contribution in https://github.com/MarathonLabs/marathon/pull/850
@kartik1o made their first contribution in https://github.com/MarathonLabs/marathon/pull/854

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.8.4...0.9.0

0.8.4

9 months ago

What's Changed

fix(cli): exit code mismatch in clikt by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/824

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.8.3...0.8.4

0.8.3

9 months ago

What's Changed

fix(vendor): file in test serialization by @Vacxe in https://github.com/MarathonLabs/marathon/pull/795
feat(core): change flakiness overhead from ms to readable format by @Vacxe in https://github.com/MarathonLabs/marathon/pull/793
Adds DM-TECH to ADOPTERS.md by @j-vegas in https://github.com/MarathonLabs/marathon/pull/799
fixed ios documentation by @matzuk in https://github.com/MarathonLabs/marathon/pull/801
fix(bill): fix billing end time calculation by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/800
fix(android): findBinary should make a decision from the exit code, not the output by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/802
docs(cloud): Added Marathon Cloud overview by @austyh in https://github.com/MarathonLabs/marathon/pull/805
docs(zh): Introduction and Overview pages in Chinese, Docusaurus update to 2.4.1 by @austyh in https://github.com/MarathonLabs/marathon/pull/803
Marathon Cloud doc update by @matzuk in https://github.com/MarathonLabs/marathon/pull/807
Cloud doc update by @matzuk in https://github.com/MarathonLabs/marathon/pull/810
fix(ios): support .app structure without PlugIns folder by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/811
fix(ios): propagate test status to skip successful tests by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/814
docs(ios): remove TERMINATE from the suggested lifecycle actions by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/817
docs(ios): add compatibility notes for xcodegen by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/816
Add support for bugsnagReporting in gradle config. by @tabletenniser in https://github.com/MarathonLabs/marathon/pull/820
chore(all): update dependencies by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/822
chore(docs): 0.8.3 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/823

New Contributors

@j-vegas made their first contribution in https://github.com/MarathonLabs/marathon/pull/799
@tabletenniser made their first contribution in https://github.com/MarathonLabs/marathon/pull/820

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.8.2...0.8.3

0.8.2

1 year ago

What's Changed

feat(cli):update ignoreFailures reporting logic by @Vacxe in https://github.com/MarathonLabs/marathon/pull/782
fix(core):logging test parser capitalise exception by @Vacxe in https://github.com/MarathonLabs/marathon/pull/783
fix(plugin): windows duplication for CLI directory by @Vacxe in https://github.com/MarathonLabs/marathon/pull/785
fix(core): run shouldn't freeze when unexpected exception is received by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/788
fix(core): SingleValueTestFilter if file not exist then should be evaluated as empty by @Vacxe in https://github.com/MarathonLabs/marathon/pull/776
feat(core): class named batching strategy by @Vacxe in https://github.com/MarathonLabs/marathon/pull/777
fix(android): pullFolder shouldn't fail if folder contains empty file by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/789
feat(all): update kotlin to 1.8.10 + other deps by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/790
fix(cli): ignoreFailures should produce error if false by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/791
feat(analytics): migrate to grafana cloud by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/792

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.8.1...0.8.2

0.8.1

1 year ago

What's Changed

fix(vendor): fix local test bundling (Batching no longer works with local test parser, fixed-size always treated as 1) by @Vacxe in https://github.com/MarathonLabs/marathon/pull/778

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.8.0...0.8.1

0.8.0

1 year ago

Blog announcement

What's Changed

Features:

Add dynamic feature support by @princeparadoxes in https://github.com/MarathonLabs/marathon/pull/693
feature(gradle-plugin): generate Marathonfile for variant task by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/701
feat(gradle-plugin): add tests for task caching by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/704
feat(gradle-plugin): enable publishing to plugins.gradle.org by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/705
feature(ios): pull xcresult by @abhishekbedi1432 and @Malinskiy in https://github.com/MarathonLabs/marathon/pull/719
feat(ci): update github actions by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/720
feat(cli): parse subcommand by @matzuk in https://github.com/MarathonLabs/marathon/pull/724
feat(ios): completely rework ios by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/726
feat(android): remove ddmlib by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/740
feat(ios): extra application installation by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/748
feat(ios): ignore resource forks by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/754
feat(core): execution strategy by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/758

Bug fixes:

fix(core): format the pkg.classname as classname in case of empty pkg by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/692
fix(docs): allure kotlin example by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/695
fix(html-report): add hours to the displayed time by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/697
fix(report): timeline iframe autoresize by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/698
fix(android): fix not used booted parameter by @Vacxe in https://github.com/MarathonLabs/marathon/pull/721
fix(ios): running universal binaries should be able to use arm64 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/737
fix(core): fix exit code by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/739
fix(ios): rsync should use the same credentials as ssh when overridden by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/741
fix(ios): reuse apple test bundle identifier by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/755
fix(core): correctly log FSM not registered by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/768
fix(marathon-gradle-plugin): fixed groovy filtering configuration by @ildar2 in https://github.com/MarathonLabs/marathon/pull/753
fix(ios): password auth for rsync by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/742
fix(android): update adam to fix android 31+ testing by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/743
fix(android): update samples and fix multiple android bugs by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/744

Other:

docs(android): add docs about multimodule testing by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/685
docs(configuration): add docs for dynamic configuration by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/696
Update Apache Commons Text to 1.10.0 by @tseperi in https://github.com/MarathonLabs/marathon/pull/706
docs(docs): update search by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/730
feat(docs): revamp by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/731
feat(docs): change title to 'Marathon docs' by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/733
feat(all): change license for everything except samples to GPL-2.0-only by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/734
feat(docs): change doc tabs styling by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/735
feat(core): create a bill of used device time at the end of the run by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/738
docs(all): update docs url by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/745
chore(deps): update dependencies by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/746
docs(docs): add clarification on target OS for marathon by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/747
docs(docs): version 0.8.0 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/766
docs(docs): version 0.8.0 by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/767

New Contributors

@tseperi made their first contribution in https://github.com/MarathonLabs/marathon/pull/706
@matzuk made their first contribution in https://github.com/MarathonLabs/marathon/pull/724
@ildar2 made their first contribution in https://github.com/MarathonLabs/marathon/pull/753

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.7.6...0.8.0

0.7.6

1 year ago

What's Changed

Features:

feat(android): support screen captures using ScreenCapture API by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/682
feat(android): support enabling window animations by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/684

Bug fixes:

fix(android): fix parsing of remote annotations containing commas by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/683

Other:

docs(android): add docs about multimodule testing by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/685

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.7.5...0.7.6

0.7.5

1 year ago

What's Changed

Breaking changes:

fix(marathon-gradle-plugin): fix incompatibility with AGP 7.1.0+ by @Malinskiy in https://github.com/MarathonLabs/marathon/pull/680. Only AGP 7.1.0+ is supported if using marathon-gradle-plugin

Full Changelog: https://github.com/MarathonLabs/marathon/compare/0.7.4...0.7.5