Retesteth Versions Save

testeth via RPC. Test run, generation by t8ntool protocol

v0.3.1-cancun

5 months ago

Docker file big update, support pyt8n, besu, evmone, geth, pyspecs, ethereumjs, nimbus Compatible test release: https://github.com/ethereum/tests/releases/tag/v13

New options:

--singlenet >=forkname                   select multiple forks when running/generating the tests
--singlenet "fork1,fork2"
--verbosity PYSPEC                       print pyspec script log
--statediff Frontier--Berlin             print state diff between poststates on forkA and forkB of the test

Removed option:

Announcment

Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests) Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/) The test process diagram: https://tinyurl.com/y525ezs7

Testing stats

Testing results are available at http://retesteth.ethdevops.io/ There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/ All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/

Changelog

Interesting

docker script with all supported clients in it
do not require excpetion code to be defined in configs (check the text directly from test if not defined)
use t8n eof tool to run/generate EOFTests
exectimlog measures totaltime, cputime and client t8n subcall time
support EIP4844 blockheaders, transactions
support pyt8n transition tool
cancun fields support in tests and apis
rejected transactions in state tests filled as invalid blocks in bc version of the state test
statediff forkA--forkB option
limit max test suite execution time to 5000 sec
support :yul evmversion optimisationflag {} in test fillers
yul and solc version can be set by adding a special comment in the test src
print all warnings summary

Client Configs

better error and log reporting from client .sh scripts
pyspec managment script
support besu, ethereumjs, evmone, pyt8n, nimbus t8ns
more options for the docker.sh script

Technical

continue Pyspecs .py generation support
refactor Statetest runner
disallow multiple keys in .json and .yml (excpet json comment fields)
do not ask basefee calculation on genesis block
use c++20 features
support client configs
basic libssz tests (develop mode)
detect .py tests that are marked as skipped
singlenet option work with .py tests
rlp_decoded printed in bc tests for invalid blocks too
support nimbus --vmtrace
better detect folders and files as tests when passed to retesteth directly without any options
fix json parse bugs
allow helper files which are not tests in test folders (required by pyspecs)

ubuntu 20.04.6: http://retesteth.ethdevops.io/release/0.3.1-cancun/ubuntu-20.04.6/retesteth-0.3.1-cancun-ubuntu-20.04.6

Might need the dependecies install (but better to be run on Ubuntu20):

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode14: http://retesteth.ethdevops.io/release/0.3.1-cancun/macOS-XCode14/retesteth-0.3.1-cancun-macOS-XCode14

Docker: Clients updated as of 01.11.2023 (6 GB image) https://ethereum-tests.readthedocs.io/en/latest/retesteth-tutorial.html#retesteth-in-a-docker-container geth evm version: evm version 1.13.5-unstable-a3be3812-20231102 lllc version: 0.5.14-develop.2023.7.11+commit.c58ab2c6.mod.Linux.g++ solidity version: 0.8.21+commit.d9974bed.Linux.g++ http://retesteth.ethdevops.io/release/0.3.1-cancun/dretesteth-0.3.1-cancun.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.3.0-shanghai

1 year ago

Many changes: proto support for pyspec, new clients, Shanghai logic Introducing more debug options (--statediff, --poststate, --vmtrace) for intermediate states/transactions in blockchain tests Net tests suites: -t EIPTEsts, -t EOFTests Compatible test release: https://github.com/ethereum/tests/releases/tag/v12

New options:

    retesteth file.json                  Run/Fill the test directly (--singletest detected if in tests path, --testfile if outside)
    retesteth <Folder>                   Run/Fill the test directory (if inside testpath detect -t suite, not all suites supported)
    --exportcall <Folder>                Option to export t8ntool interactions
    --vmtrace <Folder>                   Option to export transaction traces into files
    --vmtrace x:y                        Trace block x, transaction y

    --vmtraceraw <Folder>                Option to export transaction traces into files
    --vmtraceraw x:y                     Trace block x, transaction y

      (intermidiate state for individual transaction in bc tests requires --filltests command)
    --poststate  <Folder>                Option to export transaction states into files (when running state tests)
    --poststate x:y                      Show poststate block x, transaction y
    --statediff                          Print statediff post vs pre in StateTests
    --statediff x:ytox2:y2               Show statediff from block x, transaction y  to block x2, transaction y2
    --statediff xtoy                     Show statediff from block x  to block y

    --chainid  id                        To override transaction chain id when generating or running the test

    --verbosity <channel>                Set logs channels. 'STATS|RPC|TESTLOG|LOWLOG|SOCKET|STATE'
    --getvectors                         Output all subunits of the given test (disables execution)
    --filloutdated                       Run only unfilled test fillers

Removed option:

    --testfolder                   No longer required as new test folders automatically registrate within boost

Announcment

Testing stats

Changelog

Interesting

any new folder in supported test src suites will be automatically registered into boost
new unregistered folders and subfolders (1 lvl depth) automatically register within boost
custom compiler shell script in client configs to define parser for src code in test fillers (example, docs)
cmake configure option -DLOCALDEPS to be able to use locally installed dependencies and don't use hunter (BOOST)
intermidiate poststate and statediff debug in blockchain tests
vmtraceraw "outfolder" option to export transaction traces into files
poststate "outfolder" option to export transaction states into files (when running state tests)
verbosity better selection of logging output
getvectors option to print all test vectors commands in particular test suite
filloutdated option to refill only those tests that hash is different to the filler file
t8ntool calculate baseFee support
forceupdate option allow to fill LegacyTests
singlenet option in test run mode does not throw an Error
chainID defined for individual fork in forks config files
web utility scripts added to the repo
statediff option print state change in state tests
fork+xxxx automatically asks t8n clients to run on fork+xxxx (where xxxx is eip number) rules
support Shanghai logic (adds withdrawalsRoot and withdrawals fields to the bc tests)

Client Configs

integrate ethereumjs config
integrate etc (ethereum classic) config
integrate nimbus config
integrate evmone config (develop)
switch besu from rpc config to t8n
new option checkDifficulty to verify ETH difficulty calculation of the t8ntool client
new option checkBasefee to verify ETH baseFee calculation of the t8ntool client
new option checkBasefee to verify ETH baseFee calculation of the t8ntool client
new array fillerSkipForks to skip filling tests on forks (forks + eips) that are not supported
new option calculateBasefee to calculate basefee for the t8ntool client that does not support it
new option calculateDifficulty to force retesteth calculated difficulty (in case client does not support it)
new option support1559 to disable blockheader auto convertion to Merge/1559 rules (for etc clients)
new option transactionAsJson to send t8ntool tx files in json form not RLP (for evmone type clients)
integrate pyspec .py fillers support (experimental)
update default yul.sh script
update default start.sh for t8ntool clients (include --erorlog option parsing and better exception check)
update dretesteth.sh

Technical

print retesteth config path
update circle config builds, support mac builds
refactor compiler.cpp, main.cpp, options.cpp, statetests, testsuite runner and more
update to CXX17
remove libff MPIR scrypt AES dependencies
remove unused boost_program_options
update hunter gate to https://github.com/cpp-pm/hunter/archive/v0.24.7.tar.gz
refactor includes in .h and .cpp files. remove redundancies
fix fs=boost::filesystem in headers compiler error
make dataobject a separate lib
nodes option autoresolve hostname (before only accepting IP)
hardcode new test folders, fix --testfolder option
testfile have now the same logic as normal test execution/generation
refactor test versioning (test hash verification, test filler verification, test without fillers)
refactor Blockchain test run/generation functions
better check of error log from t8ntool
disable RPC support for GeneralStateTests generation (do not ask to calculate genesis)
don't stop on test's _info section validaton errors

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.3.0-shanghai/ubuntu-18.04.3/retesteth-0.3.0-shanghai-ubuntu-18.04.3

Might need the dependecies install (but better to be run on Ubuntu20):

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode12: http://retesteth.ethdevops.io/release/0.3.0-shanghai/macOS-XCode12/retesteth-0.3.0-shanghai-macOS-XCode12

macOS-XCode14: http://retesteth.ethdevops.io/release/0.3.0-shanghai/macOS-XCode14/retesteth-0.3.0-shanghai-macOS-XCode14

Docker: (!Better version of docker is comming with other clients support!) geth version: geth version 1.11.5-unstable-5d23d21f-20230320 Git Commit (around): 5d23d21f geth evm version: geth version 1.11.5-unstable-5d23d21f lllc version: Version: 0.5.14-develop.2022.7.30+commit.a096d7a9.Linux.g++ solidity version: Version: 0.8.17+commit.8df45f5f.Linux.g++ http://retesteth.ethdevops.io/release/0.3.0-shanghai/dretesteth-0.3.0-shanghai.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.2.2-merge

1 year ago

Merge PoS structures support in tests, little refactoring, new option --testfolder, --nologcolor, custom chainID in transactions Geth + custom eip example configuration, MacOS support, update ReadME Compatible test release: https://github.com/ethereum/tests/releases/tag/v11

New options:

    --testfolder <SubFolder>                Run tests from a custom test folder located in a given suite. Requires -t <TestSuite>
    --nologcolor                                    Disable color codes in log output

Announcment

Testing stats

Changelog

Interesting

new option --testfolder so no need to hardcode custom test folders, the folder would be looked at home directory of provided -t testSuite
new option --nologcolor to disable color codes in log output for clean text when exporting to log files
lllc support opcode name 'RANDOM' which is identical to 'DIFFICULTY'
support 'Merge' forkname and structures. See example tests for details:(https://github.com/ethereum/tests/blob/develop/src/GeneralStateTestsFiller/stExample/mergeTestFiller.yml) (https://github.com/ethereum/tests/blob/develop/src/BlockchainTestsFiller/ValidBlocks/bcExample/mergeExampleFiller.json)
if state tests expect section indexes fields are not set, the default value is -1
trasaction sender is exported to generated tests
state tests -d <label> selector does not require :label prefix to select transaction by label name
transaction tests support custom forknames
blockchain tests exception names are verified against geth t8n tool when running the tests
custom chainID in clients configs to be able to sign transactions for other test networks
0x:bigint support in TransactionTests to generate bizzare structures
new section verify in json tests to check how retesteth generate .json of the test. See: (https://github.com/ethereum/tests/blob/develop/src/BlockchainTestsFiller/InvalidBlocks/bcExpectSection/result_MergeEnvConvertionFiller.json)
if env/genesis header not defined for EIP1559, the default value for baseFee is set
if env/genesis header not defined for Merge, both the baseFee and currentRandom are set if not defined.
in legacy env, the difficulty translates to 0, mixHash gets the value of difficulty, when generating old tests on Merge rules
transition tests from PoW to PoS at given difficulty, not block number
update ReadME building instructions, and the docs are update https://ethereum-tests.readthedocs.io/en/latest/

Technical

update cmake build script to use latest boost 1.79 version for MacOS support
export solidity version to generated tests (solc)
:label prefix for label names is not exported to generated state tests to save space
if test_setChainParams fail, the tests continue exectution
experiment with std::move to reduce dynamic memory allocation
protection from repeating forks in transaction tests
refactor t8ntool backend code (blockchain builder)
refactor testSuite.cpp, split heavy functions
go version updated in docker file to support geth, support changes in geth t8n
correct translating the fork name to geth t8n tool internal forkname
fix memory leaks / race conditions what found
new test exception names
t8ntool backend blockchain logic for Merge support
check data pointer to be empty when printin DataObject, a rare bug happened when exception is thrown and DataObject is printed after
refactor t8ntool backend block verification a litle

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.2.2-merge/ubuntu-18.04.3/retesteth-0.2.2-merge-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode12: http://retesteth.ethdevops.io/release/0.2.2-merge/macOS-XCode12/retesteth-0.2.2-merge-macOS-XCode12

Docker: geth version: Version: 1.10.22-unstable Git Commit: fea569f90aa608abeb13cea6c9fd55f1d0a77f40 geth evm version: evm version 1.10.22-unstable-fea569f9-20220729 lllc version: Version: 0.5.14-develop.2022.7.30+commit.a096d7a9.Linux.g++ solidity version: Version: 0.8.6+commit.11564f7e.Linux.g++ http://retesteth.ethdevops.io/release/0.2.2-merge/dretesteth-0.2.2-merge.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.2.1-difficulty

2 years ago

Coming up with DifficultyTests for ArrowGlacier, new DifficultyTests test suite to point check the difficulty formula depening on fork New test exceptions for transaction tests invalid RLP handling. T8N, T9N support.

New test suite: -t DifficultyTests New test method: VALUE test_calculateDifficulty(FORK, VALUE _blockNumber, _parentTimestamp, VALUE _parentDifficulty, VALUE _currentTimestamp, VALUE _uncleNumber)

New options:

    --vmtrace.nomemory           "Disable memory in vmtrace/vmtraceraw"
    --vmtrace.nostack            "Disable stack in vmtrace/vmtraceraw"
    --vmtrace.noreturndata       "Disable returndata in vmtrace/vmtraceraw"

Announcment

Testing stats

Changelog

suppot TransactionTests suite. handle invalid transaction RLPs
continue development of 0x:bigint feature, fix bugs
condition variable on the main thread instead of checking finalization of jobs in cycle (actually slows down, because of the safety mutex)
make bash scripts more safe with other versions of shell
Added stEIP3607 to BCGeneralStateTests
t8ntool ArrowGlacier support
t8ntool more exceptions to check invalid transactions
t9ntool support (transaction tests)
more unit tests, fix potential thread lock places and memory leaks
fix bug with generated test hash calculation for blockchain tests (1 test to many blockchain tests)

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.2.1-difficulty/ubuntu-18.04.3/retesteth-0.2.1-difficulty-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11: http://retesteth.ethdevops.io/release/0.2.1-difficulty/macOS-XCode11/retesteth-0.2.1-difficulty-macOS-XCode11

Docker: geth version: Version: 1.10.14-unstable Git Commit: 4ebeca19d739a243dc0549bcaf014946cde95c4f geth evm version: evm version 1.10.14-unstable-4ebeca19-20211125 lllc version: 0.5.14-develop.2021.11.27+commit.401d5358.mod.Linux.g++ solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++ http://retesteth.ethdevops.io/release/0.2.1-difficulty/dretesteth-0.2.1-difficulty.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.2.0-memory

2 years ago

Breaking change:
Test-parse logic optimization. Do not sort source test json structure before calculating the hash, to save time. This changes the way filler hash is calculated leading to older versions of retesteth tests would not pass the hash verification check. (except legacy tests)

Continue refactoring and optimizations. Near 50% execution time saved on remote VPS so far.

New test suite: -t TransactionTests New test method: test_rawTransaction(BYTES, FORK) https://github.com/ethereum/go-ethereum/pull/23494

Check on the generated tests when filling the tests. If no changes after test regeneration, do not update _info section by default.
New option --forceupdate to update the regenerated test even if no changes (_info section header always change)

Announcment

Testing stats

Changelog

--showhash show full hash
support difficulty formula calculation from t8ntool (https://github.com/ethereum/go-ethereum/pull/23353)
json are sorted on export, sort function refactored, no sort on json load
cache values/hash string representation for future calls when requested to be converted, recache if data is mutated (!)
notification when trying to run older generated test
test suites output (x of y) verbosity
more smart pointer use. less data copy when filling the tests (!)
New test suite: -t TransactionTests Net test method: test_rawTransaction(BYTES, FORK)
refactoring, logic optimizations to save execution time
--forceupdate option when filling the tests
do not update the _info section by default if no changes been done after --filltests

! - potential bug behavior, stay aware

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.2.0-memory/ubuntu-18.04.3/retesteth-0.2.0-memory-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11: http://retesteth.ethdevops.io/release/0.2.0-memory/macOS-XCode11/retesteth-0.2.0-memory-macOS-XCode11

Docker: geth version: Version: 1.10.9-unstable Git Commit: 84ff152de56b9d65f6888daef9dc00c97a6aafd3 geth evm version: evm version 1.10.9-unstable-84ff152d-20210915 lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++ solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++ http://retesteth.ethdevops.io/release/0.2.0-memory/dretesteth-0.2.0-memory.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.1.2-london

2 years ago

A big update on memory managment with more optimizations to come.

Announcment

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests) Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)

Changelog

timeout shutdown in 10 hours execution time (for stat page)
use bigint for values, allow overflow values in Ethereum structures for comuptation
fix issue when error didn't finish the thread in retesteth
test_modifyTimestump is absolute in blockchain tests
memory and json parsing optimizations
store DataObject using smart pointers.
support 100_000_000 notation for decimal values in test fillers
store temp files on memory drive if possible (make sure there is enough space in /dev/shm)
download boost dependecy from http://retesteth.ethdevops.io/ when cmake

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.1.2-london/ubuntu-18.04.3/retesteth-0.1.2-london-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11: http://retesteth.ethdevops.io/release/0.1.2-london/macOS-XCode11/retesteth-0.1.2-london-macOS-XCode11

Docker: geth version: Version: 1.10.7-unstable Git Commit: d3e3a460ec947c9e1e963d1a35f887d95f23f99d geth evm version: evm version 1.10.7-unstable-d3e3a460-20210804 lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++ solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++ http://retesteth.ethdevops.io/release/0.1.2-london/dretesteth-0.1.2-london.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.1.1-eip1559

2 years ago

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests) Uses existing clients to run/generate the tests. See documentation.

Changelog

fix --checkhash warnings on LegacyTests
remove blockchain version of old VMTests
typed transactions exported without rlp prefix (as plain 01 + tx.bytes)
select transaction by label in a filled state test
check for excessive expect sections in gstate tests
yul compilation support
t8ntool secret key export
transaction type2 support in gstate tests (0x02)
DataObject notinitialized type for std logic. fix issues with autosort.
openethereum-evm gstate tests support via wrapper
replace BlockHeader with spBlockHeader
introduce new struct BlockHeader1559
support besu and oewrap
EIP1559 test parsing
setup.sh script in client configs. (executed once in the begining of retesteth run)
fieldReplace map in clients config (on rpc protocol)
checkLogHash option in clients config
check t8ntool response files for emptiness bugfix
eip1559 blockchain test support (t8ntool)
eip1559 BerlinToLondonAt5 support (t8ntool)
invalid transactions check
test_mineBlocks method expect result of rejected transactions

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.1.1-eip1559/ubuntu-18.04.3/retesteth-0.1.1-eip1559-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11: http://retesteth.ethdevops.io/release/0.1.1-eip1559/macOS-XCode11/retesteth-0.1.1-eip1559-macOS-XCode11

Docker: geth version: Version: 1.10.4-unstable Git Commit: eff998effbf466d4acbe599583dd8ec75f2af6a1 geth evm version: evm version 1.10.4-unstable-eff998ef-20210611 lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++ solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++ http://retesteth.ethdevops.io/release/0.1.1-eip1559/dretesteth-0.1.1-eip1559.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.1.0-accesslist_fix

3 years ago

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests) Uses existing clients to run/generate the tests. See documentation.

!!!FIX the testfile option!!!

Changelog

move expectException in blockchain filler outside of blockheader.
allow ">=Frtontier" : {} inside blockheader in blockchain filler (individual overwrite)
show trRaw data debug when failing a state test
select tr by data label (in gtests) from cmd and expect section
support data/value/gas index ranges in gtests expect section
tx.nonce "auto" in bcTest fillers
bugfix: color symbols corrected when output to console
bugfix: remove comments when filling a single test file
VMTests subfolder in GeneralStateTests
labels in filled tests. "_info" section of filled test change for new tests
warning debug when lllc compilation fails
tx.access lists support in gtests and blockchain tests
fix nonce from being size_t in state. acc.nonce > 2**64-1 is not allowed
better debug around transactions failing in blockchain test generation
vmTrace in blockchain tests (wip)

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.1.0-accesslist/ubuntu-18.04.3/retesteth-0.1.0-accesslist-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode10: http://retesteth.ethdevops.io/release/0.1.0-accesslist/macOS-XCode10/retesteth-0.1.0-accesslist-macOS-XCode10

Docker: geth version: Version: 1.10.2-unstable Git Commit: faacc8e0faa89f5b3a7055e86924a95b6a9be944 geth evm version: evm version 1.10.2-unstable-faacc8e0-20210315 lllc version: Version: 0.5.14-develop.2021.3.9+commit.14c9d5de.Linux.g++ solidity version: Version: 0.7.0+commit.9e61f92b.Linux.g++ http://retesteth.ethdevops.io/release/0.1.0-accesslist/dretesteth-0.1.0-accesslist.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.1.0-accesslist

3 years ago

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests) Uses existing clients to run/generate the tests. See documentation.

Changelog

move expectException in blockchain filler outside of blockheader.
allow ">=Frtontier" : {} inside blockheader in blockchain filler (individual overwrite)
show trRaw data debug when failing a state test
select tr by data label (in gtests) from cmd and expect section
support data/value/gas index ranges in gtests expect section
tx.nonce "auto" in bcTest fillers
bugfix: color symbols corrected when output to console
bugfix: remove comments when filling a single test file
VMTests subfolder in GeneralStateTests
labels in filled tests. "_info" section of filled test change for new tests
warning debug when lllc compilation fails
tx.access lists support in gtests and blockchain tests
fix nonce from being size_t in state. acc.nonce > 2**64-1 is not allowed
better debug around transactions failing in blockchain test generation
vmTrace in blockchain tests (wip)

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.1.0-accesslist/ubuntu-18.04.3/retesteth-0.1.0-accesslist-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode10: http://retesteth.ethdevops.io/release/0.1.0-accesslist/macOS-XCode10/retesteth-0.1.0-accesslist-macOS-XCode10

Docker: geth version: Version: 1.10.2-unstable Git Commit: 22082f9e565665f7da045b9ff708e4698f383c77 geth evm version: evm version 1.10.2-unstable-22082f9e-20210309 lllc version: Version: 0.5.14-develop.2021.3.9+commit.14c9d5de.Linux.g++ solidity version: Version: 0.7.0+commit.9e61f92b.Linux.g++ http://retesteth.ethdevops.io/release/0.1.0-accesslist/dretesteth-0.1.0-accesslist.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/

v0.0.9-berlin

3 years ago

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests) Uses existing clients to run/generate the tests. See documentation.

ubuntu 18.04.3: http://retesteth.ethdevops.io/release/0.0.9-berlin/ubuntu-18.04.3/retesteth-0.0.9-berlin-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode10: http://retesteth.ethdevops.io/release/0.0.9-berlin/macOS-XCode10/retesteth-0.0.9-berlin-macOS-XCode10

Docker: geth evm version 1.9.24-unstable-b63bffe8-20201030 lllc version: 0.5.14-develop.2020.10.30+commit.9189ad7a.Linux.g++ http://retesteth.ethdevops.io/release/0.0.9-berlin/dretesteth-0.0.9-berlin.tar

Documentation: https://ethereum-tests.readthedocs.io/en/latest/