Snabb Versions Save

Snabb: Simple and fast packet networking

v2023.10

6 months ago

This release pulls in recent improvements and bug fixes from LuaJIT upstream, refines engine pacing, adds a snabb config shutdown command, and adds support for ConnectX-7 NICs.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2023.06...v2023.10

v2023.06

10 months ago

This small summer release contains various improvements for Snabbflow (snabb ipfix) and a bug fix for Snabb lwAFTR.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2023.04...v2023.06

v2023.04

1 year ago

This release finally merges @lukego's timeline: a probabilistic high-frequency event log that is useful to understand and debug runtime latencies. It can be enabled via the environment variable SNABB_TIMELINE_ENABLE. As usual this release also comes with various minor improvements and bug fixes.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2022.12...v2023.04

Contributors

Alexander Gall (1):

  • 8e7be8efa: apps.rss.metadata: remove 59 (no-next-header) from list of IPv6 extension headers

Luke Gorrie (10):

  • 3e4c4474e: dasm_x86.lua: Add support for RDTSCP instruction
  • 95872b165: core.timeline: New module for "timeline" logs
  • 930f29417: Makefile: Embed "*.events" timeline specs
  • aa9980a5b: engine: Add engine.events, app.events, link.events
  • 8530942a5: core.link: Add dropped bytes counter
  • 9b252f0e6: engine: Instrument with timeline events
  • 40ceef603: core.timeline: Switch to double-float on disk
  • 563ae7ae3: engine: update timeline level probabilities
  • ffb7379c7: engine: Randomize timeline log level with math
  • 16a6bb21e: engine: Remove timeline packet payload sampling

Max Rottenkolber (51):

  • 1bb4108a3: core.app: remove remains from 16a6bb2 (timeline packet sampling)
  • 0e52b2406: core.timeline: make timeline log available to other core modules
  • e8348451e: core.packet: record packet allocation events to timeline
  • a6def7b56: Revert "core.timeline: make timeline log available to other core modules"
  • 8201d1d79: lib.ptree.worker: reformulate to use engine.main with done func
  • debd26cfe: engine.main: fix memory leak due to latency histogram creation
  • edaad6c82: core.app: set timeline log level at the very end of breathe loop
  • 9c4c804cb: core.packet: reorder group_fl released/reclaimed/unlocked events
  • 004f5bb71: core.timeline: decouple log level from event rate
  • 8e681091a: core.app: initialize timeline log rate to 7 (no logging)
  • 8f0c6bf92: core.timeline: add switch to disable timeline logging
  • 30cafdc7c: core.app: add timeline events for app network configuration
  • e5faba0f1: Fix some wrong assumptions about the event rate
  • 872eaab60: app.events: reduce tick/ticked event rate
  • 025225416: engine.events: fix breath_ticked description
  • 8080451d1: core.app: log breath_ticked only when tick()=true
  • cd43d69f1: engine.events: increase rate of commited_counters
  • 809153146: Revert "app.events: reduce tick/ticked event rate"
  • 3e0fee74c: core.app: fix bug introduced in merge with master
  • cb11a267e: app.events: reduce tick/ticked event rate
  • bfa3aa67b: lib.ptree: fix bugs introduced by merge with master
  • 8c3464687: timeline: cleaup merge
  • 840e1e532: timeline: cleanup
  • db3c5cbcb: engine: add timeline_enabled toggle (on by default)
  • 7b00bcfe2: Revert "engine: add timeline_enabled toggle (on by default)"
  • 9896b4b5b: timeline: disable by default, add lib.scheduling toggle
  • 21e2017a7: timeline: rework group freelist events
  • b7a8af9fe: timeline: remove unused arguments to tick events
  • 068b4d58d: timeline: remove linkstats for push events
  • f41f7a1de: timeline: fixup rework group freelist events
  • bcca06e62: core.sync: add load primitive
  • 45d3ac768: core.group_freelist: fix a deadlock
  • b916131a7: group_freelist: revert panic
  • f8c977c81: group_freelist: add deadlock detection
  • 2fbc94b33: lib.poptrie: fix bug where address bits where interpreted in reverse order
  • 67b3d9c66: lib.poptrie: optimize x86 lookup
  • a382b1d5d: core.timeline: fix selftest
  • 00287bbbe: engine: allow timely timeline initialization
  • a6fe6dc8b: snabb ipfix probe: add --timeline option to CLI
  • 66f0eb3ad: lib.scheduling: add group_freelist_size setting
  • f906776e1: lib.interlink: fix shm printing bug
  • 50cad00ff: ipfix probe: make group freelist and interlink sizes configurable via schema
  • 81a9e1929: timeline: enable via environment variable
  • f805e81f4: Revert "snabb ipfix probe: add --timeline option to CLI"
  • 0916c248f: Revert "engine: allow timely timeline initialization"
  • 559c80dcd: core.sync: load64, cas64
  • f47228ba8: core.group_freelist: use 64 bit sequence
  • b6c130d82: core.group_freelist: ensure finish is atomic
  • e8eb4fdcb: Revert "group_freelist: add deadlock detection"
  • f3905b350: core.group_freelist: cleanup
  • 7472b839b: lib.yang.list: fix bug in remove_obsolete_nodes

v2022.12

1 year ago

This release introduces a new data structure to represent YANG lists, allowing us to expose lists with the attribute ordered-by: user as a configuration interface. Additionally we have made previously hardcoded freelist and interlink buffer sizes configurable at runtime to enable tuning of those buffers to fit application demands. Finally, ipfix probe has been optimized to operate without software RSS when the configuration allows it. As usual this release also comes with various minor improvements and bug fixes.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2022.10...v2022.12

Contributors

Max Rottenkolber (100):

  • 4b58a3c50: heap 1
  • 536c929d5: heap 2
  • 9ea357e7d: list 1
  • 1afa4cdb1: heap no overflow, simplify, fix bugs
  • c325cd91d: heap collisions
  • 62d4ae457: remove, iterator
  • e451f5e3a: enable LUA52COMPAT
  • 00a61691a: fix bugs
  • 0f8580e2b: ListMeta
  • 2075954a8: add_or_update
  • 2313cc039: fix heap _ref bug
  • 559faf3e5: refactor
  • b3692f589: refactor
  • b60b9181e: ip bench
  • 9c6a29e6e: refactor
  • a6492c05c: funny
  • d8e53fe2a: ListMeta fixes
  • cc7b972c7: Make keys/members specs extendable
  • 89a67ac22: todo: deterministic struct field order
  • ddabaa3bd: lib.yang.list: support optional members
  • 64331e4af: lib.yang.list: sort fields in build_type
  • 62696b76c: lib.yang.list: more builtin types
  • 95a9d311e: lib.yang.list: add lvalue type (for arbitrary Lua values)
  • abc0f72d7: lib.yang.list: add ipv4/ipv6-address types
  • 147557f18: lib.yang.list: single key meta, object() getter
  • 8e1da161e: lib.yang.list: load/save
  • e36d84e48: lib.yang.list: object() functions a is-list? predicate
  • 4c90e38ae: lib.yang.list: add from_table constructor
  • 4eca2e71d: core.shm: pass through extra sizeof args in map
  • f948fa6bf: lib.interlink: make queue size configurable
  • f1577c9ba: core.shm: allow mapping of partial objects
  • c7bb16466: core.group_freelist: configurable group freelist size
  • 7b6ee588f: core.packet: configurable freelist size
  • 1ac0362bb: core.packet: fix freelist shm display bugs
  • 07dc2420c: lib.interlink: revert from typeof to cdef for struct interlink
  • 9400c624a: lib.scheduling: add max_packets parameter
  • 690bd3ebb: lib.yang: integrate list into data
  • 5d20d5ae4: lib.yang.list: clean up lvalues, load, save
  • d728c3249: lib.yang: integrate list into binary
  • 86a8a32bf: lib.yang.list: fix bug wrt lvalues/optional
  • 96ce23500: lib.yang.binary: test list lvalues and fix bug
  • dbc6f5e02: lib.yang.list: add optional lvalue test case
  • c5609e9b9: lib.yang.data: cleanup
  • d5e508a37: lib.yang: update README
  • 1db643005: lib.yang.path_data: wip
  • a66ee30e9: lib.yang.path_data: wip
  • de2acbc19: lib.yang.path: cleanup
  • c3423ec5f: libya.ng.path_data: wip
  • 63dde84cd: lib.yang.path: fix bugs
  • d267f225c: lib.yang.list: add identityref and leafref types
  • 275da2ae0: lib.yang.path_data: wip
  • 97a58999c: lib.yang.path: add unparse_path
  • ee4af97df: lib.yang.path_data: wip passing
  • adb40ef0d: lib.yang.path_data: fix bugs, extend tests
  • e8c9725ed: lib.yang.list: integrate state, ptree support
  • 6ff9f33d6: lib.yang.list: add struct support
  • ab96b5d8d: list lwaftr wip
  • 00ba1213f: lib.lua.StackTracePlus: pull upstream
  • 5eebd6fb9: core.main: re-enable StackTracePlus
  • 4bf08f84f: lib.yang: factor out lib.yang.ctype
  • bb9eca2da: lib.yang.list: use lib.yang.ctype
  • bc571d3ad: apps.lwaftr.binding_table: fixup
  • f3c8e18fd: lib.yang.binary: serialize struct ts for list
  • 8c8c25c5d: program.lwaftr.tests.probased.genyang: integrate
  • a3c0e399f: core.main: fallback to debug.traceback when STP fails
  • 27a5ec918: integrate lwaftr wip fixup
  • 990ab593a: lib.yang.list: fix empty iterator bug
  • 3cd57c262: lib.yang.state: fixup
  • c76441272: lib.yang.path/path_data: handle rpc schema
  • 231381d9a: lib.yang: only ever handle list objects for list productions
  • 34c432464: lib.yang.path_data: add grammar_for_schema_by_name
  • 4fc54c25f: integrate lwaftr wip
  • 7ae62e70b: lib.yang.list: use ctype if available
  • 11452752e: integrate lwaftr fix bugs
  • 264bd6af0: lib.equal: do not compare tables with metatables
  • ad5c3a55f: lwaftr integrate fix bugs
  • c2261f2b9: lib.yang.data: test ordered-by
  • 38589997e: lib.yang.list: fix ordering bugs
  • 308e56c9c: lib.yang.path_data: fix setter and remover bugs
  • b04a2613f: lib.yang.list: fix bug in field_order
  • 04c79b649: lib.yang.data: avoid redundantly optional list members
  • 0059c0b06: lib.yang.state: muffle warnings
  • 4e5633280: lwaftr: remove legacy schema and migrations
  • b0ea121c6: lwaftr: supply mandatory padding value in native_binding_table_from_ietf
  • 5bd308783: Integrate snabbflow
  • 1896a2c4d: snabb ipfix: remove class order leaf
  • 78f1a1180: lib.yang.binary: support serializing leafrefs
  • 68cd6c458: snabb-snabbflow-v1.yang: use leafrefs where sensible
  • 1553134fb: lib.ptree: fix a bug where bogus PID was logged
  • 5923add8e: ipfix probe: cleanup code, optimize operation without software rss
  • 48a174768: program.ipfix.tests.test: tweak tolerance
  • 004b6b89f: lib.yang.binary: bumb version
  • 052d8c256: lib.interlink: fix queue size race condition
  • 37628fcf8: core.shm: test parameterized types
  • acf5d8032: apps.lwaftr.binding_table: keep ctable defaults originally used in lib.yang.data
  • 84d59cd92: lib.interlink: move size to same cache line as state
  • 0183beb0a: lib.interlink: keep local copies of mask
  • 3b3c3de27: core.group_freelist: keep local copies of mask
  • 176b12624: lib.interlink: edits
  • 58be8ee03: core.group_freelist: edits

v2022.10

1 year ago

This release introduces a YANG schema for the multi-core scalable IPFIX probe developed by @alexandergall at SWITCH, “Snabbflow”. Additionally we have written a tutorial for getting up and running with Snabb lwAFTR. As usual this release also comes with various minor improvements and bug fixes.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2022.07...v2022.10

Contributors

Alexander Gall (3):

  • 101911ac8: interlink: fix shmem names in receiver/transmitter shutdown
  • 56cdc1deb: Adapt ipfix stats program to work with probe_ptree
  • 89a218f03: map_pci_memory(): set file path, increase timeout

Max Rottenkolber (97):

  • a03d3c5b5: lib.yang: support empty leaf-lists
  • 0ffd14c26: lib.yang: fix bug where native number keys caused parsing to c(l)tables
  • c501f784c: lib.yang: fix bug where value_ctype was used in native_key tables
  • 2f86ddf72: Revert "lib.yang: fix bug where value_ctype was used in native_key tables"
  • 402ecdf37: lib.ptree.action_codec: support toplevel app classes and nil app args
  • bbbea9575: program.ipfix.lib: factor pure configure functions
  • 507173f07: sketch: ipfix probe_ptree
  • ea636f46e: apps.tap: continuously scan MAC and add overwrite_src_mac option
  • 8a5d3e27b: apps.tap: add forwarding option
  • 11bbb495f: program.ipfix: use Tap app features for setting exporter src MAC and sysctls
  • c6ab421fe: App apps.snmp.iftable
  • e3f4d77a4: program.ipfix: use apps.snmp to setup ifmibs
  • 4bbd11eb8: lib.yang.data: do not derive bogus ctype for leaf-lists
  • 247761ae5: lib.cpuset: fix assertion in add, add contains/remove/list methods
  • d42c38f56: lib.ptree: scan for 'pciaddress' field in acquire_cpu_for_worker
  • 6cf6e2f90: program.ipfix.probe_ptree: pin to cpus specified in config
  • 8d04cd2a4: ipfix probe_ptree: update example config
  • 069264f10: ipfix probe_ptree: start with name
  • c814c43dc: lib.ptree: add rudimentary worker-restarting facility
  • f3fd7e78e: ipfix probe_ptree: use lib.ptree worker restarts
  • a757a8e68: ipfix probe_ptree: log_level=INFO, rename schema variable
  • 0996502b9: lib.ptree: manage worker restarts per worker configued via worker_opts
  • 97bba2361: ipfix probe_ptree: only restart dedicated exporter processes
  • 2d61cfb7c: apps.tap: overwrite_dst_mac not overwrite_src_mac
  • d585c2f77: ljsyscall: fix bug in S.sysctl where we wrote at position ~= 0
  • ab14ac35b: ipfix probe_ptree: canonicalize singular list names in schema/config
  • 88312f576: ipfoc probe_ptree: more schema cleanup
  • 42a58eee6: ipfix: probe_ptree: [wip] schema documentation
  • 3a1055ec2: core.app: setvmprofile in tick
  • aec36e681: ipfix probe_ptree: remove use-maps from schema
  • 5490392e4: ipfix probe_ptree: remove instance weight leaf from schema
  • 2fe881b44: ipfix probe_ptree: add scan-protection/enable leaf
  • 66358123b: ipfix probe_tree: raise exporter MTU default to 1500
  • 816906847: ipfix probe_tree: remove add-packet-metadata option
  • 9a5d18eff: ipfix probe_tree: more schema documentation
  • c3ce6089f: ipfix probe_tree: allow maximum ConnectX recvq_size in schema
  • 3630cf759: core.lib: equal: check object identity early
  • 4571335f4: apps.ipfix: allow full reconfig while keeping flow sets intact
  • 749ce284c: ipfix probe_ptree: support configs without software RSS classes
  • 7d7b0ed08: apps.ipfix: fix bugs in counter initialization
  • cfc509567: lwaftr: fix bug in migrate_device_on_config
  • 192a0a3c8: lwaftr: tutorial wip
  • b1d7eb9ee: lwaftr: tutorial wip 2
  • 285f3f3be: lwaftr: tutorial wip3
  • b969b9d3a: lwaftr tutorial: flowchart
  • a3a8029f0: lwaftr tutorial: edit lwaftr-veth-env.sh
  • c76a58f00: lib.ptree.inotify: turn warnings into debug messages behind flag
  • 8e94ad81a: lwaftr tutorial: supporting programs
  • a5523ead3: lib.ptree: support scalar value app configs in action_codec
  • ff74f68f3: ipfix probe_ptree: test wip
  • 4fea4ea0e: Revert "ipfix probe_ptree: test wip"
  • ebc741344: ipfix probe_ptree: add state counters
  • 3e5ac19b9: wip
  • a416c424b: wip
  • b23fe45a8: apps.ipfix: assert templates shm doesn’t already exist
  • 413cf1913: wip
  • 680a28b03: wip get.state
  • b26d0152d: lib.ptree: add acquire_cpu worker option
  • ef3a002a2: ipfix probe_ptree: do not acquire cpu core for mellanox control worker
  • 6eb81db76: lib.scheduling/lib.ptree.worker: make jit.opt configurable
  • 00112e1dd: ipfix probe_ptree: run workers with custom jit options and engine.busywait=false
  • de3a22548: ipfix probe_ptree: key rss groups / instances in snabbflow-state with id instead of pid
  • 02dcd3365: ipfix probe_ptree: device queue stats for rss groups
  • acf52dd44: ipfix probe_ptree: fix bug introduced in de3a2254
  • 1fd8e51c8: apps.connectx: fix stop() bugs
  • f34646764: ipfix probe_ptree: normalize device, app, and input link names
  • 29dfa8354: ipfix probe_ptree: guard against duplicate devices
  • 5187a9e79: ipfix probe_ptree: hide debug prints
  • 89581cffc: apps.mellanox.connectx: fix bug in IO:stop()
  • 83b9f1e9f: apps.mellanox: use default enable_counters setting
  • e2890f41a: apps.mellanox: add test case for rxdrop and per-queue rxdrop counters
  • c0a49637c: core.app: fix a bug related to getting app zone name
  • 00d233738: ipfix probe_ptree: warn on missing traffic class, throw error on missing exporter
  • 61b67a309: Replace ipfix probe with probe_tree, remove probe_rss
  • 22db66a33: ipfix probe: add common scheduling CLI opts
  • e930e4e74: ipfix probe: enable VMProfile by default
  • 722801020: apps.mellanox: make sync interval configurable, add :report()
  • 5feed3d10: packetblaster: support connectx, increase send desciptors in loadgen mode
  • bfa68ba1b: program.config: do not exit on error in call_leader
  • da4839741: Add program/ipfix/tests/bench.snabb
  • 81bd38978: apps.basic: fix bug in Truncate
  • 1ef5bee60: packetblaster ipfix: generate flows from pcap on multiple cpu cores
  • 2aae05b87: ipfix probe: update bench.snabb to use packetblaster ipfix
  • f2870ac5d: program/ipfix/tests: check in truncate_pcap script
  • d64e23c7e: ipfix probe: add --rss-goups option to bench.snabb
  • 97e9369e2: program.ipfix.lib: remove dead code
  • c508b40a0: ipfix probe: add test.snabb
  • 7c5ee4e86: ipfix probe: update collector-test.sh
  • a8c2f246c: ipfix probe: remove generate_packets.py
  • cdf1c3b11: ipfix probe: cleanup tests
  • 86e14ed20: ipfix probe: update README.md
  • 609716db0: lwaftr tutorial: fix typos, reference schema instead of source
  • 70785bed4: lwaftr tutorial: remove TODOs
  • 5a4d0b138: apps.ipfix: fix bug in selftest
  • 18d2631f4: snabb config listen: fix bug introduced in bfa68ba1bd4ccf7afe973ed21cafac9a0dcb72b5
  • 5fe89b5ba: apps.lwaftr: do not flush lookups early
  • 4706127a2: lib.ctable/lib.hash.siphash: optimize traces

v2022.07

1 year ago

This release upstreams the multi-core scalable IPFIX probe developed by @alexandergall at SWITCH, “Snabbflow”. Additionally, we have extended the core.app interface to support the new tick and per-link push methods. Other notable changes include improved inter-process link scaling, and a new benchmark for our Connect-X driver to be used in CI. As usual this release also comes with various minor improvements and bug fixes.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2022.01.1...v2022.07

Contributors

Alexander Gall (105):

  • 0f5068d13: lj_trace.c: unpatch blacklisted bytecodes when flushing traces
  • 5df67e816: lj_trace.c: Add penalty to trace abort message
  • b19d44231: intel_mp: fix range of array registers for i210
  • 51214ead7: intel_mp: add sanity checks for the number of rx/tx descriptors
  • d4a98716f: intel_mp: add queue enable counters, fix rxdrop counter
  • fe709ed26: lib.protocol.ipv4: avoid allocation for pseudo-header
  • d15cbff0a: socket.raw: don't use select()
  • 54780c240: ctable: fix power-of-2 issue
  • 300261449: Add optional callback to the CTable:resize() method
  • 0cda3d1d9: lib: disable tail-call optimization for endian conversions
  • 62d0e7221: Avoid factor-of-2 headroom in ctable
  • 4c15c4e7e: Check bound of values in lib/lpm/lpm4_248.lua
  • d4f8914c5: lib.lpm4_248: implement search in pure Lua
  • 30b1e6f24: Flush JIT traces after ctable resize
  • d59aaff93: Export flow before resetting fields
  • 5ec2a6480: Properly count records for IPFIX and NetFlow v9
  • f4e93cd92: Send full-sized export packets
  • 556bc58b4: Get flow octet counter from IP header
  • 246655c36: Add tcpControlBits to flow sets, factorize transport processing
  • 132f5b9ff: Allow multiple files as input for make_ipfix_element_map()
  • e2587ae5b: Delegate exporting packets to FlowSets
  • f40c1b104: Add counters
  • 605dac068: Add sub-program to print stats for running ipfix processes
  • a25d3538c: Add take_all() method to token bucket
  • e0d93bcbb: Make table scan time configurable
  • 30b7c4f4e: Support VLAN-tagged traffic, IPv6 extension headers
  • b36e45bb0: Support PEN, strings and octetArray in templates
  • d72d42d2a: Add optional state variables to flow cache value
  • 46263a730: Add optional template-specific stats counters
  • 57b71a036: Refactor template definitions
  • 045f48ec3: Add templates for HTTP
  • 2575d94c8: Add templates for DNS
  • 9e6d48b54: Add options to ipfix probe program, support routed tap interface
  • 463022d40: Add extended template
  • 7f6c24189: Switch to packet-metadata module from RSS
  • 24a5063e9: Allow multiple IPFIX instances in the same process
  • 817857756: Add probe_rss ipfix sub-program
  • 84b486a1d: Disable map logging in extended template by default
  • 7a9e3c82d: Add SNMP Interface MIB for PCI devices
  • 5b9e56e04: program.ipfix: redesign RSS framework
  • a15f4f380: program.ipfix: support hardware RSS in probe
  • 2c05b4c9d: program.ipfix: fix stats sub-program for redesign
  • 95ff0ca9b: program.ipfix: integrate mellanox driver
  • 5151c964d: program.ipfix: include PCI stats from control app
  • 560e5b1a9: program.ipfix: increase receive buffers for mellanox driver
  • a9e9f7fc5: program.ipfix: adapt to interlink semantics of v2018.06
  • 28cca9375: apps.ipfix: tune log messages
  • 84cbf0df8: apps.ipfix: fix selftests
  • a2097f3a5: core.app: skip array indices when traversing input links
  • 395a4f8bb: core.app: assert that links are connected only once
  • 2c7929ce9: core.app: support link-specific push methods
  • 565d7e6bc: apps.basic: apply link push methods to basic apps
  • ea076d87e: VlanMux: optimize tag pop/push
  • bc36ddbcf: VlanMux: apply specialized push methods
  • 1cfadb3f7: core.app: only call push() if the link is not empty
  • 5fb9816d8: Add housekeeping() method to apps
  • 233c8947c: Adapt to new versions of logger and token bucket
  • be1f65c5b: apps.vhost: suppress -Wstringop-truncation
  • 33eefac7b: lib.hardware.pci: add new device to supported Mellanox cards
  • b65564342: apps.ipfix, apps.rss: adapt to specialized push link semantics
  • 40373dfb7: program.iptix.probe_rss: add JIT configuration for RSS workers
  • 14e32eb70: apps.rss: mitigate unbiased branches in metadata handling
  • c1136703c: apps.rss: explicitely unroll the loop over packet queues
  • 744d6d521: apps.rss.rss: Preserve order in classes_active, fix explicite loop unrolling
  • 36476110b: program.ipfix.probe_rss: make receive queue size configurable for mellanox
  • 72f5482ea: program.ipfix.stats: use global counters when per-queue stats are not available
  • c24d55ceb: lib.interlink: increase queue size to allow bursts for ipfix
  • b2797901c: Make be1f65c5b1 conditional for GCC >= 8
  • 9bfdaae27: program.ipfix: add IF MIB for routed tap interfaces
  • 670c41117: apps.rss.rss: use specialized function to copy addresses for hashing
  • 54409f845: core.packet: increase maximum number of allocated packets
  • a1780b34f: Fix transitions in CXQ state machine
  • 90c576250: map_pci_memory: wait for kernel driver to release the device
  • 87c1a0e9b: apps.mellanox.connectx4: unbind device in IO:new()
  • 08f25ca51: apps.intel_mp.intel_mp: fix device unbinding for Intel driver
  • b47b38d42: apps.intel_mp.intel_mp: remove disable bus master cleanup
  • 8f1a48025: apps.ipfix.ipfix: move record expiration to housekeeping
  • da76c64d3: apps.mellanox.connectx4: fix mcast counters
  • 5f05daba4: lib.hardware.pci.map_pci_memory: only wait if first call failed
  • 15ef82b43: program.ipfix.probe_rss: use pools to assign collector address and port
  • afbe2bd09: apps.rss.rss: Add VLAN match capability
  • 6d5bafa2b: program.ipfix: increase logging rate
  • eb659ba9d: program.ipfix.probe_rss: add observation domain to log output
  • 58ce70ee1: program.ipfix: disable date in log messages by default, fix READMEs
  • 432f38a50: Add scan-protection feature
  • 541c0d8fd: interlink: fix shmem names in receiver/transmitter shutdown
  • b9c499e45: program.ipfix.probe_rss: restart dead workers
  • 429fa2144: program.ipfix: make maximum load-factors of hash tables configurable
  • 276a26d73: ipfix: restrict flow-rate tracker to signature flows
  • aafd550c0: program.ipfix.probe_rss: scale scan-protection rates with number of processes
  • 3620245ef: program.ipfix.probe_rss: add CPU pool and NUMA binding
  • bc9211fa7: Untabify
  • 5a47fdee5: program.ipfix.probe_rss: make CPU-pinning configurable
  • 1f082b84b: program.ipfix.probe_rss: increase logging rate limit for master process
  • 4af53457d: program.ipfix: rename ConnectX4 -> ConnectX
  • 4296bfaac: Don't export empty flows
  • fc407c203: Use proper flow start time after active timeout
  • caa11e1c6: lib.ctable: fix hugepages allocation size
  • 64a62f238: apps.mellanox: Make RX/TX flow control configurable, default to off/off
  • 4c1571fcd: apps.mellanox: Add per-queue drop stats
  • 69a15b93d: apps.mellanox: Use lib.parse in ConnectX:new() and IO:new()
  • 3a5b5aec0: apps.mellanox: Use consumer counter in cxq to simplify ownership handling
  • be7a343d4: connectx.lua: Add basic event handling
  • 7c269fa37: map_pci_memory: wait for kernel driver to release the device
  • 1c7497cb1: lib.hardware.pci.map_pci_memory: only wait if first call failed

Andy Wingo (2):

  • 907ce8194: Use binary search for all lookups
  • b457b6ec8: Add a type cache, in case that's important

Luke Gorrie (5):

  • b29666f8e: lj_trace.c: Clear penalty slot after successful trace
  • b4060ef46: lj_jit.h: Increase HOTCOUNT_MAX and expand HotPenalty.val
  • 0a907647c: fixup! lj_jit.h: Increase HOTCOUNT_MAX and expand HotPenalty.val
  • c685d8b0d: lj_trace.c: Reset hotcount table after flush
  • 544394018: lj_record.c: Relax heuristic for root trace meeting JIT loop

Max Rottenkolber (76):

  • bd5d4eca8: wip
  • 2f6b983c6: wip 2
  • e301b53f0: mellanox benchmark numa
  • aaea69bf0: add Source software benchmark to rule it out as a bottleneck
  • 763457332: measure rx at sink
  • 7f967e4d6: apps.mellanox: packetblaster
  • 9adad5263: mellanox benchmark: use packetblaster
  • 350aea922: apps.mellanox.connectx: cleanup and optimization
  • 3d86febc6: mellanox benchmark: use stats counters instead of querying HCA
  • ae5121bd6: mellanox benchmark: cleanup output
  • b1cf848bd: mellanox benchmarks example scripts
  • 87207cf98: apps.connectx: remove dead code from packetblaster
  • 0ab555fff: mellanox benchmark: add --opt option to supply driver config options
  • 312b740da: mellanox benchmark: add forwarding mode
  • 28f249a81: mellanox benchmark: add --nmacs, --nvlans paremetrs, remove source-sofftest
  • 4fa1d01cc: mellanox benchmark: fix up previous commit
  • 6c69c04dc: mellanox benchmark: add sink mode, sink halts
  • 7195667a8: mellanox benchmark: IMIX source
  • f799af237: apps.interlink: add instrumented latency benchmark
  • fbc13abec: core.packet: factor packet reclaimation from group_fl into reclaim_step
  • a9c84369b: apps.interlink: better instrumentation
  • 3b32a2ff4: core.packet: lock-free group freelist
  • e1a70b084: core.group_freelist: cache head_add/tail_remove, document
  • c0ab1b195: core.packet: better group freelist design
  • cdec562e8: apps.interlink: fix bugs in wait_test.snabb
  • d01df5898: core.group_freelist: add missing load barrier
  • 99e2a6ce2: core.group_freelist: shrink queue
  • 2ec3a89fc: apps.interlink: fremove obsolete line wait_test.snabb
  • cab614de5: apps.interlink: sort cores in wait_test.snabb
  • 328ba098e: apps.mellanox.connectx_test: make sure links are up in basic_match
  • 3cd72c244: apps.mellanox: packetblaster
  • 60ce041c4: apps.mellanox: cleanup and optimization
  • 66ab5b1b5: apps.mellanox: remove dead code from packetblaster
  • 67850d13f: Mellanox benchmark: let source linger for when TX > RX
  • ee2a70338: apps.connectx: hide event prints behind debug_info flag
  • 84cb61c7b: core.packet: ensure freelist has enough space for group fl rebalancing
  • 616e6e259: core.group_freelist: enlarge group_freelist to hold up to 2 million packets
  • 7086845fb: default.nix: remove obsolete brute-force shebang patching (breaks with newer nix)
  • c45ae8600: lib/luajit: add build artifacts to gitignore
  • a06db22aa: core.app: remove use_restart facilities
  • 840d07bec: core.app: make breathe_pull/push_order local
  • ec7e08047: core.app: add tick() app method support
  • add9e77b6: snabbmark: add micro-benchmark for tick() methods
  • e372868d7: core.app: link() 3.0
  • 0ee20907e: snabbmark: add microbenchmark for push_link methods
  • b05b08da8: src/README.md: document core.app 3.0 features
  • e9e977fe1: core.app: refactor tick() throttle
  • bc970a0b7: apps.test.match: fix selftest
  • 2895647e0: apps.lwaftr.V4V6: fix selftest (test_join)
  • c676980f8: apps.pcap.tap: fix selftest
  • 26bcea8f3: apps.rate_limiter: fix selftest
  • b6ea72733: apps.packet_filter: fix selftest
  • 30f85467a: core.app: fix bug in compute_breathe_order...
  • df9e77fe0: snabbvmx: fix lwaftr_app_check test setup
  • ed5c94794: core.app: copy app class push_link to fresh table in instance
  • 6dd5418d3: lib.hardware.pci: cleanup previous commits
  • b9f512596: src/README.md: formatting
  • addfc10f6: apps.ipfix: fix selftest
  • 1021d2c56: lib.ctable: replace MAX_MAX_DISPLACEMENT with configurable max_displacement_limit
  • fc3e37720: Revert some changes from 0c4205b5 because they break tested behavior
  • d6a641c30: lib.protocol.ipv4: add ipv4:pton_cidr
  • c23857c36: lib.protocol.ipv4/6: remove bogus methods
  • 1e948114b: apps.ipfix: use lib.poptrie
  • 45d1b07bb: apps.ipfix: fix previous poptrie usage for 32-bit ASNs
  • 657c8848f: lib.protocol: add ipv6:pton_cidr(), fix documentation of ipv4:pton_cidr()
  • c154ab199: apps.ipfix: support IPv6 prefix to AS mapping
  • 2447d1755: lib.poptrie: support 32-bit leaves
  • c89289d13: apps.ipfix: fix up previous commits
  • 9ad014b6c: lib.protocol: add dot1q header
  • a06412487: apps.ipfix: exercise extended templates in selftest
  • 04227d707: program.ipfix: pfx_to_as is now split into pfx4/6_to_as
  • 798495b07: lwaftr: softbench
  • 3d8ddccc0: lib.numa: do NUMA migrations only for >1 node systems
  • cf73e1e01: apps.mellanox: make per-queue counter creation configurable
  • d67f63dd9: lwaftr: updated ConnectX config defaults
  • 056d43472: ljsyscall: fix bug in S.sysctl where we wrote at position ~= 0

v2022.01.1

2 years ago

Fix up .version for Octarina release.

See Snabb 2022.01 “Octarina”

v2022.01

2 years ago

This release contains the a new driver for Mellanox Connect-X series NICs, an improved Intel AVF driver with support for RSS, and an experimental XDP driver. As usual this release also brings many smaller improvements and bug fixes.

What's Changed

Full Changelog: https://github.com/snabbco/snabb/compare/v2019.11...v2022.01

Contributors

Alexander Gall (24):

  • 48f608084: Cherry-picked apps.melanox from lukego/debug100g
  • 44740000e: Uncommited changes from lukego
  • 580cf9b00: connectx4.lua: minor changes
  • 10ceea423: connectx4.lua: fix alignment of HCA command queue
  • 1b9cf2b79: connectx4.lua: fix RSS
  • 83326715e: Register ConnectX5 device in lib.hardware.pci
  • 263919ade: connectx4.lua: identify driver for device_info
  • d57c67abc: connectx4.lua: add statistics counters
  • 22af8471f: connectx4.lua: use async commands to read stats counters
  • a94924561: connectx4.lua: use a factory to create HCAs
  • b4d9252d6: connectx4.lua: fix bug with async commands when debug_hexdump is enabled
  • e2eecff04: connectx4.lua: fix page sizes in CREATE_{C,R}Q
  • 76c0c80a7: apps.vhost: suppress -Wstringop-truncation
  • 56884a7d7: apps.mellanox.connectx4: add MT28800 as supported device
  • a0e85852a: apps.mellanox.connectx4: add per-queue drop counters for ConnectX5
  • fc37be48e: apps.mellanox.connectx4: unbind device in IO:new()
  • adc7d3d69: apps.mellanox.connectx4: fix mcast counters
  • 221974839: Fix transitions in CXQ state machine
  • 6cdcb40c4: apps.mellanox: free CXQ during process shutdown
  • c579524f8: apps.mellanox: use correct WQE stride in RX queues
  • 556e42779: mellanox: complete renaming ConnectX4 -> ConnectX
  • a348899c2: lib.ctable: fix hugepages allocation size
  • a86c61e17: connectex.lua: extend RSS hashing to non-TCP/UDP IP packets
  • 5f10b3b7a: connectx.lua: convert tabs to spaces

Andy Wingo (5):

  • 9a787b544: Fix snabb top interface view for multiple queues
  • 7a0c6c80c: Disable vmprofile on lwAFTR by default
  • 648c67a5c: Add 2019.06.02 changelog entry
  • 6524dec90: fix typo
  • 828fa4f4f: lwAFTR version 2019.06.02

Cosmin Apreutesei (6):

  • 45d0696b6: stub module and readme
  • 8720a606a: pci init
  • cd3a103ed: vendor/dev id
  • dfbd705c0: firmware revision register
  • 34929f1b0: print firmware revision maj and min
  • fe8065ff1: init procedure until QUERY_HCA_CAP

Luke Gorrie (24):

  • a6973da68: lib.hardware.pci: Add reset_device()
  • ccdf38e2f: mellanox: Added text/hexdump trace of Linux driver
  • 276f4fa96: connectx4: Progress on initialization routine
  • 6a426bde8: connectx4: Translate virtual to physical on demand
  • f349c4197: core.memory: Add 'align' argument to dma_alloc()
  • 8c55f664b: connectx4: Request alignment on memory.dma_alloc()
  • 2c1a92ded: connectx4: Add multi-mailbox command support
  • 6abbd96a7: connectx4: Successful QUERY_HCA_CAP query
  • 92ec4104b: connectx4: Command mailbox chaining fixes
  • 13e65509e: connectx4: Set debug = false
  • cd8e30eab: connectx4: Remove stray print statements
  • a285999e4: connectx4: Move checkstatus() into post()
  • 4575dc738: connectx4: Device initialization fixes
  • 8c0be9da4: connectx4: Comment on ommitted SET_DRIVER_VERSION
  • f196ac72c: connectx4: Added CREATE_EQ (event queue) command
  • c1cee02a6: connectx4: Added initial VPORT commands
  • 51d4d45c5: connectx4: Give 'lock' argument to map_pci_memory
  • 7659eb61f: connectx4: Clean driver initialization
  • 21d0dc36d: connectx4: Refactored for multiprocess operation
  • f08da3c33: connectx4: IO app now has only 1xSQ and 1xRQ
  • ffe4a22be: connectx4: Add 'mtu' paramter (default 9500)
  • 06c43f034: connectx4: Cleaner (simplistic) selftest method
  • e367b6b69: connectx4: Fix recv completion queue wrap-around
  • 42c2196a6: mellanox: Rename ConnectX4 -> ConnectX (because it works with 5+ too)

Max Rottenkolber (150):

  • 77e548cab: Squashed 'lib/ljsyscall/' changes from d78235c50..e587f8c55
  • 09b29d986: ljsyscall: add some XDP constants
  • 3f8201071: ljsyscall: fix a bug in getsockopt when querying for structs
  • 1e176cb1c: ljsyscall: lookup strflags in linux bpf(2) wrappers
  • 573a29b05: ljsyscall: add BPF_MAP type XSKMAP
  • 63f0cfeb2: apps.test.synth: add packets option
  • f53552561: apps.test.synth: emit all given packets
  • 61745637f: core.packet: expose constants for packet alignment and headroom
  • 984d4a41c: apps.xdp: driver for AF_XDP sockets
  • e056fa1ca: Remove src/xdp.snabb (accidentally checked in xdp proof of concept)
  • ee4e42d23: core.packet: expose free_internal
  • b67729262: apps.xdp: fix free stats accounting, cleanup fill/completion mngmnt
  • 1b3593f47: apps.xdp: add duplex test case, fix random_v4_packets
  • 22d754c14: apps.xdp: cleanup bpf_ld_imm64/LD_MAP_FD construction
  • 4e318568e: apps.xdp: generate more descriptive errors on bind(2) failure
  • e53f314b0: apps.xdp: fixup comment about engine breath stimulation
  • d225e75b5: apps.xdp: make num_chunks configurable in snabb_enable_xdp(opt)
  • d44fb1d56: apps.xdp: do not leak packets in XDP:stop()
  • f8cb80c8c: apps.xdp: munmap(2) rings in XDP:stop() (do not leak rings mappings)
  • e06c82fab: apps.intel_avf: use new PCI acccess API (fix integration breakage)
  • 7722f0d8b: apps.intel_avf: free resources on shutdown (fix leak)
  • 6c330ecf5: lj_syscall: add BPF_OBJ_* syscall wrappers, extend bpf_attr union
  • ea955a8bc: apps.xdp: allow sharing interfaces between Snabb processes
  • 01f11e970: pflua: do not cdef struct bpf_ins (collides with ljsyscall)
  • ae35674a1: core.app: add clearvmprofiles() function
  • 1124b80f7: lib.timers.ingress_drop_monitor: clear vmprofiles on flush
  • 8f2a2161d: lib.timers.ingress_drop_monitor: reset last_value on drop-free period
  • 63968f69c: raptorjit: clear all hotcounts every second
  • dfadac832: raptorjit: amend prev. commit, also clear trace exit hotcounts
  • b7c50cbba: raptorjit: amend prev. commit, do not clear SNAPCOUNT_DONE
  • bd84224c2: apps.xdp: expose driver reference
  • 1a9eba523: lib.scheduling: add enable_xdp option
  • 18cc3658f: apps.xdp: kick tx queue if not empty
  • 19072b494: lib.yang.data: reorder translated members before printing
  • ae4f734fe: snabb config: use consistency checker in command parsing
  • 05b495ea6: lib.yang.path_data: expand choices in consistency checker
  • e96ae1a71: lib.yang.data: rework 19072b494 (remove order parameter) add tests
  • 95d3a741e: lib.yang: remove leftover debug print
  • 3fdf926db: pflua: fix typo bug in native codegen (xor/or emission)
  • 07acce271: pflua: make regalloc architecture independent
  • cd4d77381: apps.xdp.bpf: add basic disassembler, endiannes opcodes
  • 48ff71cd9: apps.xdp.pf_ebpf_codegen: add eBPF backend for pflua
  • c158ac824: apps.xdp: add filter option (offload non-matching packets to kernel)
  • 6b5851a4c: lib.numa: gracefully handle failure to read CPU performance governor
  • 16c99eda8: lib.ptree: cleanup obsolete aggregated stats
  • 0068df612: arch/checksum: fix bug in carry propagation
  • 3461a095d: apps.xdp: only run rxtx_match selftest if SNABB_XDP_NQUEUES=1
  • 00cac3632: apps.xdp: debug stop()
  • 8d4ee134b: apps.xdp: mark stop() NYI / not supported
  • 2bcc644bb: lwaftr --xdp sketch
  • dca300464: snabb-softwire-v2: add default for leaf error-rate-limiting/packets
  • 8c2000b74: apps/ipv4,6/reassemble,fragment: handle padded packets
  • 561b52a44: lwaftr/setup: fix interfaces for bump-in-the-wire Interfaces used in bump-in-the-wire configurations were swapped, possibly during a prior refactor. Undo this.
  • 1cdc6352d: snabb-softwire-v2.yang: documentation edits
  • 6bcce09e3: lib.numa: gracefully handle failure to read CPU performance governor
  • 191581a88: apps.lwaftr.ndp: send NS via solicited node multicast
  • 4817ae822: lwaftr: support vlans in XDP mode
  • 004587b50: lwaftr: automate linux interface setup for XDP
  • bce8579eb: snabb-softwire-v2: allow more than two queues
  • 909dca7a1: lib.protocol.ethernet: add ptoi used by connectx driver
  • 6bca98b8c: apps.mellanox.connectx: fixup lib.hardware.pci usage
  • 832ea9dfa: apps.mellanox.connectx_test: traceprof is now part of RaptorJIT
  • d58ce744c: apps.mellanox.connectx_test: get PCI addresses from environment
  • 6036de6f7: lib.protocol.etherenet: do endian conversion in ptoi
  • bf84158a3: apps.connectx: selftest fixups
  • fc7dfd291: apps.mellanox.connectx: support RSS + MAC/VLAN
  • 55ea547d0: Revert "apps.mellanox.connectx: support RSS + MAC/VLAN"
  • 680355e2b: apps.mellanox.connext: fix data segment address translation in sq:transmit
  • 740b63c9d: Revert "Revert "apps.mellanox.connectx: support RSS + MAC/VLAN""
  • 22d2619d9: apps.mellanox.connectx_test: test MACVLAN+RSS
  • 4b0487d15: apps.mellanox.connectx: invert MAC/VLAN hierarchy in macvlan_rqlist
  • 704126c38: apps.mellanox.connectx: switch multicast packets when using MAC+VLAN
  • 6d18bea2b: apps.mellanox.connectx_test: exercise L3-only RSS
  • d4a108358: lwaftr: keep full config in worker setup
  • 907fb7748: lwaftr: add mellanox.connectx driver support
  • 4c84dd0ee: apps.intel_avf: add multiqueue/rss support
  • 8c151eab1: lwaftr: add support for intel_avf driver
  • e3dd48ff4: apps.intel_avf: add VLAN filter/stripping/insertion support
  • dbc4f3430: lwaftr/lwutil/setup: refactor, add num_queues, is_lowest_queue
  • 448d626aa: lib.hardware.pci: add Intel X710 device info
  • d54e29d1f: lwaftr: support auto-config of AVF-compatble NICs
  • 80557cfe8: intel_avf: move bits() constructor out of fast-path
  • be7dc0840: program.lwaftr.setup: remove bogus stale require
  • 263c4e2f8: lwaftr.setup: fix error reporting in cmd util
  • 6df64ca89: core.lib: fix error detection in writefile
  • 720235f05: lwaftr.setup: print more useful error message... when unable to write sriov_numvfs
  • fa553a6e8: apps.intel_avf: move device stats to pci/
  • 85428eab2: snabb top: handle devices that do not specify speed
  • 89c48fc67: lib.ptree: start manager before setting initial configuration
  • 4379d1ccd: snabb-softwire-v2.yang: fix descriptions of device leaves
  • 98e97b407: Revert "snabb-softwire-v2.yang: fix descriptions of device leaves"
  • 75a3373ee: Revert "lwaftr: keep full config in worker setup"
  • bff9d0fab: lib.numa: gracefully handle unset PATH in assert_irqbalanced_disabled
  • b97ccc25c: Revert "snabb-softwire-v2: allow more than two queues"
  • 21013be89: Revert "snabb-softwire-v2.yang: documentation edits"
  • f903e0f84: Revert "snabb-softwire-v2: add default for leaf"
  • 0288de4ac: lib.yang.data: parse defaults of nested leaves
  • eea42d2b6: lib.numa: do not migrate pages from preferred node
  • 1588452ed: lib.protocol.ethernet: fix truncation bug in ptoi
  • a6734ae53: lwaftr: qualify shared_next_mac_key with vlan
  • c1c4854d1: core.packet: fix account_free physical capacity formula
  • 8c44e614d: apps.intel_avf: fix IRQ setup for additional queues
  • 18fc9f5bf: lwaftr: fix bugs introduced in 75a3373e
  • 3c669a905: lwaftr: create snabb-softwire-v3
  • faeb6ffaa: snabb-softwire-v3: fix mistakes in leaf descr.
  • 2dddff659: snabb-softwire-v3: Add default value for error-rate-limiting/packets
  • eff1a9ae4: snabb-softwire-v3: allow more than two queues
  • 1f8ee8172: snabb-softwire-v3: external-interface/device -> external-device
  • d75f07930: lwaftr: use snabb-softwire-v3 schema
  • e06c198aa: apps.ipv4.arp: add request/reply counters
  • e3b400ac1: apps.lwaftr.ndp: add NS/NA counters
  • 6f5e90577: apps.ipv{4,6}.echo: add echo I/O counters
  • bd914c121: lwaftr/snabb-softwire-v3: state additions and fixes
  • 37cfb3625: apps.intel_avf: add option to add additional macs
  • 2bfba7132: apps.intel_avf: update README.md
  • b112c94ea: lwaftr: configure internal-interface multicast MAC address for intel_avf
  • d3a30c6bf: lib.protocol.ethernet: remove ptoi apps.connectx: use lib.macaddress instead of ptoi
  • ee37d77d0: apps.intel_avf: add multiqueue/rss support
  • 451aeecf6: apps.intel_avf: add VLAN filter/stripping/insertion support
  • ce533cf73: lib.hardware.pci: add Intel X710 device info
  • 3a39748b6: intel_avf: move bits() constructor out of fast-path
  • b2ac1c3a9: apps.intel_avf: move device stats to pci/
  • 7566bcf3c: snabb top: handle devices that do not specify speed
  • dae106165: apps.intel_avf: fix IRQ setup for additional queues
  • 5ccf47982: apps.intel_avf: add option to add additional macs
  • d22af4f19: apps.intel_avf: update README.md
  • dc4042651: apps.test.synth: add packets option
  • 355051b03: intel_avf: truncate CRC from received packets
  • d3fd3e722: intel_avf: more robust HENA configuration
  • 991acd98e: intel_avf: fix tests, separate RSS tests, add VLAN, multicast tests
  • 6845091b2: intel_avf: add explicit VLAN test case
  • 9c83c2561: intel_avf: fix rx/tx packet lengths
  • c1220bed5: apps.mellanox: add ConnectX 6 type
  • 5b68b01f3: apps.mellanox.connectx_test: add multicast and checks
  • cc59d6456: apps.mellanox.connectx: implement stop()
  • ad4c941cf: apps.mellanox.connectx_test: exercise stop()...
  • d36174e00: apps.mellanox.connectx_test: add match test
  • bf1322e74: apps.mellanox: add README
  • 22f950cd9: lib.hardware.pci: add mellanox MT2892 Family [ConnectX-6 Dx] model
  • ffb0ba950: apps.xdp: only run rxtx_match selftest if SNABB_XDP_NQUEUES=1
  • 1a5f7c47f: apps.xdp: mark stop() NYI / not supported
  • 7b0d35bce: lwAFTR 2022.01.13
  • 1531f37d9: apps.ipv4.arp: fix selftest
  • 3f3c40cf0: lwaftr: update end-to-end test data
  • 247ef95c1: core.packet: revert globalization of newly exported variables and functions
  • 5f045e7d6: core.app: setvmprofile unconditionally
  • 52048a93a: Fixup previous commit: remove unused profile option in lib.ptree.worker
  • 862af2cf7: Fix regression in config-migrations
  • 992a84511: lwaftr migrate-configuration: support snabb-softwire-v2, fix bugs
  • 6bd9e7aa6: snabbnfv: do not load ingress_drop_monitor

v2019.11

4 years ago

Lots of new gadgets in this release: a Snabb driver for Intel AVF based Virtual Functions (virtualized NICs) such as provided by Intel X710 and XL710 based NICs, a new optimized Poptrie implementation for all your longest-prefix-match needs (lib.poptrie), VMDq support for Intel i350 based NICs, support for 256-bit AES keys in lib.ipsec, and much broader support for YANG language features in lib.yang. As usual, this release includes numerous additional small improvements, optimizations and bug fixes.

Changes

  • #1314 #1381 #1382 #1438 Additions , optimizations and bug fixes for lib.ipsec. New: support for AES 256 (256-bit keys).
  • #1443 Fixed a bug in statistics collection in apps.intel_mp (Intel 52899 driver)
  • #1442 Fixed a bug where belated opening of auditlog would fail due to initial JIT activity (open it earlier)
  • #1397 Added a fast, generic Poptrie implementation (lib.poptrie)
  • #1390 Fixed a bug that prevented shared packets from being released to the group when a process is stopped
  • #1416 Added support for YANG enumeration types to lib.yang
  • #1357 Various bug fixes and improvements to snabb loadtest
  • #1431 Fixed a bug in core.memory that caused SIGSEGV handling to fail to recent RedHat Linux distributions
  • #1427 Fixed a crash in snabb ipfix probe when the duration flag was not provided
  • #1423 lib.hash.siphash: improved compatibility with reference implementation
  • #1421 core.app: simplified loop structure of engine to help the JIT find better traces
  • #1353 Added VMDq support for Intel i350 based NICs to apps.intel_mp, and fixed some statistics collection bugs for i350/i210 based NICs
  • #1376 lib.yang: changed implementation to use native Lua number keys for parsed YANG data where possible
  • #1435 lib.yang: added support for unique, min/max, and choice keywords
  • #1436 apps.intel_mp: make sure PCI device is unbound from Linux driver before mapping its memory into the Snabb process (previous behavior caused crashes with recent Linux kernels, see issue #1286)
  • https://github.com/igalia/snabb/pull/1231 lib.fibers.timer: fixed a bug in timer event promotion
  • https://github.com/Igalia/snabb/pull/1224 lib.yang: added support for if-feature expressions
  • #1448 Merged lwaftr release v2019.06.01 into Snabb
  • #1444 apps.intel_mp: added support for Tx->Rx MAC Loopback mode, and fixed related bugs
  • #1446 Added apps.intel_avf, a driver for Intel AVF capable NIC virtual functions (Intel X710, XL710, ...)
  • #1445 #1433 #1427 Various minor bug fixes and improvements
  • #1432 Bug fixes and improvements to SnabbBot, our CI robot

Contributors

Alexander Gall (4):

  • 5724ff25d: lib.yang.schema: implement semantics for enumeration type
  • 4989b99f5: lib.yang.data: add test-case for enumeration type
  • 8c616b0cb: core.app: use implict pull/push loops in breathe()
  • edc07fca7: lib.hash.siphash: add option to comply to reference implementation

Andy Wingo (28):

  • a805f9241: Re-enable NUMA memory binding on newer kernels
  • 3809be24b: Detect version mismatch when loading compiled YANG configurations
  • 69764b582: Remove bogus lwaftr benchmarking file
  • 7f2a1d25b: Fix PCI affinity check for --preferred NUMA binding
  • a27d8b3a3: Add more system performance diagnostics
  • ecd443c76: Detect irqbalance presence and suggest remedy
  • 9f7177bc9: Fix uninstall advice for irqbalance
  • e1af4f9d6: Improve snabb lwaftr run --help
  • a004e9a43: Fixup to snabb lwaftr run --help
  • fbf585ef5: Refactor packetblaster lwaftr to re-use vlan, arp, ndp, v4v6
  • 7886344a2: Separate B4 and internet lwaftr load generation apps
  • 14c725520: Allow different IPv4 MAC addresses and VLAN tags; fix bugs
  • b63f1969e: Fix whitespace
  • 1b74cf9ce: Fix source IPv6 from B4, and better interleaving of streams
  • e7a60d3f0: Fix frame sizes. Update test files for fresh checksums. Allow for ordering differences between v4 and v6 packets. Stop in a more robust way.
  • 94d123a27: Fix inc_ipv4
  • f1050ec10: Start ingress drop monitor in grace period
  • bd822d9c0: Bump snabb-softwire-v2 revision dateD
  • 516306afc: Add v2018.09.03 changelog
  • acd54d905: Update version to v2018.09.03
  • b4c907319: Fix promotion of lib.fibers.timer events from outer to inner wheel
  • 0e9e5d918: Make memory monitor a timer instead of an app
  • cc4acb5a0: Revert "lib.ptree: do not aggregate (ignore) counters that are symlinks"
  • 79075f595: Snabb lwAFTR 2019.06.01
  • 157723831: Fix markdown syntax
  • be0656089: Add link to upstream release notes
  • a283e7b13: Add link to YANG module
  • c2015ea0b: Fix release benchmarks to always specify CPU

Asumu Takikawa (1):

  • 8e8ad6447: ipfix: fix done state checking in ipfix probe

Luke Gorrie (1):

  • 70dd8799b: README.md: Update Slack invite link

Max Rottenkolber (160):

  • 25a8d95c3: snabb_bot: delete $tmpdir on startup
  • 971627f04: snabb_bot: configure git user name and email
  • 29e230361: snabb_bot: add timeout to cushion broken test cases
  • 6d1594aee: snabb_bot: print SNABB_PCI_INTEL1G{0,1} / snabb_doc: set git user/email
  • 44f6ab049: snabb_doc: fixup git user/email config
  • 59b1b82bc: apps.ipsec: add tunnel mode esp app
  • 17e8c6cc3: snabbmark esp: add rudimentary PMU analysis
  • 461f195a2: lib.ipsec.aes_128_gcm: add rudimentary PMU profiling to selftest
  • 9d14b98ed: snabbmark esp: fix bug where packets of wrong size were constructed
  • 7f75dc101: snabbmark esp: minor changes
  • bb72e66bd: lib.ipsec: add missing licensing headers
  • 53ae8bdf6: lib.ipsec.esp: correct bogus note about IP fragment handling
  • 531170a77: lib.ipsec.esp: avoid lib.protocol.* on the fast-path
  • 43d498a26: lib.ipsec.esp: use full 16 (instead of 12) byte ICV
  • 66a0dbb70: lib.ipsec.esp: keep lib.protocol.esp*
  • 65f0a75e1: snabb_bot: fix bug that compared benchmark results with wrong target
  • f49720af5: snabb_bot: make checkout/merge more robust
  • 2814b7b9b: intel_mp: fix broken per queue stat accumulation
  • 9c4e3ee60: intel_mp: VMDq support for i350
  • 33c091209: apps/intel_mp: RQDPC is actually an RC register on the i350
  • 283d6a828: loadtest find-limit: fix some edge cases and bugs
  • 90c3be721: snabb_bot: fix bug in benchmark regression testing
  • 32586f3e8: lib.yang.data: represent some number-keyed lists as Lua tables
  • 8269afeb4: lib.yang.binary: support number-keyed Lua tables in ad-hoc grammars
  • 07821cf88: lib.yang.path_data: s/string_key/native_key
  • 796c177a6: lib.ipsec.esp: optimize padding by specializing for power of two
  • 5b86f9409: lib.ipsec.esp: fix a packet leak in :resync()
  • 2bd39aee5: intel_mp: fix 1G blast selftest via use of RateLimitedRepeater
  • 9ea857e97: intel_mp: port more vmdq tests to 1G cards.
  • afc971b71: intel_mp: revert queuing -> queueing spelling change from 9c4e3ee603
  • 691b5a1c6: lib.yang.data: return single value from normalize_id
  • 1bff54323: lib.yang.path_data: add unique restriction consistency checker
  • 5d00ae90e: lib.yang.path_data: run consistency_checker in parser_for_grammar
  • c7a655e11: lib.ptree: run consistency checker on initial_configuration
  • 1c9642e16: core.packet: release packets to group freelist on shutdown
  • ac45e3ff6: lib.interlink: fix an off-by-one bug in the tostring method
  • 553378201: core.packet: do not append .freelist in freelist_create/open)
  • 78cf3c32f: main.shutdown: unlink supervisor shm root
  • ace9b3264: Revert "main.shutdown: unlink supervisor shm root"
  • c6b32f41b: core.packet: require explicit initialization of packets freelist
  • 482c3a510: Work-in-progress implementation of Poptrie
  • 3234b1fef: Add basic documentation for lib.poptrie
  • 9343b36ab: lib.poptrie: fix building empty RIB and repeated calls to build()
  • 4e48a25f6: lib.poptrie: refactor :build() into smaller methods...
  • 77cd0a737: lib.poptrie: implement direct pointing
  • b5fcbfb3c: lib.poptrie: do not print zero value leaves in fib_info
  • 92bc6c637: lib.poptrie: optimize build(), cover direct pointing in PMU analysis
  • 3fcc794be: lib.poptrie: make s (bits used for direct pointing) configurable
  • db1320f08: snabb_bot.sh: do not attempt to initialize submodules
  • 703eb9a49: intel_mp: work around flaky mirror test on i350
  • ab7719731: lib.yang.data: make table_native_key a bit easier to follow
  • 17871d460: lib.yang.binary: minor coding style change
  • d29763d1f: intel_mp: fix a bug in VMDq BAM (bcast accept) handling for the i350
  • 6be165ea3: intel_mp: add VMDq broadcast tests
  • 69b6ca1e0: intel_mp: fix selftest from the future
  • 7b52cf894: lib.yang.data: fix bug that prevented top-level choices being parsed
  • 0893b1653: lib.yang.data: fix bug when parsing list members of choice cases
  • 5eb385785: lib.yang.data: correctly parse choice case short form.
  • 6ff14eff5: lib.poptrie_lookup: incorporate peter’s suggestions
  • bed7ec21d: lib.poptrie_lookup: comment formatting
  • ab0cfaf83: lib.poptrie: extend to support lookup32/lookup128
  • 4e7168096: lib.poptrie_lookup: fix bug where offset was not set correctly
  • 6211b05fb: lib.poptrie_lookup: optimize lookup128, prefer 32-bit operations
  • 4f8ed1f1e: dasm_x86: import ADX/BMU/FMA3 instruction support from LuaJIT:v2.1
  • 7283f7104: lib.poptrie_lookup: use BMI2 instructions when available
  • 5ca45780a: lib.poptrie: avoid cache thrashing in micro benchmark
  • 55f778873: lib.ptree.support: fix bug related to native table keys
  • 355b03359: lib.poptrie: fix out of bounds read in add
  • 4c88093fc: lib.poptrie: avoid slow down incurred by ASM routines as upvalues
  • ff13dd2d4: !fixup previous commit
  • 2b613adba: lib.poptrie: reformulate extract
  • e22dcd8d5: lib.poptrie: add test scaffolding for testing different configs
  • 4e9379bb4: lib.poptrie: update a comment
  • 7f92167d8: lib.poptrie: cache generated ASM code
  • 8419101f0: lib.poptrie: expose micro-benchmark parameters via env vars
  • 6a684a96c: lib.poptrie: fix up to previous commit
  • 125facdf1: lib.poptrie: update README
  • 1baf303bb: lib.yang.path_data: fix bug where key_ctype was preferred over native_key
  • 3f16ef739: snabb_doc.sh: support multiple tags pointing at the same commit.
  • 7a7110ee5: core/memory.c: fix mmap usage in SIGSEGV handler (see issue #1429)
  • f95e33b73: scripts/dock.sh: do not expose unset environment variables
  • 6d888d0d1: snabb_bot.sh: run as many tests as possible, don't abort on failure
  • 718f8ebb8: lib.yang: implement min-elements and max-elements restrictions
  • 1d20f3cbd: apps.intel_mp: fix race condition in test_10g_counters.sh
  • 71ef55f96: lib.yang.path_data: handle key_ctype in consistency check visitors
  • ab7e5cd00: lib.yang.data: fix influxdb_printer_from_grammar to use native_key
  • c9adc44b7: lwaftr: iterate over native keyed tables with pairs
  • 64fa68b94: lib.ptree.support.snabb-softwire-v2: translate native tables correctly
  • e80cf0014: lib.yang.path_data: properly handle ctables in consistency checker
  • 0bfa3d494: lib.hardware.pci: separate PCI resource opening from memory mapping
  • 94c5630ca: lib.hardware.pci: reformulate shutdown for shared PCI resources
  • 817c8d7a4: core.lib: accept whitespace and error on missing bytes in hexundump
  • 6110b285a: apps.keyed_ipv6_tunnel: fix hexundump usage
  • 59c767e84: lib.ipsec.aes_128_gcm: use new hexundump capabilities
  • 7304f4b8c: lib.ipsec.aes_*: add support for AES256
  • 93ffd0443: lib.ipsec.aes_*: reorganize, expose AES256-GCM to lib.ipsec.esp
  • 4add8425f: lib.ipsec.aes_gcm: document usage
  • fec6c57cc: lib.ipsec.aes_gcm_avx: support large AAD, extract AAD hashing
  • 51a1389a3: lib.ipsec.aes_gcm_avx: some edits and clarifications in comments
  • b4f12f0fc: apps.ipsec: extend Linux interop test to cover AES256
  • 06e7ac789: Fixup merge conflicts/gaps between 68817961b and cf8a711f8
  • f2d5b0ee4: lwaftr: instance.queue is now a native table (iterate using pairs)
  • dd9a69aca: intel_avf: tweak tests for single port operation
  • 707aee56d: lib.rrd: fix a bug due to implicit casting
  • 05be3a029: lwaftr/apps: add memory_info.MemoryLog app to log mem in use to RRD
  • 7d56e5174: lwaftr: configure MemoryLog app for lwaftr instances
  • 286a31fe7: lwaftr: replace MemoryLog w/ MemoryCounter (ptree man. gen. rrd)
  • 848ed4ac3: lib.gauge: add SHM object type for gauge values
  • 77b14006f: apps.lwaftr.memory_info: use lib.gauge to expose a gauge SHM object
  • 4c22c414f: lib.pree: support aggregating and RRD generation for SHM gauges
  • 3dec0d397: core.main: open auditlog during initialization
  • 983094ab9: Add new ietf-softwire-br, ietf-softwire-common schemas
  • b019947a7: Add discontinuity-time to snabb-softwire-v2's softwire-state
  • a39495e0a: lwaftr: updates for draft-ietf-softwire-yang-16
  • d3a641dd4: ietf-softwire-br: temp. patch around unsupported if-feature bool exp
  • b188164c6: program.lwaftr.tests.propbased.genyang: fix a bug wrt empty structs
  • 2e51c8609: lib.ptree.support.snabb-softwrite-v2: add test cases, fix bugs
  • d6b6ea0d6: lwaftr: map ietf instance name to (singleton) lwaftr name
  • 5a297207c: lib.ptree: pass current config to translator.get_state
  • d3d1f04ac: lwaftr/tests/test_env.py: add opt. expected ret. code arg to run_cmd
  • 80ac63853: lwaftr: add more test cases, bug fixes for support.snabb-softwire-v2
  • 7a17eba90: snabb-softwire-v2.yang: declare softwire/b4-ipv6 unique
  • 189c48295: src/Makefile: s/-/_/g in TESTMODS to allow selftests...
  • 7f00119cf: lib.ptree.support.snabb-softwire-v2: remove left over debug prints
  • fc0877e0c: lib.ptree.support.snabb-softwire-v2: fix error reporting bugs
  • 59d5f3867: Revert "ietf-softwire-br: temp. patch around unsupported if-feature bool exp"
  • f8da9c71c: lib.maxpc: add match.string
  • caf686dc9: lib.yang.schema: implement parsing of YANG 1.1 if-feature expressions
  • c3df85ae8: lib.yang.schema: remove debug tracing (see previous commit)
  • 2a73e9eb6: Add `snabb rrdcat' tool to summarize RRD archives
  • 7b9fb520e: intel_mp: count total packets dropped in rxdrop counter
  • cb17d4369: intel_mp: include sum of all queue drop counters in rxdrop
  • 433f716ce: snabb rrdcat: plot error lines only when bounds are known
  • 815ac5987: intel_mp: implement mac_loopback option for 82599 chips
  • 8879ff05b: intel_mp: Enable VM TX loopback in VMDq mode
  • cd528a6b4: intel_mp: fix ineffective null pointer test in 82599 transmit loop
  • 555e4c8d5: lib.ctable: avoid GC in lookup streamer
  • ac65ee045: BTLookupQueue: avoid cdata allocation by get_lookup
  • daf7bdbfd: lib.binary_search: cache and reuse generated variants
  • f7d0f8c8e: lwaftr.rangemap: cache and reuse entry types to avoid leak of ctypes
  • 616067ee6: lib.multi_copy: cache and reuse generated variants to avoid leaks
  • 83a8fd046: lib.hash.siphash: cache and reuse generated variants to avoid leaks
  • c17080993: lib.ctable: remove redundant memoization of binary_search.gen
  • 06f83961e: lib.yang, lib.ptree: cleanup temporary SHM files after use
  • 0f695d9c7: timers.ingress_drop_monitor: use app:get_rxstats() (was app:rxdrop())
  • 0c93c4187: lib.ptree: do not aggregate (ignore) counters that are symlinks
  • 20c303c0b: Make previous commit (0c93c4187) robust against races.
  • 775fd288d: Revert "snabb-softwire-v2.yang: declare softwire/b4-ipv6 unique"
  • 791a8a97e: snabb-softwire-v2: warn on duplicate b4-ipv6 when transl. to ietf
  • b3916a2ca: support.snabb-softwire-v2: make sure instances share no state
  • 6ec7fa217: apps.test.synth: fix some bugs in 4a04933 (add random_payload option)
  • 88d2a56ab: intel_avf: execute test via selftest.sh
  • f8949837d: intel_avf: minor cleanup
  • d1bd9fdef: intel_avf: extend, and further document reset delay
  • fece51f0d: intel_avf: fix truncation of outbound packets
  • 3d47c0f54: intel_avf: integrate with lib.hardware.pci device_info
  • 7f463052a: intel_avf: async stats synchronization
  • 2bd2e4e57: intel_avf: alias SHM direction to canoical pci/ location
  • ac979981a: intel_avf: ensure RSS HENA caps are disabled
  • e231faa9c: intel_avf: add rxdrop()/txdrop() methods (used by loadtest)

Pete Bristow (9):

  • 31c8d7877: Initial import of intel_avf driver
  • 4a0493364: expand synth to generate random payloads and include a packet id, add apps.test.npackets an app that only sends n packets from input to output
  • e9ee3b92b: add a back2back test to intel_avf
  • bde5725e1: Expand intel_avf/tests/back2back to test mbox_sr_stats and deliver 100million packets
  • cc9fd9a50: Fix the issues in intel_avf discovered with the previous test.
  • ee2c68800: roll back to mbox_sr and remove unexplained / untested sleep
  • 19b616497: add more tests and make sure they pass, add stop() support to app
  • f752f6dc6: FACTPS was missing a type parameter
  • e50404a2f: only allocate mbox queues if required

v2019.01

4 years ago

This long awaited release is the first Snabb to ship with RaptorJIT and runtime support for the Studio diagnostics environment. The Snabb top monitoring tool is replaced bya more interactive rewrite, and its basic SHM object listing functionality is spun out to the new snabb shm utility. In addition to bug fixes and optimizations, this release also includes improvements to lib.yang and our IPv6 fragmentation apps as well as support for current versions of nDPI.

Changes

  • #1316 Integrate RaptorJIT with Snabb
  • #1401 Merged lwAFTR release v2018.09.02
  • #1386 Add snabb shm: simple tool to print information about Snabb SHM objects
  • #1384 apps.ipv6.reassemble: add expiration of incomplete reassembly buffers
  • #1383 Add path MTU discovery to IPv6 fragmenter (apps.ipv6.fragment)
  • #1275 lib.checksum: optimize IP checksum computation using DynASM
  • #1368 Support nDPI 2.X in ljndpi
  • #1380 Fix a bug in apps.vhost.vhost_user with regard to NUL-termination
  • #1385 Move logger in core.lib to lib.logger
  • #1392 VlanMux: optimize tag pop/push (apps.vlan)
  • #1394 #1395 #1396 Ctype diversity related optimizations

Contributors

Alexander Gall (22):

  • 796597d4c: lj_trace.c: unpatch blacklisted bytecodes when flushing traces
  • 2ad681783: ipv6.reassembly: avoid packet cloning
  • 0463915d5: ipv6.reassembly: expire stale reassembly buffers
  • ffd584c36: ipv6.reassembly: reduce scope of local variables in handle_fragment()
  • 66a757522: Add PMTUD to apps.ipv6.fragment
  • a9a4b7296: ipv6.fragment: improve performance, reduce garbage
  • 7f0703ada: ipv6.reassembly: perform reassembly in separate loop
  • dd9bb127e: Refactor the logger facility
  • 2bbaa390f: lib.tsc: cache calibration of rdtsc
  • 477b4c534: VlanMux: optimize tag pop/push
  • 8f7678224: intel_mp: fix ctype diversity for txdesc_t
  • cff919c5a: packet: cast pointer arg in from_pointer()
  • f89645823: datagram: canonicalize pointers in packet append() and prepend() calls
  • d06314cbd: lwaftr.ctable_wrapper: add cleanup function to random eviction
  • a44d8e1f3: apps.ipv6.fragment: canonicalize pointers, simplify ICMP matching
  • 4e2869082: apps.ipv6.reassemble: fix packet leak
  • d7a51c6b4: apps.ipv6.reassemble: avoid spurious sort
  • 2e5b5e89b: apps.ipv6.reassemble: copy header from first fragment
  • f7a00fff1: apps.ipv6.fragment: fix bug in ICMP type match
  • 57cc28065: apps.ipv6.reassemble: remove over-eager optimization of module operator
  • d054ec014: apps.ipv6.reassemble: use max_payload constant in packet size check
  • 69473ebd7: apps.ipv6.reassemble: fix check for valid packet length

Andy Wingo (122):

  • 634ab2439: Remove duplicate lj_auditlog.c
  • 2914e5af0: Make file-local auditlog variables static
  • 8119e5d36: Remove references to the profiler, -jv, -jdump, and the like
  • bbd763561: Remove references to -jv, -jdump, and the like
  • 694313518: Revert "Merge pull request #1040 from lukego/dynasm-gc64-nocoerce"
  • a91e4577e: Add ring buffer module
  • 252257c4b: Add basic IO streams
  • 5ceb3c84e: Add file stream implementation
  • ddb6a8ea2: Add full replacement for Lua's "io" module
  • fed20342b: Move io.open implementation to lib.stream.file
  • 5ee535744: YANG output byte streams use new Lua streams
  • 311bea2a4: Move tmpfile() impl to file.lua; add optional perms arg
  • 8a0b09801: More YANG output byte stream refactoring
  • 55deb49bf: Add some helper methods to Lua streams
  • b27a00c58: Remove calls to :align() output to ffi natural sizes
  • a2fda310b: Remove unused open_output_byte_stream function
  • 0e5f45f73: Remove unused lwaftr rangemap load/save capabilities
  • a36169771: Replace lib.yang streams with lib.stream streams
  • 0512a8f42: Remove YANG streams
  • 810c81e8e: Add memory-backed stream implementation
  • 5d1b830fb: Migrate YANG and related libs away from ad-hoc string_io_file
  • 949e663a7: YANG syntax parser is now streaming
  • 7e45ce3cf: Fix use of undeclared variable (refactor residue)
  • 1a33991a2: Fix default EOL handling style
  • ce3b8ade6: Fix error reporting in "listen" test
  • 3805a3af3: Fix top-level scalar parsers to take stream as argument
  • ac8e74ee5: File streams query OS for appropriate block size
  • 91560fa59: Adapt "snabb config listen" to streaming parse
  • 38f1ad4a7: Fix conversion of listen to streams
  • e135a0218: call_with_output_string flushes stream
  • 4129dec31: Add timer wheel
  • 1edd231f1: Add fibers scheduler
  • 1d2e560dc: Add fibers
  • c6beee91c: Add concurrent ML operations and channels
  • f9a37a6b5: Move sleep and timeout-related operations to sleep.lua
  • 18467fb40: Add epoll wrapper
  • 28ca806bb: Rework complete tasks to be more centralized
  • 650f7c28b: Add epoll-based nonblocking file I/O
  • 2974b061c: Supervisor process restores blocking flags on stdin,stdout,stderr
  • 6bf7425cf: Add Concurrent ML buffered channel
  • 149360b58: Convert "snabb config listen" over to use fibers
  • 2a5b52638: Convert lib.ptree.trace to use new streams
  • e26a4b6b6: Adapt new JSON library to return nil on EOF
  • 19e422ce1: Rewrite "snabb config bench" to use fibers and new streams
  • a6654cea3: Replace old ptree JSON library
  • e1b0324e9: Fix fibers sleep self-test
  • 70fde0bb0: Add sockets library that integrates with blocking handlers
  • fb7c091ab: Improve error handling in "snabb config" tools
  • 007be9b31: Add support for orderly scheduler shutdown
  • 37053d267: Convert ptree manager to use fibers
  • 0d7d94a50: Minor cleanup when reading string table
  • 7466c74a9: Fix YANG binary serialization of by-reference cdata leaf values
  • 8ef996b65: Add assertion to Stream:write_scalar
  • fdec9b7e4: YANG binary serialization allows for >4GB files
  • f6f87551f: Avoid copy when reading in ctable
  • ee1a81a6a: Use more relaxed NUMA memory binding policy
  • 855aae74d: Simplify alarm notifications listener
  • 3ee13d91a: Fix socket API change
  • 9bb068eb6: Add condition variables to fibers
  • a6ea6ff2c: Fix typo in channels self-test
  • f3cf8046f: Update fibers file API to allow wait-for-readable ops
  • b47a55f76: Add inotify module to ptree
  • 90dacea99: Add EINTR handling to epoll module
  • f4a4ab9bc: Add :next_entry_time() method to timer wheel
  • af60f950c: Add scheduler :main method
  • b0bc5b316: Use fiber main method in programs
  • 598745a7f: Restore schedule_tasks call on event waiter
  • 5426d1807: Fix duplicated method
  • 032d187ae: Minor scheduler refactor
  • cd99fe39d: Inotify is_dir() function uses lstat
  • c16edb746: Make lib.comma_value work better for large uint64 values
  • 5c8cabdbf: Rewrite "snabb top" with fibers
  • b74014c07: Fix error case for histogram summaries
  • 4fa0ca870: Arrows change focus in snabb top
  • 600cbee19: Remove snabbvmx top.
  • 270bddb30: Fix "snabb lwaftr query"
  • 1914a8633: Add round-robin database library
  • bfe4f3dff: Back off RRD version to 3
  • c29f09544: Refactor ptree manager treatment of counters
  • d08292e56: Fix reading of "snabb config" configurations from stdin
  • 225878d74: Make sure recursive inotify drains all nested events before returning
  • 57b8c18ce: Swap argument order for file names and initargs in rrd create
  • 5eedfef7e: Fix RRD bugs
  • 8a7ab76a2: Ptree manager samples worker and aggregated counters into RRDs
  • 81a54ed56: "snabb top" reads rrd files
  • 59d372da1: snabb top doesn't monitor itself
  • 5d033e1b7: Add "interface view"
  • abe2d5834: Improve spacing and column width allocation in snabb top grids
  • cf8992fef: Switch "snabb top" to prune state tree in UI
  • 2e95609a5: Wrap "snabb top" counter leaves in an object
  • 6530a0d03: Sort rrd lookup results
  • c3fef254e: top: Add ability to skim back and forward through time
  • 1e77c9d29: Add fallback version of directory monitor if inotify is unavailable
  • 2ba44e83f: Make alarms codec use stream i/o routines
  • 6806b5991: Tweaks to make alarm encoding have less overhead
  • 74e78e3bb: Cache array types in stream.lua
  • d6a8c9868: Fix another snabb top problem
  • 53f4e05cb: Update "snabb top" docs
  • 607f7c1ed: Add ptree docs on counter collection and aggregation
  • a533ed413: Fix typo
  • 26812c6cc: Remove some indirection in alarm_codec
  • 34ec6c8f7: Fix broken encode_raise_alarm
  • 15be8033e: Simplify alarms API
  • 93090aedd: alarm_codec doesn't require unpacked args
  • 047f6e70e: Fix bug introduced in previous commit
  • a99cd300b: Ptree extends alarms by installing alarm handler
  • 3930e905f: NDP uses a pre-allocated pseudoheader
  • 0cb4122da: Remove some loops-within-loops in stream.lua
  • dbdb0d1f8: Micro-optimizations
  • 993071585: Fix to alarm:raise
  • 84c290115: Expand on some Changelog features
  • 6ce2990ce: Minor wording changes around the RRD feature
  • dd54c802f: Revert "Show rxbits and txbits instead of bytes"
  • 7b75fbf8a: Ensure vhost-user socket paths are NUL-terminated
  • 44ef1270e: intel_mp app instantiations make stats symlink counter forest
  • 5fa0d15bd: Remove unused symlink creation routines
  • edad14ba8: Minor formatting change
  • 71bf2190f: Update l2vpn for intel_mp stats change
  • a24bb8da5: Remove extraneous diff
  • fa913d56f: Remove more extraneous diff
  • 8f548697c: Revert "Minor formatting change"
  • 144c589a6: intel_mp: Don't eagerly open shared counters

Asumu Takikawa (30):

  • b145d272c: tap: bump selftest timeout to 0.05 seconds
  • c4681a6c5: Use virtual instead of profile time for vmprofile
  • fdf5d02cb: Restore use of LUAJIT_CFLAGS
  • 4bd9d6edf: intel_mp: store shm stats in global directory
  • 2a638fec6: Go back to avoiding setting run_stats
  • 0d641de05: inotify: adjust is_dir to allow symlinks to dirs
  • 373d1951a: Filter queue counters based on enabled bitmap
  • 1c536e2ef: intel_mp: add a new test for rxcounters & workers
  • c40f0ea0c: snabb top: refactor queue stats filtering
  • af8c75fb5: snabb top: fix worker nesting with shared pci
  • 5388c9876: intel_mp: add 10g test for shared RX counters
  • 6b72001f9: Use virtual instead of profile time for vmprofile
  • 504e2a64b: Start changelog for lwAFTR v2018.06.01
  • 102f99096: Add a benchmarking script for lwAFTR releases
  • fd0f29ebf: Adjust benchmark to check SNABB_PCI env vars
  • 929bb7a19: Add CPU env var for lwAFTR benchmark script
  • c02519f2c: Provide info if lwAFTR errors during benchmark run
  • d627abd80: Fix typo in env var check in benchmarking script
  • ece8074a4: Parameterize CPUs used for loadtest in benchmark
  • cf5dc3fdf: Set CPU affinity on two CPUs for RSS release test
  • 79d454611: Use self.shm frame in get_rxstats / get_txstats
  • 07c3be894: Adjust test_10g_counters.sh for new location
  • 5b217941b: Remove remove_stats_symlinks call
  • 2ae4ea488: lib.yang.data: use stream ops to open test data
  • 89d5e6eb6: lib.yang.parser: use error() instead of os.exit()
  • 9703dd02d: intel_mp: fix delayed counter read
  • bcbc3fec6: Add changelog for lwAFTR v2018.09.01
  • 987f60c17: snabbnfv: bump telnet timeout for selftest
  • 90e9b679d: ljsyscall: ensure size matches mask for get_mempolicy
  • 08ff28f03: ljsyscall: ensure size matches mask for get_mempolicy

Ben Agricola (4):

  • 39dc2458d: Fix notification_peers is nil error in ptree
  • af4363e1a: Fix incorrect status sent as alarm-notification
  • e0a5738dc: Add alt-resource support to yang.alarms.
  • ebfb2c611: Add missing cltable include

CapsAdmin (1):

  • fabab0060: x64/LJ_GC64: Fix asm_fuseloadk64()

Darius Bacon (1):

  • 559113ac0: correct spelling

Dibyendu Majumdar (17):

  • 0dda7b270: issue #8 baseline checkin of Lua 5.1 test suite
  • e6fc70247: Create README.md
  • e832e541b: Update README.md
  • 1cb616175: issue #8 initial attempt to get the tests running
  • 0497c7b23: issue #8 initial attempt to get the tests running
  • 45b22589b: issue #8 initial attempt to get the tests running
  • b11631383: Update README.md
  • ea00addbe: issue #8 add 5.2.2 tests
  • ef23b70ed: issue #8 add 5.2.2 tests
  • 6e2030f1e: issue #8 add 5.2.2 tests
  • a1dccdb03: issue #8
  • 318dedd6d: Update README.md
  • 8e20d26a6: Update README.md
  • 2faff3564: issue #8 add strings.lua and literals.lua to the execution
  • ad494d6df: issue #8 add strings.lua and literals.lua to the execution
  • 6fe6fbe77: add coroutine.lua
  • e7b029b02: issue #8 removing tests

Diego Pino Garcia (154):

  • 044a45823: Enable vmprofiling in workers
  • 92adb41af: Hoist enable_auditlog out of loop
  • 360a50480: Implement alarm-notification logic
  • 129f33cdb: Basic notification push mechanism
  • 7fa656a65: Fetch notifications from alarms state
  • 911917d81: Serialize notifications to JSON
  • f4e9a7e6b: Add alarms listen subprogram
  • 65df2caf1: Push notifications over socket using a queue
  • 3feb45124: Fix error while parsing ipv4 and ipv6 prefix
  • f8bc5705f: Remove unused function
  • 3e7786803: Fix impendance mismatch in ipv4-prefix
  • 6334a302e: Add test case for inet:ip-prefix
  • b45785145: Adapt alarm notifications management to new API
  • a46612073: Add identificator name in alarms
  • 050c9fbb9: Add basic support for influxdb format
  • 2911d5add: Prevent potential error if value is nil
  • a8180aa7b: Initialize root variable if nil
  • 031e69ecc: Detect nodes uniqueness as a function of the schema
  • cf3520981: Fix several errors in serialization of arrays
  • 682a0efb6: Escape influxdb tags and values
  • 07a0dc83c: Add influxdb printer tests
  • 39e932579: Disambiguate keys
  • 89d7b19b5: Use '%position' as tag key for leaf-list nodes
  • 8352fd5b9: Schema markers need to be reset on each load
  • 42717a9fe: Test more data types in test case
  • a25deebc1: Handle integer data types
  • f7ee4994e: Append '/' to uniquified names
  • 43c0636e6: Collect node uniqueness in extra pass
  • 9f8dda9a5: Set TTL=64 in ICMPv4 echo response
  • 18f50c8b9: Set hop_limit=64 in ICMPv6 echo response
  • aafbe6e0f: Add end-to-end tests for pings with TTL lower than 64
  • 150420087: Simplify monitor behavior
  • 19ff59814: Add function is_iface to core.lib
  • 93a32fe20: Indent
  • 83f83162b: Support tap interfaces in v4 and v6 arguments
  • ca2a3f06d: Support tap interfaces in on-a-stick mode
  • 55d387e8a: Change load_tap to load_iface using RawSocket
  • f49c9c6b4: Change load_on_a_stick_tap to load_on_a_stick_iface using RawSocket
  • fd4ab223b: Reduce size of packet
  • e12cc2bfc: Rework function 'is_iface'
  • 4842d8160: Rename references to iface as kernel iface
  • d88e019ef: Open channel in worker for listening to directory events
  • 3abdc1f44: Initialize aggregated counters in manager process
  • 918bd28e4: Cache counters
  • 3039ce8fb: Archive counters on delete
  • 569116936: Move fiber for managing aggregated counters (creation and destruction)
  • 606074452: Create fiber to update aggregated counters
  • b5f26d879: On archiving counter, perform counter.delete
  • 4aeeafcf9: Merge create and update counter logic
  • c02c07946: Sum counters of all workers and commit on each iteration
  • 514cd519f: Emit cancel operation on workers shutdown
  • ef4f9b8aa: Rework archive_counter
  • 4134c1b59: Call scheduler shutdown for 0.1s or until it returns true
  • c7388a22d: Sum of archived aggregated counter should be accumulative
  • 5e7793a45: Rework aggregate counters logic
  • 5e1fced0c: Fix aggregated counter retrieval
  • f5fd15efb: Fix attempt to index a nil value
  • 2a6498e1a: Implement leafref value
  • a510b7178: Add leafref test
  • 4db39d7c3: Implement consistency checker
  • 84397f829: Resolve circular reference by moving consistency code to path_data
  • ec0223ad2: Visit leafref nodes with an iterator
  • d4cc98da0: Implement require-instance constraints in leafref
  • 2224f9d91: Precompute getter outside of calling function
  • 618d552fc: Synchronize daylight-save flag between utc time and local time
  • 2e59e6db2: Fix parsing of ISO8601 date format
  • 60b37d4b4: Show command 'listen' in list of available 'alarms' subcommands
  • 0e306ee36: Remove undeclared variable
  • 660e9b2bc: Enable leafrefs in ietf-alarms
  • 720a1d740: Run consistency checker after loading configuration
  • 19d14c965: Improve parse_path
  • 63355f437: Getter should be of parent path
  • 56ad8ee5a: Return path if path is absolute
  • 8152cf7df: Resolve current() to current node_path
  • 597d79f89: Rename arguments
  • bc2333e6f: Only add leafrefs if successfully obtained a getter
  • d1b8ae591: Add consistency checker of ietf-alarms
  • 4651a92a1: Fix typo in lwAFTR configuration docs
  • f4bb339fa: Print out value as mac address if label is 'macaddr'
  • 7dd4fe074: Fix undefined variable
  • 4af258a21: Add guard when retrieving speed and macaddr values
  • 95e57ccf8: Fix function require_splitter
  • 6c4e92827: Determine whether a configuration should run on-a-stick
  • cdd79cfa2: Add on-a-stick assert and prepare migration
  • e649e6049: Scale packet drops
  • ed5316165: Initialize stats queue number
  • c444683b7: Set run_stats true for all nic setups
  • 6c1dd955b: Sync only statistics if instance is master
  • 004b01d3d: Sync stats for relevant queue only if rxcounter defined
  • 14e6b472a: Fix test
  • 1c3115bd8: Update some stats counters always
  • b57d9ade1: Sync device stats refardless of run_stats value
  • 227f996bd: Iterate queue stats registers in order
  • a1cbf7266: Honor txcounter when updating queue stats
  • 709b99fb3: Blacklist of counters which should not be aggregated
  • 0c2785f14: Check sync_timer exists before calling it
  • 30412f08c: Skip blacklisted counters in aggregated counter list
  • e68b756b1: Skip blacklisted without goto and refactor blacklisted
  • 5d4683a1b: Update Snabb lwAFTR version
  • b026f2155: Improve CPUSet:acquire warning message
  • 51dc6aae7: Reintroduce subcommand compile-binding-table
  • 0faa67739: Modify generate-binding-table to generate a configuration file instead
  • b45115577: Rename generate-binding-table to generate-config
  • c19905f1d: Rename compile-binding-table to compile-config
  • 6fb022b4b: Update lwAFTR README
  • 75e61ecf5: Fix test
  • d742a6bb8: Fix indentation
  • e27f506b6: Change instance template to id 0
  • 36283033e: Restrict condition for use of V4V6 splitter
  • 7ba21bfa8: Fix parsing of path in setter and remover for grammar
  • dc67aee94: Remove dead code
  • eb8065753: Do not skip psid=0 if psid-length is zero
  • 436d311ac: Fix error while opening rrd.file
  • fe72a43f9: Show rxbits and txbits instead of bytes
  • 73d0072f0: Print out user-friendly error message
  • 12b8f196d: Fix MAC address comparison
  • cd5aa38c4: Change MAC addresses in configuration file
  • a81e7d288: Select ping6 program
  • 1582927c1: Missing argument in Manager:update_configuration
  • f0c6011fd: Implement checksum computation using DynASM
  • 9a96d576f: Add reference implementation of checksum computation in Lua
  • d42747c73: Convert loops to ifs
  • 9da791f9e: Remove unnecessary label
  • f3969f092: Add at 16 bytes strides
  • 52e845790: Fix comments
  • 12fd28cfb: Sum at 32 bytes strides
  • 1ed8aa519: Remove unnecessary assignment to register
  • a7bac0498: Print out nanseconds by byte and per csum
  • ca059dda3: Check AVX2 and SSE2 are available
  • f38ec15cc: Add function for verifying correctness of new checksum computation
  • 7d5eeab4d: Remove AVX2 and SSE2 checksum computations
  • 24ee9fbac: Use new checksum function by default
  • ced75004f: Add snabbmark checksum subprogram
  • 542a17968: Benchmark checksum using PMU utilities
  • b163b10c0: Fix runtime error in lwAFTR verbose mode (-v)
  • 08ea6a140: Don't print out stacktrace on reporting parsing error
  • e081d27d0: Report parsing errors using Parser:error and not assert
  • 8f8b43b2d: Extract method parse list of cpus
  • 15793920d: Bind manager process to first available CPU in NUMA node
  • b6363558b: Make CPUSet:bind_to_numa bind to CPU too
  • 7845eeca9: Compute available cores by subtracting total cores - isolated
  • b6d50e6ad: Bind manager process to a set of available cpus
  • 56876bd0c: Randomize name parameter in test to avoid collisions
  • 321ee1899: Disable snabbvmx nexthop test
  • b858c9ed3: Allow setting flow-label in ingress packets
  • b75190deb: CPU parsing should return an empty list if string is blank
  • 3c2218f56: Trim list of cpus
  • 14690f2f6: Make flow-label YANG leaf default to 0
  • 03dd8e195: Show nexthop MAC in top
  • c64426a98: Skip memory binding in blackisted kernels
  • 1600fb943: Allow to blacklist kernel versions that are greater or equals than a certain version
  • 8aea0891f: Add assert limit for width value
  • 6489f0e50: Memoize specialized functions
  • 690760456: Save next-hop MAC resolution in ARP and NDP apps respectively

Jessica Tallon (10):

  • d84e63065: Preserve the version number for lwaftr release
  • ce6313e09: Remove unreleased note from changelog
  • 69b5d0a8e: Fix loadtest find-limit arguments for short form.
  • f8fec8d20: Add changelog items for 2018.06.01
  • 3934c3325: Fix few nits in changelog
  • bb25545ca: Fix version number
  • ae0ca397b: Fix errors due to bad strncpy behavour.
  • 012c2935c: Update CHANGELOG.md with 2019.09.02 release
  • 8dbdad074: Add testing 2 instances with 4 queues (RSS).
  • fa0e13e98: Add improvement to benchmarking script to CHANGELOG.md

Lesley De Cruz (18):

  • 46e1fea56: Add first part of test framework: parse tests.
  • a4ec00269: Add index() and extract() to tester module.
  • a4dd1e039: Add run_single() and run() to tester module.
  • 639480bc6: Add filter() to tester module for filtering tags
  • af54fa130: Add verbose option to run() and run_single()
  • b0b3a201a: Add test.lua for running and filtering tests.
  • 24d2b9787: Move some tests into new structure and adapt comments to test runner.
  • 5f331e709: Avoid string.rep in test.lua
  • 0d975fa2e: Clean up test script (args, tag patterns)
  • 885905822: Implement @key: value matching in parse() function of tester module
  • 16b329346: Don't print an empty description in build_codestring() in tester module
  • 765714f63: Put @key: value pairs in separate attributes table in parse()
  • 14bfa87fa: Add --runcmd='x' option to test runner
  • a6e510292: Capture stderr when tests are run externally in run_single()
  • 91cb29bc9: Add workdir argument to extract() in tester module
  • 82586b19f: Improve filenames of extracted tests and error reporting in test runner
  • 1d7aaed64: Moved proposed test runner and examples into 'experimental' directory.
  • 581a474d7: Put subtests in 'test' dir

Luke Gorrie (242):

  • b0a75b45a: Added bench/roulette.lua
  • a71cd6d99: roulette: Stop seeding the random number generator
  • f333908a8: Added bench/PARAM_x86_CI.txt (CI params)
  • 6a66f5d0a: Added LUAJIT_VMPROFILE: new profiler backend
  • 5c74044ad: Added initial README.md
  • 006018f78: Change wording of README
  • d1c0e13d4: Remove LUAJIT_USE_PERFTOOLS
  • 7beb3b29a: Remove all architectures except x86-64.
  • 827e3d68f: Add ifdef-defile config for 'unifdef'
  • 3127cb0b9: COPYING: Switch to Apache License 2.0 for new code
  • 58b063ba7: CONDUCT.md: Add simple code of conduct
  • 40381fa10: Remove unused code.
  • 0213af2a7: Added absolute minimum .travis.yml
  • 1842bc3ae: README.md: Added Travis-CI status badge.
  • f4c8ca693: README.md: Performance regression tests link
  • 7fe552f1d: Revised README.md
  • b270bf026: Remove jit.p, jit.v, jit.dump, disassemblers
  • e2968ccae: Removed dynasm modules for unsupported architectures
  • a168dc60c: README.md: Add quotes, fix benchmarks link
  • 8796648ab: Add LuaJIT/LuaJIT-test-cleanup to submodules/
  • 09b2f3ecc: Add LuaJIT test suite to Travis-CI
  • 9359d140a: Added CONTRIBUTING.md
  • 43e53c75d: COPYRIGHT: Update the COPYRIGHT file inherited from LuaJIT
  • 0e8e9976d: Revised README.md
  • ac49377f4: Remove all uses of LJ_FASTCALL (a NOP)
  • ac6311df6: Remove definition of LJ_FASTCALL (a NOP)
  • 28f0f6bc3: README.md: Indulge in more pithy quotations
  • 5ccbcfe68: Make test 366 pass by adding "move:" to expectation
  • 66b482221: Removed luajit-test-cleanup submodule
  • d5b935481: Add raptorjit-testsuite submodule
  • bfe7ddc6d: Update Travis-CI to use raptorjit-testsuite
  • 9fedd59de: Travis-CI: Added '+slow' argument to test suite
  • 5726c8820: Switch from gcc to clang
  • 78f9acff6: Makefile: Replace minilua with luajit dependency
  • 60aa095ed: Specify build dependencies with nix
  • 112434064: Travis-CI update for nix-based build.
  • a4a5720eb: README.md: Updated build instructions
  • 3a523dee9: default.nix: Commented
  • cd0e41617: README.md: Add link to default.nix
  • 84379d3b7: Remove "amalg" amalgamated build"
  • eb052df4c: Remove '*.bat' console build batchfiles
  • df45ff533: Remove PROFILE and VMEVENT features
  • 972fc1e4a: lib_jit.c: Remove introspection and jit.attach()
  • e2e568975: Remove unused lj_vm_profhook() prototype
  • f7dc94a7a: Define NO_UNWIND
  • 8f2744acd: ifdef-defile: Correct spelling of LJ_NO_UNWIND
  • 5660da339: README.md: Note +NO_UNWIND
  • f7122f197: README: Declared CPU & Optimization policy
  • 5f263f29d: README.md: Add software optimization links
  • fa02289da: Remove DUALNUM mode
  • f458d9ee9: Fix mistakes in DUALNUM removal
  • 170c3ac7a: vm_x64.dasc: Fix FORL type coercion
  • c8b2b1cdb: vm_x64.dasc: Resolve +JIT +FFI -X64WIN
  • 03ad9118d: Travis CI: Test -O3/-O2/-O1/-joff separately
  • d286c9506: Fixed typo in jit=-O1
  • b1cfd2730: lj_asm_x86.h: Fix CNEWI for constant pointers
  • fb32f91b8: Fix IR_KKPTR case of b1cfd2730e42d8a0b8d5f76f0c05dac948925dec
  • b1bc13bde: Compile with -Werror (treat warnings as errors)
  • 065909239: Remove submodule for testsuite
  • c025664d8: nix: pin nixpkgs, pin clang 4.0, run test suite
  • 82487c76b: Travis-CI: Update now that nix runs the test suite
  • 398bd2846: Cleaned up nix expressions
  • 735670897: md5 benchmark 15% speed by removing "slow LEA"
  • 7a3583959: Import revamped nix benchmark framework
  • b1b52db19: Fix markdown goof in README.md
  • f5aa32905: README.md: Add note about where benchmark visualizations go
  • 43181637f: testsuite/bench: Tweaked tests to run longer
  • 7bf26e61d: Add new "uplifting" RaptorJIT logo
  • cb132d173: Add lj_auditlog (very preliminary)
  • 5ea4b741a: lj_auditlog: use msgpack format for audit log
  • 76be28386: lj_auditlog: remove redundant "size" field
  • b302c6eab: lj_auditlog: Add "event" object
  • 2dfdb732f: lj_auditlog: Implement logging of trace_abort
  • 376fb58c4: lj_trace: Log trace aborts to auditlog
  • 0a554696d: Generate separate DWARF debug info
  • 0acc230ed: lj_auditlog: Log the memory containing IR instructions
  • 65675f511: lj_vmprofile: Port & adapt revisions
  • a86ca9373: raptorjit build: remove jit.* and disassembler symlinks
  • 27e600ff4: raptorjit build: hackey update of makefiles and nix exprs
  • c6aae3038: core.app, core.main: drop jit.zone dependency (dangling)
  • f9d7cdd0d: src/Makefile: Shrink by removing obsolete platform logic
  • 6d7a8d218: Add VM generated code to the repository
  • 086b4c920: Exclude generated code from .gitignore
  • 196a9e264: Makefile: s/LuaJIT 2.1.0-beta2/RaptorJIT 1.0.0-alpha1/
  • 3ca3df826: README: Update build procedure description
  • 964cbe445: Makefile: New target 'bootstrapclean' removes in-tree generated code
  • 726cc9c25: raptorjit.nix: preBuild = 'make bootstrapclean'
  • 2cf99248c: check-generated-code.nix: Check if in-tree VM code is stale
  • 9fe396796: .travis.yml: Include check-generated-code test
  • c297923f2: Makefile: New 'reusevm' target & bootstrap-skipping method
  • 8cd8f7e2f: vmprofile: Extend Lua API and add test cases
  • d7fd44e28: testsuite/bench: Remove PARAM_* for unsupported platforms
  • d095eae73: raptorjit.nix: Fix executable name / broken build
  • 8ec77f987: .travis.yml: Update Travis-CI config (was not testing)
  • 076d161eb: check-generated-code.nix: Fixed
  • d27d4d4fc: check-generated-code.nix: Tweak order of diff args
  • 300d14e74: reusevm: Updated generated code
  • 4aaa844b8: lj_jit.h: Save 'parent' and 'exitno' fields in GCtrace
  • fcf7053dd: check-generated-code.nix: Add more verbosity
  • 4a06d4a55: lj_vmprofile.c: Fixed to set file magic number with C API calls
  • 4b4dcb0cc: lj_trace.c: Make trace numbers unique (stop reusing them)
  • 2b8d1a32e: Makefile: Add 'make reusevm' for raptorjit
  • 1d81da757: src/Makefile: Switch "luajit" command to "raptorjit"
  • bbbd4b691: src/Makefile: Fix path to raptorjit.a
  • 55ac7f5d3: snabbnfv.traffic: Remove jit.p and jit.dump calls (not in raptorjit)
  • cf655d95a: lj_crecord.c: JIT pointer difference for all element sizes
  • 4e945d25e: lj_api.c: Fix breakage in cherry-pick of ffd2610139125e6145b5b10af52fda3d07fb8b9e
  • 4cd536f1e: testsuite: Enable Lua 5.2 compat
  • 00e983c4c: src/reusevm: update generated files
  • 88bcf0063: README.md: New introduction
  • 2bc2d951c: README: Make less fuss about Intel Core
  • 9ab33a893: README: shorten intro, move Optimization Resources down
  • 7c2a11ec9: fixup! README: shorten intro, move Optimization Resources down
  • bebdbacca: Makefile: Added reusevm target at top-level
  • cc5668b09: README: Added note about future platform support
  • 1b5c2f27d: fixup! README: Added note about future platform support
  • 86f23d611: README: Re-introduce goal of minimizing non-deterministic performance
  • ad14f4571: GCtrace: Make it possible to map between IR and mcode insns
  • c5923d846: lj_auditlog.c: Log VM definition information
  • f7212ccb9: lj_trace.c: Clear penalty slot after successful trace
  • 01dc84486: lj_jit.h: Increase HOTCOUNT_MAX and expand HotPenalty.val
  • a720595ae: lj_trace.c: Reset hotcount table after flush
  • ce6fbb424: lj_record.c: Relax heuristic for root trace meeting JIT loop
  • e182ae84a: Add jit.tracebarrier() primitive
  • 0be85c638: src/reusevm: update generated files
  • f5d810e97: lj_record.c: Record IFUNC/IFUNCV the same as FUNC/FUNCV
  • b6902f8a5: Remove EXITSTATE_PCREG
  • 089c55ab2: lj_obj.h: Explicitly define implicit VM states
  • bd7266db9: Track last exited trace (lasttrace) in global_State
  • 2b89796f6: vmprofile 3.0 with more information
  • 5cac382f4: lj_vmprofile.c: Fix file header initialization
  • c73491031: Remove feature to compress GCproto.lineinfo
  • 5e673ead6: lj_obj.h: Fix comment about lineinfo (non)compression
  • 7f4787acb: Fix bug in lj_bcread_proto()
  • 17b3c9cdf: lj_bcread.c: Fix warning
  • c1659d94d: VMProfile 4.0: File format revision
  • ae5c6aaed: vm_x64.dasc: Fixes to ensure g.lasttrace is a trace number
  • 0823d9683: lj_vmprofile.c: Fix trace number overflow (into bucket 0)
  • a8b0f320b: lj_vmprofile.c: Add assertions with lua_assert
  • 16121f247: Statically allocate JIT temp buffers
  • 7a4e25b94: Add log of recorded bytecodes (BCLogRec) to jit_State
  • 9b2b46751: Minor update to jit_State bytecode log
  • 238c698b7: lj_auditlog: Improve logging of trace stop/abort
  • b29101e9e: fixup! lj_auditlog: Improve logging of trace stop/abort
  • bc57ceb17: lj_state.c: Fix bug in allocation of IR buffer
  • d371db63c: lj_state.c: Fix dealloc to match
  • 06b9f3227: lj_state.c: Fix allocation and free of IR buffer
  • 43691e007: reusevm: Update generated code
  • 4d8b3eb93: auditlog: Log all loaded bytecode (GCproto objects)
  • 5843c5370: lj_auditlog.c: Log prototype names (GCstr)
  • 88cc35c3f: reusevm: update generated code
  • 2f5a9a37f: lj_obj.h: Redefine GCRef as simple GCobj* pointer
  • 158737793: lj_obj.h: Redefine MRef as simple void* pointer
  • 857073ccd: lj_auditlog.c: Add lj_auditlog_open(path) API function
  • 671d770a5: lib_jit.c: Add 'jit.auditlog(filename)' Lua API function
  • 07fef11fc: luajit.c: Add 'raptorjit -a ...' command line auditlog syntax
  • 7e34e72e9: reusevm: Update generated code
  • 3e2d4e443: lj_auditlog.c: Use open_memstream() instead of fmemopen()
  • 588e9c39c: lj_auditlog.c: Fix compiler warning
  • 2276cd8c9: lj_trace.c: Fix compiler warnings
  • 623d45f43: lj_auditlog.c: Remove fflush() that seems problematic
  • 0b940c582: lj_auditlog.c: Glibc memory stream workaround...
  • 3a5aa7df7: lj_trace.c: Do not reuse trace numbers after flush
  • b5056fa2d: lj_parse.c, lj_debug.c: Remove clever tricks in lineinfo encoding
  • 541d60dd9: auditlog: Can only be opened once now (error on second open)
  • de0f44270: fixup! auditlog: Can only be opened once now (error on second open)
  • 1fa5375d2: Fix compiler warning & reusevm generated code
  • 7844c5f52: Add '-p file' command line syntax for VMProfile
  • fd0e49da8: Support "one-liner" usage of jit.vmprofile.open()
  • 9dac90f56: auditlog: Log source code (in chunks via lexer events)
  • ed2103493: auditlog: Log source (lex events) as msgpack binary
  • f66fc04ef: testsuite/bench: Fix awk parsing of perf output
  • fcf86b847: lj_str.c: Remove special-case string interning fastpath
  • fe89c1069: luajit/lib_jit.c: Fix merge conflict (duplicate of jit.tracebarrier)
  • 072d23e73: src/Makefile: Fix raptorjit build
  • 4db5edf3d: engine: Enable RaptorJIT auditlog and vmprofile
  • 8c09d57a4: core.shm: Add function path(name)
  • b021efbf4: src/Makefile: Fix s/luajit/raptorjit/ bug
  • c2c2ed2a9: lj_auditlog.c: Pick latest working version from lukego/auditlog
  • e92c500fc: lj_vmprofile.c: Fix bug where restarting the timer would not work
  • 4189da6cb: Just use the default gcc instead of clang 4.0.0.
  • 42bb70b28: lj_ir.h: Fix typo made when resolving merge conflict
  • 0dea74ee8: lj_lex.c: don't log lexer events for bytecodes
  • 9be90a3e3: lj_jit.h: Increase default maxtrace from 1000 to 10000
  • 7b57a2358: lj_trace.c: Allow reuse of trace numbers after jit.flush()
  • c6347dc27: lj_trace.c: Clear profiler lasttrace state on flushall()
  • cad220d9e: lj_trace.c, lj_auditlog.c: Log auditlog event "trace_flushall"
  • cc311cf7c: dasm: Error when a 64-bit value is used as a 32-bit immediate
  • 7bc8597a2: Move lj_auditlog.c out of Snabb and into RaptorJIT
  • 0158240c7: luajit.c: Make -a and -p argument handling more consistent
  • d0dcc755d: lj_audit.log.c: Add file size limit (default 100MB)
  • b0cbca7ad: lj_auditlog.c: Add "nanotime" timestamp to events
  • f4ff59e60: lj_auditlog.c: Increase in-memory log limit to 10MB (from 1MB)
  • 10764c489: lj_auditlog.c: Log strings referenced as IR constants
  • d0191fec2: lj_auditlog.c, lj_ctype.c: Log named ctypes to the audit log
  • 1c81d51de: fixup! lj_auditlog.c, lj_ctype.c: Log named ctypes to the audit log
  • 486f720ff: lj_auditlog.c: Log GCfunc objects referenced by IR constants
  • b93738f79: shell.nix: Make 'nix-shell' command work as documented
  • 1d1dc9f49: README.md: State more clearly that Linux is required
  • 44fbf8e3e: lj_auditlog.c: Log GCtrace->irmcodesz (IR-mcode mapping)
  • d64a769f6: fixup! lj_auditlog.c: Log GCtrace->irmcodesz (IR-mcode mapping)
  • 8c8731e01: lj_asm.c: Fix szirmcode values
  • f62c2463e: fixup! lj_asm.c: Fix szirmcode values
  • 9b5ab0af4: lj_dwarf.c: Add lj_ircall.h and lj_ff.h for more debug information
  • 02062e939: src/Makefile: Embed DWARF debug info as binary blob
  • 229fc152d: lj_auditlog.c: Log raptorjit VM DWARF debug information to audit.log
  • e51eaa11b: lj_debuginfo.h: Add missing file declaring dwarf data
  • 1646db3ae: lj_audit.log.c: Fix iteration through trace constants
  • a5222e7a1: lj_state.c: Partial fix of assertion on shutdown
  • 92955dc83: src/Makefile: Add dependency from DWARF info to generated headers
  • 9a798d7ba: luajit.c: Fix argument parsing bug that made "-a" fall into "-p"
  • 8d9d959ac: Extend GCproto debug with declared function name (declname)
  • 4166e7a80: lj_bcdump.h: Bump bytecode version number (2 -> 3)
  • 74b52e652: lj_bcread.c: Remove suspicious loop
  • 73b96a4a0: src/reusevm: Update generated code
  • 01f8b4cf9: lj_bcread.c: Remove suspicious loop
  • 8f55c0343: src/reusevm: Update generated code
  • d60c59518: lj_prase.c: Remove old debug noise
  • c552236ca: Restore older debug info fields to their original positions
  • 96e00a6f8: lj_bcwrite.c: Remove unused variable
  • 90a15f7a4: lj_ctype.c, lj_trace.c: Poll for ctypes to log on trace stop/abort
  • 473cb199e: lj_ctype.c: Avoid crash when printing unprintable ctype IDs
  • cd172fc27: lj_parse.c: Set declname for file-level code to
  • 2c5faa8a7: Exclude function-rooted traces from global_State->lasttrace
  • ca0abe30f: reusevm: Update generated code
  • 420fa7571: Minimal rebranding from LuaJIT -> RaptorJIT
  • 48919010a: README.md: revised ahead of first release
  • 4e1405dd4: README.md: Add quick Studio getting started intro
  • fcf138fd1: README.md: Correct profile names to *.vmprofile (expected by studio)
  • 47822655d: Fix allocation/deallocation of T->szirmcode
  • 66f9234b6: lj_trace_alloc: Copy T->szirmcode to new trace
  • 9959cb1ab: lj_asm.c: Added comment about szirmcode moving to final GCtrace
  • 3f9db9e3f: lj_ctype.c: Detect loops in ctype_repr()
  • d09927b33: lj_trace.c: Fix and simplify allocation of J->trace
  • d3c149d5f: default.nix: Test with -DLUA_USE_ASSERT and -Werror
  • a667ead77: Fix deallocation of T->szirmcode
  • 3b8063349: lj_state.c: Restore assertion that all memory is deallocated
  • 55e765664: lj_ctype.c: Detect bad ctypeid without failing lua_assert
  • 56a88b23f: Prepare for RaptorJIT 1.0 with installation fixes
  • fe6324e66: .version: Step to v2019.01
  • 15b1a62db: .version: Fix conflict
  • a9fe280fb: core.engine: Add .vmprofile suffix to filenames to help Studio

Max Rottenkolber (5):

  • 6be5397d0: core.main: call vmprofile.start() before running program...
  • 580c87ef5: core.histogram: extract summarize method from snabb top
  • 1f9619cbf: core.histogram: add __tostring meta-method to meta-type
  • 3d5cbb497: core.packet: register SHM type with __tostring method for freelist
  • ff2d7bd7e: snabb shm: introduce tool to replace 'snabb top -l '

Mike Pall (83):

  • a273241fe: Initial commit
  • de5568e0e: Remove Lua 5.0 compatibility defines.
  • 0cf78854a: ARM64: Fix XLOAD/XSTORE with FP operand.
  • 779a1eb8e: ARM64: Fix Nintendo Switch build.
  • fa126c5f9: x64/LJ_GC64: Fix assembly of CNEWI with 64 bit constant pointer.
  • 024ade796: LJ_GC64: Fix BC_CALLM snapshot handling.
  • 78f5f1cef: x64/LJ_GC64: Fix emit_loadk64().
  • 3143b2189: ARM64: Add big-endian support.
  • e205ad0c5: FFI: Fix FOLD rules for int64_t comparisons.
  • dc320ca70: Remove old Lua 5.0 compatibility defines.
  • de97b9d52: Add some more changes and extensions from Lua 5.2.
  • 247b3624f: OSX: Fix build with recent XCode.
  • 22dfa6328: Allow building on Haiku OS.
  • 9c685f700: Refactor with LUA_OK.
  • c67a09829: From Lua 5.2: Add lua_version().
  • ef23b70eb: From Lua 5.2: Add lua_copy().
  • f2e2a3f75: From Lua 5.3: Add lua_isyieldable().
  • cde968f91: From Lua 5.2: Add luaL_testudata().
  • 2b8de8cfc: From Lua 5.2: Add luaL_setmetatable().
  • de26f76e2: From Lua 5.2: Add lua_tonumberx() and lua_tointegerx().
  • cced1786b: Document added C API extensions from Lua 5.2/5.3.
  • 18efb331a: ARM64: Fix stores to vmstate.
  • 58aaac3c6: MIPS64: Fix write barrier in BC_USETV.
  • ed54eace6: MIPS64: Fix stores of MULTRES.
  • 02b4b1e55: Add workaround for MSVC 2015 stdio changes.
  • fbfbd7b9e: FFI: Compile bitfield loads/stores.
  • cf8a5bea8: Add FOLD rules for mixed BAND/BOR with constants.
  • b608891d7: FFI: Update docs on compiler limitations.
  • ae0d438f2: Update changelog.
  • 0bf80b07b: RELEASE LuaJIT-2.0.5
  • e9f8abfbf: Update changelog.
  • 8271c643c: RELEASE LuaJIT-2.1.0-beta3
  • 1c89933f1: Fix LJ_MAX_JSLOTS assertion in rec_check_slots().
  • 630ff3196: Add missing LJ_MAX_JSLOTS check.
  • 7381b6203: MIPS: Use precise search for exit jump patching.
  • c7c3c4da4: MIPS: Fix handling of spare long-range jump slots.
  • a057a07ab: MIPS64: Add soft-float support to JIT compiler backend.
  • b0ecc6dd6: FreeBSD/x64: Avoid changing resource limits, if not needed.
  • 6a71e71c1: Remove unused define.
  • 82151a451: Modify fix for warning from 'ar'.
  • 7e662e4f8: x64/LJ_GC64: Fix emit_rma().
  • fd37da0d5: PPC: Add soft-float support to interpreter.
  • 07f976a08: Remove Lua 5.0 compatibility defines.
  • 5126a06f2: LJ_GC64: Fix BC_CALLM snapshot handling.
  • de9a8863a: x64/LJ_GC64: Fix emit_loadk64().
  • e834e9c7c: Merge branch 'master' into v2.1
  • dbe561925: Remove old Lua 5.0 compatibility defines.
  • d6db00566: Add some more changes and extensions from Lua 5.2.
  • b28c891a6: Refactor with LUA_OK.
  • eaf262dd6: From Lua 5.2: Add lua_version().
  • f1264bfb8: From Lua 5.2: Add lua_copy().
  • 9a520cb5b: From Lua 5.3: Add lua_isyieldable().
  • 4a307c1ed: From Lua 5.2: Add luaL_testudata().
  • 9fabcf9ed: From Lua 5.2: Add luaL_setmetatable().
  • ffd261013: From Lua 5.2: Add lua_tonumberx() and lua_tointegerx().
  • bddc781fc: Document added C API extensions from Lua 5.2/5.3.
  • 2f7f0a23b: FFI: Compile bitfield loads/stores.
  • e091baf7a: Add FOLD rules for mixed BAND/BOR with constants.
  • a698e89f4: FFI: Update docs on compiler limitations.
  • a0a198391: Merge branch 'master' into v2.1
  • 07918dc7b: Merge branch 'master' into v2.1
  • e2cabaff9: Remove unused define.
  • c0165a6e8: x64/LJ_GC64: Fix emit_rma().
  • f3d75075e: Use https for freelists.org links.
  • 6b0824852: x64/LJ_GC64: Fix fallback case of asm_fuseloadk64().
  • 71b7bc883: PPC: Add soft-float support to JIT compiler backend.
  • 05fbdf565: x64/LJ_GC64: Fix type-check-only variant of SLOAD.
  • bf12f1daf: MIPS64: Hide internal function.
  • 0c0e7b168: DynASM/x86: Fix potential REL_A overflow.
  • b4ed3219a: LJ_GC64: Fix ir_khash for non-string GCobj.
  • 850f8c59d: LJ_GC64: Make ASMREF_L references 64 bit.
  • 9f0caad0e: Fix FOLD rule for strength reduction of widening.
  • 06cd9fce7: ARM64: Fix assembly of HREFK.
  • 99cdfbf6a: MIPS64: Fix register allocation in assembly of HREF.
  • 33082a6f4: ARM64: Fix xpcall() error case.
  • 7dbf0b05f: Fix saved bytecode encapsulated in ELF objects.
  • d417ded17: ARM64: Fix xpcall() error case (really).
  • ea7071d3c: MIPS64: Fix xpcall() error case.
  • 58d0dde0a: Fix IR_BUFPUT assembly.
  • 430d9f8f7: Fix string.format("%c", 0).
  • 97356f99f: Use https for freelists.org links.
  • f6c52a376: Merge branch 'master' into v2.1
  • 91dbe2369: Merge branch 'master' into v2.1

Peter Cawley (22):

  • 488e3fb74: Shake things up.
  • 74d256ffc: Remove some already-modernised tests from misc.
  • b8bbda318: Modernise goto test.
  • f40304dde: Modernise string_op test.
  • e002a085d: Improve reporting of failing tests in --quiet mode.
  • 6a7e34297: Modernise misc/meta_* tests.
  • 1bee68fde: PUC-Rio Lua compatibility.
  • bcd286b8d: Modernise more tests.
  • 3e5cca793: Modernise some tests.
  • 9f1451d82: Normalise line endings.
  • 9c27a59d8: Fix batch modifier application.
  • a82c499a0: Modernise some FFI tests.
  • d7985d1c6: Modernise more ffi tests.
  • 703e9cfb8: Skip some tests under LuaJIT 2.0
  • c3224bb76: Exercise TSETR and TSETM slow paths.
  • 7897e7fff: Add tests for allocation of variable-sized cdata
  • 071f05010: Exercise string concat some more
  • bcf938bcb: Extend cdata_var test slightly
  • 73139f88c: Disable some tests under 5.2 compatibility
  • 14c132e6a: Add tests for table indexing (inspired by #221)
  • 63a6f7e28: Add test for BC_KNIL slot revival under LJ_GC64
  • 014708bce: Add test for BC_VARG slot revival

aouinizied (1):

  • f2bd95dcd: Implement nDPI2.x snabb compatibility

bandhu (2):

  • 3e731388d: issue #8 add dummy file to ensure directory is saved in git
  • cd429000d: issue #8 add dummy file to ensure directory is saved in git