Lifion Kinesis Versions Save

A native Node.js producer and consumer library for Amazon Kinesis Data Streams

v1.0.3

4 years ago
  • Minor stats refactor
  • Allow to override the default pay-per-request billing mode
  • Correct check for assigned enhanced consumer on the lease manager
  • Upgrade dependencies

v1.0.2

4 years ago
  • Feature/add stats and health
  • Assign enhanced fan-out consumers to instances of the client
  • Add retry to putRecord(s)
  • Pipe records from enhanced consumers back to the client
  • Add stats support
  • Allow fan-out consumers to use regular checkpoints
  • Refactor of enhanced fan-out code to make it easier to follow
  • Implement use all shards in fan-out consumer mode
  • Refactor records encoding
  • Add tests for lib/consumers-manager
  • Implement shard expiration in fan-out consumers
  • Remove the utils module
  • Refactor “setUpEnhancedConsumers” so it’s easier to follow
  • Fix reassignment of enhanced consumers when there are more consumers than enhanced consumers
  • Confirm parent depletion works with fan-out consumers
  • Detect parent shard depletion in fan-out mode
  • Add unit tests for lib/compression
  • Remove “setUpEnhancedConsumers” from the documentation
  • Simplify the polling consumer set checkpoint calls
  • Retry only on throughput
  • Remove GET request debug message
  • Upgrade dependencies

v1.0.1

4 years ago
  • Upgrade dependencies
  • Add support for polling consumers
  • Add putRecord and putRecords
  • Make sure the state table is tagged as expected
  • Initial leasing algorithm implementation
  • Normalize the stream and table modules
  • Fix continuous polling on a shard split
  • Correct lock file, optimize renovate
  • Make sure the client recovers to any error
  • Implement roll call for consumers
  • Allow reading from all shards
  • Document the state-store
  • Adopt the concept of consumer group
  • Correct the proxies, prepare for shard reader timers
  • Improve debug messages
  • Fix shard distrution and stop consumers after lease expiration
  • Add support to manually set checkpoints
  • Remove the coordinated timeout in roll calls
  • Correct the README with the correct encryption documentation
  • Try to acquire leases for shards by sorted shard ID
  • Fix missing initialization of the dynamoDb option
  • Correct copyright in the license

v1.0.0

4 years ago
  • Add support for Enhanced Fan-Out consumers
  • Enable NPM publish in the CI
  • Configure Renovate
  • Add integration with CircleCI
  • Set NVM to use the current LTS
  • Add management of stream consumers, refactor stream management
  • Add enhanced-fanout shard subscriber and initial parser
  • Update documentation
  • Ensure streams are created, encrypted, and tagged
  • Add a Kinesis records decoder
  • Recreate the shard subscription stream when expired
  • Adopt lifion-aws-event-stream
  • Remove the check-dependencies script in favor of Renovate
  • Include the shard ID in the piped records
  • Connect the parsed records into the client
  • Add test coverage for lib/utils
  • Add deploy and publish to CircleCI
  • Replace toBeCalledWith calls with their canonical versions
  • Fix directory for .npmrc and add reports
  • Rename project to lifion-kinesis
  • Make the tag test cases more specific
  • Change the Renovate configuration
  • Make sure the CI stops if the tests fail
  • Upgrade dependencies