Real Time Analytics Spark Streaming Versions Save

Removed

• Demo component of solution. The consumer application was using an older version of the Kinesis Consumer Library (KCL), which is affected by the Apache Log4j2 Issue (https://aws.amazon.com/security/security-bulletins/AWS-2021-006/). For samples, please refer to the Amazon EMR documentation.

See changelog for more information.

Changed

• Consumer application to use same logging framework as producer (SLF4J)

Removed

• log4j dependency from consumer application

See changelog for more information.

Added

• CHANGELOG, NOTICE, CONTRIBUTING, and CODE_OF_CONDUCT files
• Java based spark streaming application
• Demo producer application to generate random products
• Foxproxy plugin configuration file under source/zeppelin folder. This plugin configuration is required for Web View of EMR cluster applications like Hadoop, Zeppelin and others once dynamic port forwarding is configured through SSH tunneling
• Flow logs to VPC
• Security configuration to EMR cluster

See changelog for more information.