StreamLine - Streaming Analytics
Streamline 0.6.0 release with feature enhancements and bug fixes.
Some of the new features include - log search, event sampling, enhanced metrics, test mode and enhancements to custom processors.
ISSUE-1061 Cleanup CustomProcessorInfo and related usages ISSUE-1191: Revert the changes made to hide the metrics values in DAG component view ISSUE-1188 Handle accessing undefined object causing configuration page to freeze ISSUE-1186: Do not display the metrics values in the DAG component view ISSUE-1176 The view mode DAG metrics values flow out of the box ISSUE-1177 View mode - metrics view does not display all the values ISSUE-1180 Fix issue to provide Storm principal to cluster security s… ISSUE-1178: Pass nimbus.seeds to storm command line ISSUE-1174 Apply ManagedTransaction to fix transaction issue ISSUE-1172 Link to Storm Ambari View from SAM doesn't work ISSUE-1165 Force set non-secured parameters in test topology ISSUE-1159 Delete user toolbar metadata before deleting the user ISSUE-1170 Limit input stream to sink with single streams ISSUE-1159: Add an API to delete toolbar metadata for a particular user ISSUE-1155: Return the exception and the cause if any during topology deployment failures ISSUE-1152: View mode UI issue ISSUE-1157 Fix leaking transactions in topology action ISSUE-1150 Populate protocol/port for kafka components even listeners with multiple protocols. ISSUE-1146 Writing failure state while applying topology action should not be rolled back ISSUE-1148: Environment gets updated even without making any changes … ISSUE-1142: Add --negotiate curl option to handle kerberos mode ISSUE-1138 - disable rolling window join in bootstrap ISSUE-1140: Exclude mailapi dependency from registry-common to avoid conflict with notifier ISSUE-1126 Fix transaction lock issue while refreshing cluster ISSUE-1135: Page stucks with loading sign on Sampling page ISSUE-1131 Remove the unused ctors and static newInstance methods fro… ISSUE-1127: SAM HBase Sink throws an exception when opening Sink Dialog ISSUE-1121 UI Error display improvements ISSUE-1119 Using TransactionEventListener from registry:storage-core module ISSUE-1129 Configure schema name and version to compute schema for HDFS source. ISSUE-1124: Fix the package name for StreamlinePMMLPredictorBolt ISSUE-1015: Quote window in the mysql create statements to handle mariadb 10.2 ISSUE-1117 Fix issue while retrieving Kafka offset metrics ISSUE-984: Change text mysql type to mediumtext for large schema ISSUE-1115 Disable topology event logger in test mode ISSUE-1108 View mode metrics changes ISSUE-1109 Provide execute latency into in processor and sink for time-series manner ISSUE-1107: Maintain the state of Sort & Filter in sampling table ISSUE-1107:UI issues in view mode ISSUE-1097 UI changes to display and search sampled events ISSUE-1105 Fix log level status API to respond status 200 when topology is not running ISSUE-1102 Fix sampling status API to respond status 200 when topology is not running ISSUE-1089 Implement custom event logger for SAM ISSUE-1086: Ability to view large messages and limit the message size… ISSUE-993 RollingWindow Join backend bugs ISSUE-973: Realtime join processor UI bugs ISSUE-1090 Provide backend API endpoint for fetching events indexed in Log Search service ISSUE-1083: Remove versioning of json configs ingested through bootstrap script ISSUE-1030: Add runtime event sampling support ISSUE-1081: Fix the validation errors when reading from kafka message values when length is more than offset. ISSUE-1093: Flatten the nested fields in DruidEvents ISSUE-1078 Inject event correlation information for processor runtime bolts ISSUE-1084: Add debug log to DruidEvent ISSUE-1069 Handles events fanout in event logging on test mode ISSUE-1074: Output schema of Branch Processor doesn't change even when input schema changes ISSUE-1076 Change default log level in log search to INFO,WARN,ERROR ISSUE-1071 Disable the logsearch button in UI if Logsearch and Ambari Infra is not available in the Environment ISSUE-1046: Allow user to select nested fields in Druid Sink UI ISSUE-1054: UI changes in topology view mode for component metrics and log level ISSUE-1044: Add support to fetch nested fields in DruidEventMapper ISSUE-1033: Implement UI part of Log Search feature ISSUE-1001 Implement backend part of Log Search feature ISSUE-1049 Fix behaviour of selecting nested fields in Join processor ISSUE-1048 Fix Aggregate processor to emit event with anchoring only … ISSUE-1014 Dynamically changing log level at Application level ISSUE-1023 Provide HTTP API endpoints for merging component catalog information and metrics ISSUE-1065 Fix the bug in Join processor with processing time ISSUE-1057 Fix condition of including jars: check filename instead of path ISSUE-1003: Refactor tsFields usage to fix the issue with aggregate processor ISSUE-1024 Refactor TopologyCatalogResource (also API endpoint paths) ISSUE-1052: Update kafka source bundle json during migration ISSUE-981: Re-use custom processor jars using digest ISSUE-913: Add a user friendly error page for 401 status code response ISSUE-968 Join processor output when both streams have same field ISSUE-1003 - Support for event-time windows in Join processor ISSUE-1026 Group test mode events in the bottom nav bar ISSUE-999: Search for component names in application editor doesn't seem to search custom processors ISSUE-1019: Shade jackson annotation library to avoid version mismatch issue ISSUE-763 Support transactions for streamline ISSUE-1040 Preserve the order of test case events while generating the groups ISSUE-1038 Remove associated component process entities prior to remo… ISSUE-918 : Enable seamless schema upgrade to 3.1 ISSUE-1021 Update registry version to 0.4.0-SNAPSHOT ISSUE-1026: Group test mode events in the bottom nav bar ISSUE-1017 Place event first which is directly related to selected event ISSUE-970: UI Changes to make input schema, output schema and config fields optional for Custom Processors ISSUE-970: Make input/output schema and config fields optional for CP ISSUE-985 Each RulesProcessor should be matched to a Storm Bolt, not … ISSUE-994: Topology Name should not have spaces in it. ISSUE-1008 Highlight source which emits selected root event in test event correlation result ISSUE-1008 Highlight source which emits selected root event in test e… ISSUE-1005: Refactor streamline code to refer FileStorage from registry ISSUE-964 Test mode: Add event correlation ISSUE-964 Inject correlation information to event ISSUE-988: UI sends improper values for fields in all the sinks having type as array.enumstring ISSUE-975: Unable to open RT-Join processor modal after connecting it to any other processor/sink ISSUE-978 Enable event time for Join processor ISSUE-972 SAM test mode doesn't adjust topology message timeout with windowed rule ISSUE-959: Have a common storage module across streamline and registry ISSUE-673: Custom Processor page needs to include hint about how to specify schema ISSUE-956: Handle cleanups of componentBundleId into topologyEditorToolbar on deletion of any source/sink bundle ISSUE-954: While configuring a custom source, getting schema using version API has undefined string in it. ISSUE-961: Add example for adding spout as custom source and related fix ISSUE-951: Join bolt does not work in Test mode ISSUE-949: Disallow null values in test mode data ISSUE-877: Support Oracle Database ISSUE-933: SAM Processors/Sinks/Rules need to update when its upstream components are updated ISSUE-933: SAM Processors/Sinks/Rules need to update when its upstream components are updated ISSUE-946 Update React & React-Dom version ISSUE-941 The edge fields grouping does not update on selecting different keys in aggregate ISSUE-935: Fix intermittent test failures from NotificationServiceImplTest ISSUE-936: Backend changes for handling the test case data as a string to preserve formatting ISSUE-939: Add missing favicon ISSUE-917 Test mode-UI: Validate test case data on clicking ISSUE-928 Integrate Travis CI as Streamline's CI ISSUE-924 Test mode running into issues in Firefox browser ISSUE-921 Test Mode: Minor UI Improvements ISSUE-917 Test mode: Validate test case data on clicking OK ISSUE-910 Test Mode: Getting an exception on deleting a test case that has been ran successfully once ISSUE-910 Test Mode: Getting an exception on deleting a test case that has been ran successfully once ISSUE-907 Test Mode: Deleting a topology source node after a test source node is configured throws exception ISSUE-905 Test Mode: Need API modifications to delete all test source/sink when test case is deleted ISSUE-901 Create event file prior to launch actual test process ISSUE-902 Add a sleep option along with repeat count ISSUE-899 Test mode: Provide an option to force stop a test run ISSUE-889 Retain Window configuration when running test topology with WindowedRule ISSUE-887 Recording events from sink leads the result confused ISSUE-844: Custom UDFs implemented as inner classes can't be registered/uploaded (#845) ISSUE-773: Ignore null values for a field in avro record to fix runtime exceptions ISSUE-856 Event logging for test runner should log output events ISSUE:849 Support schema versioning and migration using Flyway ISSUE-856 Event logging for test runner should log output events for processor ISSUE-856 Event logging for test runner should log output events for processor ISSUE-872 Fix bugs on feature to 'Test topology run' for integration test ISSUE-879: Refactor service pool related classes into a single module BUG-86247 Add parent tag in streamline-findbugs pom.xml BUG-86247 Add parent tag in streamline-findbugs pom.xml ISSUE-785 Revisit manual service registerer ISSUE-860 UI Add timeout option to topology test run ISSUE-860 Add timeout option to topology test run ISSUE-761 Move standalone mode of Storm SQL to Streamline ISSUE-851: Add missing string UDFs in streamline ISSUE-853: Enable Application Test mode from UI ISSUE-840: Address review comments ISSUE-765: Refactored FileStorage method names ISSUE-765: Keeping only streamline.yaml and streamline-dev.yaml and listing possible options in the config files ISSUE-765: DB based file storage ISSUE-840: Add standard SQL arithmetic functions in streamline ISSUE-836: UI change to show display name instead of name for UDF in projection processor ISSUE-841: Revert "ISSUE-694: Add consumer start up delay as optional parameter for kafka spout" ISSUE-838: Unit tests to cover UDFs and UDAFs shipped with streamline ISSUE-836: Fix identity function ISSUE-833: Fix failing AvroStreamsSnapshotDeserializerTest ISSUE-818 Fix REST integration test ISSUE-826 Sanitize mysql create_tables scripts ISSUE-829: Fix for Concat function ISSUE-774: reader and writer schema value needs to passed as string ISSUE-824 Forward Ambari response http status code when request to Ambari fails ISSUE-816: UI changes for RealTime Join Processor ISSUE-810: Fix the Issues observed during Hive Sink Testing ISSUE-774: UI changes to Make reader and writer schema version mandatory for kafka ISSUE-774: Address review comments ISSUE-801 Handle errors during custom processor upload ISSUE-802: Streaming Analytics Manager Application status issue ISSUE-742 UI Changes to make ssl truststore password mandatory for SSL listeners in Kafka ISSUE-774: Make reader and writer schema version mandatory for kafka ISSUE-742: Make ssl truststore password mandatory for SSL listeners in kafka ISSUE-796: HBase Client Retries Must be Configurable ISSUE-745: Added logout REST endpoint