An open-source visualization tool for monitoring Kafka cluster metrics
Hyperion is an open-source visualization tool for monitoring crucial health metrics of your Kafka cluster. This tool allows developers to quickly assess the functionality of their Kafka cluster, as well as identify metrics that become out of the appropriate range. Real-time metrics are consolidated in one dashboard for easy access, and developers have access to an error log where instances of out-of-range metrics are displayed. This application can be deployed on your local network.
Featured metrics include: under-replicated partitions, offline partitions, active controller count, producer average request latency, request rate, response rate, bytes consumed rate, and producer outgoing byte rate.
You will need npm and the latest version of Node.js.
Ports 3001 and 8080 need to be available to run this application.
Make sure you have a running Kafka cluster with a configured Prometheus instance (you will need the domain and port of where Prometheus is running)
git clone https://github.com/oslabs-beta/hyperionn
npm install
npm run build
npm start
Hyperion defaults to running on port 3000. Simply go to http://localhost:3000 to view your metrics and start managing your Kafka cluster!
After you log in, click ‘connect’ in the side navbar. Input the port number and the domain where your prometheus instance is running for your Kafka cluster and click ‘submit’.
Congratulations! You can now view live streaming of data.
Note: When the simple key metrics (active controllers, under-replicated partitions, offline partitions) are not their expected values, the app will store the occurrence and display them in the error log found on the side navbar.
Here are some features the Hyperion team is working on adding to the application in the near future:
If there is a feature you think would be useful to you and your team, or if you find any bugs, please open an issue.
Contributions are welcomed and appreciated. You can do the following to support the project!
This product is licensed under the MIT License without restriction.