Livestream IQ Highlights
1.1 Key Features of LivestreamIQ
OAuth Authentication Integration:
Ensures secure access to both UI and backend APIs using OAuth 2.0, providing robust authentication and authorization mechanisms.
Role-Based Access Control (RBAC):
Customizes the UI based on user roles, ensuring users have access only to the functionalities they need, thereby enhancing security and usability.
Performance Monitoring with Metrics Dashboard:
Offers real-time insights into Kafka node and pod metrics, helping users monitor and optimize Kafka performance efficiently.
Broker Management:
Facilitates the addition, removal, and health monitoring of Kafka brokers directly from the UI, ensuring smooth and scalable cluster management.
Topic Management:
Enables users to view, add, remove, and extend Kafka topics with ease, supporting dynamic adjustments to accommodate changing data stream requirements.
Message Browsing:
Allows users to view and align Kafka message content, aiding in debugging and ensuring message integrity and consistency.
Consumer Group Management:
Provides functionalities to view, add, and remove consumer groups, as well as assign consumers to groups, enhancing data consumption flexibility.
Multi-Cluster Management:
Supports the management of multiple Kafka clusters from a single dashboard, streamlining operations across different environments and improving operational efficiency.
Integration with Kubernetes (K8s) and Helm Charts:
Simplifies the deployment and management of Kafka with Kraft on Kubernetes, using Helm charts and K8 manifests for seamless configuration.
New Features in Version 3.5.0
Data Masking: Protects sensitive information in log messages by automatically obfuscating data (e.g., PII or confidential fields) with masking characters. An "eye" icon toggle allows authorized users (such as admins or compliance roles) to temporarily reveal the sensitive information.
User Interface:
Masking Icon: Clearly displayed above sensitive data fields.
Toggle Functionality: A brief animation or icon state change confirms that the data is being unmasked when clicked.
Enhanced Filtering Option: Improves log analysis within the Logs Dashboard by enabling users to filter logs in real time based on specified log levels (e.g., ERROR, WARNING, INFO, DEBUG).
User Interface:
Filter Panel and Dropdown Options: Dedicated section for filtering with intuitive dropdowns that allow users to toggle specific log levels.
Dynamic Updates: The dashboard updates immediately as filters are applied, without the need for a page refresh.
Logs Dashboard: Provides a comprehensive graphical overview of system logs covering the last 24 hours.
Key Components:
Time-Series Graphs: Display log frequency and peak activity times.
Error Trends Chart: Highlights recurring issues by charting error-level logs.
Log Level Distribution: Visual representations (e.g., pie or bar charts) that show the distribution of logs across various levels (ERROR, WARN, INFO, etc.).
Detailed Log Breakdown: Summaries of total logs, log type distributions, and statistical data (such as average logs per hour), with interactivity that allows users to drill down into detailed log segments.
1.2 Who Should Use LivestreamIQ
LivestreamIQ is ideal for:
Developers: Streamline development workflows with intuitive Kafka topic and message management.
IT Administrators: Easily manage and monitor Kafka clusters, brokers, and consumer groups.
DevOps Engineers: Integrate Kafka management into CI/CD pipelines, automate tasks, and maintain optimal performance.
Data Engineers: Efficiently handle data streams, ensuring real-time data processing and analytics.
1.3 Benefits of LivestreamIQ
Enhanced Security: Secure user access with OAuth 2.0 and RBAC, now further bolstered by data masking to safeguard sensitive information.
Operational Efficiency: Simplify Kafka management tasks, significantly reducing the time and effort required for system administration and monitoring.
Scalability: Easily manage and scale Kafka clusters to accommodate growing data and processing demands.
User-Friendly Interface: A consistent, intuitive UI design that makes Kafka ecosystem management accessible for users at all technical levels.
Improved Log Analysis: Leverage enhanced filtering options and an interactive logs dashboard to quickly identify issues and monitor system performance.
LivestreamIQ empowers organizations to harness the full potential of Kafka, making real-time data processing, streaming, and management more accessible and efficient.
Last updated