Release 91.1: ksqlDB UI and Broker Disk Telemetry
Release Info
Kpow can be found on Dockerhub
docker pull factorhouse/kpow-ee:91.1View our Docker quick start guide for help getting started.
Kpow can be found on ArtifactHub
Helm version: 1.0.46
helm repo add kpow https://charts.kpow.io
helm repo update
helm install --namespace factorhouse --create-namespace my-kpow kpow/kpow --version 1.0.46 \
--set env.LICENSE_ID="00000000-0000-0000-0000-000000000001" \
--set env.LICENSE_CODE="KPOW_CREDIT" \
--set env.LICENSEE="Your Corp\, Inc." \
--set env.LICENSE_EXPIRY="2024-01-01" \
--set env.LICENSE_SIGNATURE="638......A51" \
--set env.BOOTSTRAP="127.0.0.1:9092\,127.0.0.1:9093\,127.0.0.1:9094" \
--set env.SECURITY_PROTOCOL="SASL_PLAINTEXT" \
--set env.SASL_MECHANISM="PLAIN" \
--set env.SASL_JAAS_CONFIG="org.apache.kafka.common.security.plain.PlainLoginModule required username=\"user\" password=\"secret\";"
--set env.LICENSE_CREDITS="7"View our Helm instructions for help getting started.
Kpow can be found on the AWS Marketplace
View our AWS Marketplace documentation for help getting started.
Kpow can be downloaded and installed as a Java JAR file. This JAR is compatible with Java versions 11+.
View our JAR quick start guide for help getting started.
Kpow can be downloaded and installed as a Java JAR file. This JAR is compatible with Java 8.
View our JAR quick start guide for help getting started.
For more information, read the Kpow accessibility documentation.
Kpow v91.1 introduces a new ksqlDB UI, new disk usage telemetry, schema registry improvements, wildcard filtering, and closes a number of minor issues.
ksqlDB User Interface
Kpow now provides ksqlDB integration paired with Kpow's enterprise features such as role-based access control and data-masking.
ksqlDB features seamlessly integrate with other Kpow managed resources such as connect clusters and schema registries.
Like all actions performed within Kpow, an audit log is kept for data governance when issuing any ksqlDB action.
See the ksqlDB setup guide for configuration details, or read our ksqlDB feature guide for more information about Kpow's new ksqlDB capabilities.
Broker Disk Telemetry
Kpow v91.1 provides deeper insight into broker disk usage, all the way down to a directory level. Simply navigate to Brokers > Disk.
Where your Kafka brokers are v3.3.0+ you will see Total Disk, Usable Disk, and Disk Remaining % information.
Broker Disk Telemetry in Prometheus
Each of these new fields is available via Kpow's prometheus endpoint at a broker and broker directory level.
Broker total and usable bytes
# HELP broker_bytes_total The total disk size in bytes of a broker# TYPE broker_bytes_total gaugebroker_bytes_total{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="2",} 1.05491914752E11broker_bytes_total{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="3",} 1.05491914752E11broker_bytes_total{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="1",} 1.05491914752E11# HELP broker_bytes_usable The usable disk size in bytes of a broker# TYPE broker_bytes_usable gaugebroker_bytes_usable{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="3",} 1.00089417728E11broker_bytes_usable{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="1",} 1.00089393152E11broker_bytes_usable{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="2",} 1.00089397248E11
Broker directory total and usable bytes
# HELP broker_dir_bytes_total The total disk size in bytes of a broker directory# TYPE broker_dir_bytes_total gaugebroker_dir_bytes_total{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="1",dir="_kafka_datalogs_logs",} 1.05491914752E11broker_dir_bytes_total{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="3",dir="_kafka_datalogs_logs",} 1.05491914752E11broker_dir_bytes_total{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="2",dir="_kafka_datalogs_logs",} 1.05491914752E11# HELP broker_dir_bytes_usable The usable disk size in bytes of a broker directory# TYPE broker_dir_bytes_usable gaugebroker_dir_bytes_usable{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="3",dir="_kafka_datalogs_logs",} 1.00089417728E11broker_dir_bytes_usable{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="2",dir="_kafka_datalogs_logs",} 1.00089397248E11broker_dir_bytes_usable{domain="cluster",id="CuxsifYVRhSRX6iLTbANWQ",target="1",dir="_kafka_datalogs_logs",} 1.00089393152E11
Schema Registry Improvements
Kpow v91.1 introduces improvements to schema registry authentication and observation.
Confluent Cloud Schema Registry OAuth Authentication
Kpow supports authenticating with Confluent Cloud schema registry via OAuth.
See the Confluent Cloud guide to Schema Registry OAuth and the Kpow Schema Registry Configuration Guide for more information.
Confluent Schema Registry Observation Version
Kpow provides a configurable OBSERVATION_VERSION that allows you to choose a more efficient mode of observering Confluent schema registry, at the small cost of showing schema compatibility information only at the drill-down level in the Kpow UI.
In time we will default the OBSERVATION_VERSION to '2', the current default is '1' (no change from existing).
Read more in the Kpow Schema Registry Configuration Guide.
Custom Serdes and Message Headers
Message Headers are now passed to the serialize and deserialize methods of custom serdes configured with Kpow.
See the Kpow Custom Serdes Guide for more information.
Note: this change introduces a minor breaking change in that your custom serdes must be compiled with Kafka v2.1.0+.
Release v91.1 Changelog
See the Factor House Product Roadmap to understand current delivery priorities.
Kpow v91.1 Changelog
See the full Kpow Changelog for information on previous releases
- Introduce new ksqlDB integration
- Introduce new disk usage telemetry
- Introduce support for Confluent Cloud Schema Registry OAuth authentication
- Improve schema registry observation with configurable OBSERVATION_VERSION
- Improve custom serdes with headers support
- Improve top-level filtering with wildcard support
- Improve topic and broker configuration UI with fast filters and table preferences
- Improve bulk actions with bulk group delete support
- Fix ACL bug related to comma-separated principals
- Fix intellisense bug in key entry field when producing messages
- Fix minor dark mode UI bugs
- Bump to Kafka 3.4.0 dependencies
- Bump to Confluent 7.3.1 dependencies
Release 94.6: Factor Platform, Ververica Integration, and kJQ Enhancements
The first Factor Platform release candidate is here, a major milestone toward a unified control plane for real-time data streaming technologies. This release also introduces Ververica Platform integration in Flex, plus support for Kafka Clients 4.1 / Confluent 8.0.0 and new kJQ operators for richer stream inspection.
Release 94.5: New Factor House docs, enhanced data inspection and URP & KRaft improvements
This release introduces a new unified documentation hub - Factor House Docs. It also introduces major data inspection enhancements, including comma-separated kJQ Projection expressions, in-browser search, and over 15 new kJQ transforms and functions. Further improvements include more reliable cluster monitoring with improved Under-Replicated Partition (URP) detection, support for KRaft improvements, the flexibility to configure custom serializers per-cluster, and a resolution for a key consumer group offset reset issue.
Release 94.4: Auto SerDes improvements
This minor hotfix release from Factor House resolves a bug when using Auto SerDes without Data policies, and adds support for UTF-8 String Auto SerDes inference.
Start your streaming transformation today.
Try both Kpow or Flex free for 30 days with a single license - no credit card required.