Release 94.1: Streams Agent, Consumer Offset Management, and Helm Charts

Toggle dark mode

Release Info

Kpow can be found on Dockerhub

docker pull factorhouse/kpow:94.1

View our Docker quick start guide for help getting started.

Kpow can be found on ArtifactHub

Helm version: 1.0.59

helm repo add factorhouse https://charts.factorhouse.io
helm repo update
helm install --namespace factorhouse --create-namespace my-kpow factorhouse/kpow --version 1.0.59 \
--set env.LICENSE_ID="00000000-0000-0000-0000-000000000001" \
--set env.LICENSE_CODE="KPOW_CREDIT" \
--set env.LICENSEE="Your Corp\, Inc." \
--set env.LICENSE_EXPIRY="2024-01-01" \
--set env.LICENSE_SIGNATURE="638......A51" \
--set env.BOOTSTRAP="127.0.0.1:9092\,127.0.0.1:9093\,127.0.0.1:9094" \
--set env.SECURITY_PROTOCOL="SASL_PLAINTEXT" \
--set env.SASL_MECHANISM="PLAIN" \
--set env.SASL_JAAS_CONFIG="org.apache.kafka.common.security.plain.PlainLoginModule required username=\"user\" password=\"secret\";"
--set env.LICENSE_CREDITS="7"

View our Helm instructions for help getting started.

Kpow can be found on the AWS Marketplace

View our AWS Marketplace documentation for help getting started.

Kpow can be downloaded and installed as a Java JAR file. This JAR is compatible with Java versions 17+.

Download Kpow Java 17 JAR

View our JAR quick start guide for help getting started.

Kpow can be downloaded and installed as a Java JAR file. This JAR is compatible with Java versions 11+.

Download Kpow Java JAR

View our JAR quick start guide for help getting started.

Kpow can be downloaded and installed as a Java JAR file. This JAR is compatible with Java 8.

Download Kpow Java 8 JAR

View our JAR quick start guide for help getting started.

Download VPAT
Factor House publish a VPAT (Voluntary Product Accessibility Template) for each release.

For more information, read the Kpow accessibility documentation.

This major version release from Factor House:

  • Improves data inspect
  • Improves consumer offset management
  • Improves Kafka Streams agent integration
  • Adds Flex and Community Helm Charts
  • Resolves a number of small bugs, and,
  • Bumps Kafka client dependencies to v3.9.0.

Brand new Helm Charts + Release simplification

This has been a highly requested feature for a while now: in-depth Helm Charts for all of our products!

Customers can now install Helm charts for our full product suite - Flex, Kpow and the Community Editions of both:

helm repo add factorhouse https://charts.factorhouse.io
helm repo update
helm install my-kpow-ce factorhouse/kpow-ce

To read more about our improvements to Helm + Docker see this blog post: Updates to container specifics (DockerHub and Helm Charts).

We've also streamlined our deliverables, introducing clearer release channels to make accessing our products easier than ever. This groundwork sets the stage for a big year of exciting releases!

Consolidate release artifacts

  • Consistently deploy all artifacts (Maven, Clojars, AWS Marketplace, Helm, ArtifactHub and DockerHub) to the factorhouse organisation.
  • See blog post: A final goodbye to OperatrIO for more details.

Simplify DockerHub repos

Communicate Java compatibility and evolution

1.0.0 Kpow Streams Agent!

Our beloved open-source Kpow Streams Agent hits its 1.0.0 release milestone!

Along with core improvements to the agent, we have poured a lot of love into Kpow's Kafka Streams UI and crunched down on backend work required when processing streams metrics.

Data Inspect improvements

This release is packed with quality improvements to our data inspection functionality, making it smoother, more reliable, and better than ever!

Stay tuned! We're bringing plenty more quality improvements to Kpow's data inspection functionality this year!

New modes

The data inspect form now contains additional Modes. New options include:

  • Slice (default) - queries records beginning from a start time
  • Bounded window - queries records between a start and end time

Improved data inspect reliability

There has been an outstanding bug in Kafka relating to long-running consumers that could not recover after certain broker rolling-upgrade scenarios. This bug is captured in KAFKA-13467 and resolved in Kafka clients 3.8.0 and above.

Some customers have reported this exact issue when running on Confluent Cloud. We think Confluent periodically roll their brokers in each cluster (probably for reasonable ops reasons) and update their DNS with new broker IPS rather than changing the bootstrap.

This release now resolves this long-standing data inspect issue! Our data inspect consumer pool should be more resilient to broker upgrades.

We have also added the option to manually restart the consumer pool for any case there may be unexpected consumer death.

Configurable isolation level

Starting with 94.1 customers can now specify the isolation level of the query (defaulting to READ_UNCOMMITED). When set to READ_COMMITED data inspect results will only return records from committed transactions. This can be particularly useful for customers looking to debug issues, where they ignore data in uncommitted transactions

Improved Offset Management

Kpow has long supported managing consumer group offsets, but this release gives the feature the attention it deserves:

  • Reset offset by providing new offset value
  • Reset offset by providing a precise timestamp
  • Consistent action menu across different nodes of consumer group topology as well as in table views
Consumer Offset Reset options

Release v94.1 Changelog

See the Factor House Product Roadmap to understand current delivery priorities.

Kpow v94.1 Changelog

See the full Kpow Changelog for information on previous releases

  • Advance to Apache Kafka Client v3.9.0 libraries
  • Default to Java17 for releases
  • Add Kpow Community Helm Charts
  • Data inspect improvements:
    • Correct format 'very large' Long values in query results
    • Add optional 'Window end' to queries
    • Add advanced data inspect query options:
      • Add ability to specify isolation level=READ_COMMITTED for query
      • Add ability to manually reset sampler before invoking a query
  • Streams Agent improvements:
    • Release version 1.0.0 of the io.factorhouse/kpow-streams-agent library
      • Add ability to configure a KeyStrategy - how data written to internal topic should be keyed
      • Add ability to configure a MetricFilter - specify which metrics should be sent to Kpow
    • Improve performance of streams agent backend processing
    • Improve streams agent overview page: add details about running agents, number of metrics
    • Improve streams agent topology metric UIs
  • Consumer offset management:
    • Make UX consistent between 'Workflows' UI and Table actions
    • Add new reset method: reset by raw offset
    • Improve timestamp UX: show timestamp as local time, UTC and UNIX epoch in UI
    • Improve reset offset form UX
  • API improvements:
    • Add API descriptions to all fields in our OpenAPI 3.0 spec
    • Add temporary policies to the Admin API endpoints
  • Topic actions: add 'View schema' action to all topic tables
  • Accessibility: add decal options to all charts
  • Re-add 'Data' quick link tab within 'Topics' panel
  • Add new configuration options for Strict-Transport-Security: HTTPS_STS_MAX_AGE and HTTPS_INCLUDE_SUBDOMAINS
  • Fix measurement unit in disk graphs
Flex v94.1 Changelog

See the full Flex Changelog for information on previous releases

  • Default to Java17 for releases
  • Add Flex and Flex Community Helm Charts
  • Accessibility: add decal options to all charts
  • Add new configuration options for Strict-Transport-Security: HTTPS_STS_MAX_AGE and HTTPS_INCLUDE_SUBDOMAINS
Release 94.6: Factor Platform, Ververica Integration, and kJQ Enhancements

The first Factor Platform release candidate is here, a major milestone toward a unified control plane for real-time data streaming technologies. This release also introduces Ververica Platform integration in Flex, plus support for Kafka Clients 4.1 / Confluent 8.0.0 and new kJQ operators for richer stream inspection.

Release 94.5: New Factor House docs, enhanced data inspection and URP & KRaft improvements

This release introduces a new unified documentation hub - Factor House Docs. It also introduces major data inspection enhancements, including comma-separated kJQ Projection expressions, in-browser search, and over 15 new kJQ transforms and functions. Further improvements include more reliable cluster monitoring with improved Under-Replicated Partition (URP) detection, support for KRaft improvements, the flexibility to configure custom serializers per-cluster, and a resolution for a key consumer group offset reset issue.

Release 94.4: Auto SerDes improvements

This minor hotfix release from Factor House resolves a bug when using Auto SerDes without Data policies, and adds support for UTF-8 String Auto SerDes inference.

Start your streaming transformation today.

 Try both Kpow or Flex free for 30 days with a single license - no credit card required.