Kafka Compression on Azure Event Hubs Public Preview

  • Thread starter Thread starter Christina Compy
  • Start date Start date
C

Christina Compy

Kafka compression

Microsoft is happy to announce the public preview of Kafka Compression for Apache Kafka on Azure Event Hubs. Kafka Compression enables message producers to transmit compressed data which is decompressed by the consumer. By compressing your payload, you are able to save a lot of bandwidth and reduce the memory overhead on the brokers supporting your traffic.

Kafka producer application developers can enable message compression by setting the compression.type property.

Compression.type = none | gzip



These changes are exposed in the header which then allows the consumer to properly decompress the data.



The feature is currently only supported for Apache Kafka traffic and not AMQP or web service.



There is more information on this feature in documentation at Azure Event Hubs documentation

Continue reading...
 
Back
Top