Kafka message compression
Artie decompresses gzip-compressed Kafka message values, with the source-reader configuration exposed through Terraform.
Compressed Kafka message values could not previously be consumed through Artie’s transfer path.
Artie now supports decompressing gzip-compressed Kafka message values, with the source-reader configuration exposed through Terraform.
Why this matters
- Ingest Kafka topics that use gzip-compressed values
- Reduce transport volume without adding a custom preprocessing step