Just Do It ! 행동하지 않으면 성공도 실패도 없다

Kafka Quotas, Latency

kafka client - quotas, latency https://aivarsk.com/2021/11/01/low-latency-kafka-producers/ What still makes me wonder is why librdkafka does not set TCP_NODELAY by default. Because they are doing something similar to Nagle’s algorithm in the library code by using linger.ms/ queue.buffering.max.ms settings and buffering messages. Long story short, to optimize producers for latency, you should set both: socket.nagle.disable = True queue.buffering.max.ms = 0 I think you should also set socket.nagle.disable for low latency consumers to deliver acknowledgments as soon as possible.

Kafka Encryption with SSL/TLS

Encryption with SSL/TLS mTLS kafka #!/usr/bin/env bash ############### Parameters ############### PASSWORD='password' VALIDITY=730 KAFKA_BROKER_COUNT=3 ############### Existing certs Cleanup ############### rm -rf ./certs && mkdir certs cd certs ############### Creating sslconfig file for CA ############### cat > "openssl.cnf" << EOF [req] default_bits = 4096 encrypt_key = no # Change to encrypt the private key using des3 or similar default_md = sha256 prompt = no utf8 = yes # Specify the DN here so we aren't prompted (along with prompt = no above).

Spring Kafka의 다양한 Listeners