Kafka Streams error - Offset commit failed on partition, request timed out

Question

We use Kafka Streams for consuming, processing and producing messages, and on PROD env we faced with errors on multiple topics:

ERROR org.apache.kafka.clients.co         


        

Answer 1

Looks like you have issue with Kafka cluster and Kafka consumer is get timed out while trying to commit offsets. You can try to increase connection related configs for Kafka consumer

1. request.timeout.ms (by default 305000ms)

The configuration controls the maximum amount of time the client will wait for the response of a request

2. connections.max.idle.ms (by default 540000ms)

Close idle connections after the number of milliseconds specified by this config.