Kafka Connect Alerting Options?

后端 未结 5 537
梦谈多话
梦谈多话 2021-01-13 10:45

Are there any alerting options for scenarios where a Kafka Connect Connector or a Connector task fails or experiences errors?

We have Kafka Connect running, it runs

5条回答
  •  醉梦人生
    2021-01-13 11:01

    (I still can't comment so to respond to clay's answer...)

    NOTE: There is a bug in the JMX metrics for task/connector status (at time of posting: 5/11/2020)

    1) When a task fails, it's status metrics dissapear. This is a known issue and there is a fix in progress. A Jira can be found here and PR can be found here.

    2) Don't use the Connector metric to monitor the status of the tasks. The Connector can show up as running fine but the tasks can be in a failure state, you need to monitor the tasks directly. This is mentioned in Confluent's Connector monitoring tips where it says:

    In most cases, connector and task states will match, though they may be different for short periods of time when changes are occurring or if tasks have failed. For example, when a connector is first started, there may be a noticeable delay before the connector and its tasks have all transitioned to the RUNNING state. States will also diverge when tasks fail since Connect does not automatically restart failed tasks.

提交回复
热议问题