confluent

问题 I'm using confluent platform, the zookeeper is active with status lookup. but when I try to start kafka with confluent it shows zookeeper is down. $ sudo service zookeeper status Redirecting to /bin/systemctl status zookeeper.service ● zookeeper.service - Zookeeper Loaded: loaded (/etc/systemd/system/zookeeper.service; disabled; vendor preset: disabled) Active: active (running) since Tue 2017-08-08 17:25:34 PDT; 16h ago Docs: http://kafka.apache.org/documentation.html Process: 3774 ExecStop=

问题 I am looking at Apache Kafka v2.0.0 and I can't figure out what version of java it supports (OpenJDK or Oracle JDK's new lifecycle)? So far I have seen conflicting documentations. For example: In Apache Kafka Documentation page it says: Java 1.8, however in their release notes for v2.0 I see the bug fixes and improvement like: [KAFKA-6855] - Kafka fails to start with Java 10 due to faulty Java version detection [KAFKA-5907] - Support aggregatedJavadoc in Java 9 Confluent v5.x documentation

问题 I installed kafka confluent oss 4.0 on a fresh linux centos 7 but kafka connect failed to start. Steps to reproduce : - Install Oracle JDK 8 - Copy confluent-4.0.0 folder on opt/confluent-4.0.0 - Run /opt/confluent-4.0.0/confluent start Result : Starting zookeeper zookeeper is [UP] Starting kafka kafka is [UP] Starting schema-registry schema-registry is [UP] Starting kafka-rest kafka-rest is [UP] Starting connect \Kafka Connect failed to start connect is [DOWN] Error Log (connect.stderr) :

问题 I'm getting the below issue while trying to use the confluent for kafka-connect. I'm trying to follow the demo given at https://www.confluent.io/blog/simplest-useful-kafka-connect-data-pipeline-world-thereabouts-part-1/ Error: ./bin/confluent load jdbc_source_mysql_foobar_01 -d /tmp/kafka-connect-jdbc-source.json { This CLI is intended for development only, not for production https://docs.confluent.io/current/cli/index.html { "error_code": 400, "message": "Connector configuration is invalid

问题 Beginner in kafka and confluent package.I want to start multiple brokers so as to consume the topic. It can be done via this setting - {'bootstrap.server' : 'ip:your_host,...',} This setting can be defined in the server config file or else in the script as well. But how shall I run those?. If I just add multiple end points to the bootstrap servers, it gives this error: java.lang.IllegalArgumentException: requirement failed: Each listener must have a different name, listeners: PLAINTEXT://

问题 How do I add Confluent Control Center Interceptor to an existing S3(Sink) Connector? To monitor the Sink. I am looking for documentation. Any help is appreciated. 回答1: To be absolutely clear, you need interceptors on your sink and source . If you don't, you can't monitor your pipelines with Confluent Control Center as it stands today. To enable interceptors in Kafka Connect, add to the worker properties file: consumer.interceptor.classes=io.confluent.monitoring.clients.interceptor

问题 I am trying to configure Sink Kafka Connect for Google Cloud PubSub Service. Using following command to configure Kafka Connect: curl -X POST -H 'Content-Type: application/json' -H 'Accept: application/json' -d '{ "name": "pubsub_test", "config": { "connector.class": "com.google.pubsub.kafka.sink.CloudPubSubSinkConnector", "tasks.max": "1", "topics": "kafka_test_topic", "cps.topic": "cps_test_topic", "cps.project": "cps_test_project" } }' http://localhost:8083/connectors In status, I have a

问题 I am running Kafka via Confluent platform. I have followed the steps as per documented here, https://docs.confluent.io/2.0.0/quickstart.html#quickstart start zookeeper, $ sudo ./bin/zookeeper-server-start ./etc/kafka/zookeeper.properties start kafka, $ sudo ./bin/kafka-server-start ./etc/kafka/server.properties start schema-registry command, $ sudo ./bin/schema-registry-start ./etc/schema-registry/schema-registry.properties All are running fine. Next I want to run REST proxy commands, as per

问题 I am going through kafka connect, and i am trying to get the concepts. Let us say I have kafka cluster (nodes k1, k2 and k3) setup and it is running, now i want to run kafka connect workers in different nodes say c1 and c2 in distributed mode. Few questions. 1) To run or launch kafka connect in distributed mode I need to use command ../bin/connect-distributed.sh , which is available in kakfa cluster nodes, so I need to launch kafka connect from any one of the kafka cluster nodes? or any node

问题 I need to use confluent schema-registry to connect to 0.9 kafka. But for schema-registry 2.0.1 version I didn't see SSL configuration available. Is there a way to enable ssl for schema-registry and kafka-rest to talk to 0.9 kafka? 回答1: That functionality was only added as of the 3.0 release line. If you want support for 0.9/2.0 releases, you could try either a) taking a 3.0 release and reducing the Kafka dependency to 0.9 versions (this might work, but I think there were other unrelated