apache-storm

问题 I started last week a formation in Kafka and Storm at OpenClassRooms. During practical work, I encounter an error when I try to execute a JAR containing my java code for Storm. No problem when compiling the project in Java, no problem when packaging with maven, the problem only occurs when running the JAR theirman@vm-debian:/data/eclipse-workspace/velos$ storm jar target/velos-1.0-SNAPSHOT.jar velos.App remote Running: /usr/lib/jvm/java/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm

问题 I am a trying to integrate Storm with Kafka. I am running a Storm topology using KafkaSpout . This is the basic word-count topology. I am using Apache Kafka as the source and storm for processing the data. While submitting the topology I am facing these issues. I am very new to Kafka and Storm. Please suggest me the changes I need to do in the following code. This is my code: public class TopologyMain { private static final String SENTENCE_SPOUT_ID = "kafka-sentence-spout"; private static

问题 I am developing a storm topology locally. I am using the Storm 0.9.2-incubating and have developed a simple Topology. When I deploy it using the LocalCluster() option, it works fine, but it will not show up in my Storm UI it just executes. When I deploy it regularly, it will show the Topology in my Storm UI, but no spouts or bolts will be visible when I click it. I have also tried this with example WordCountTopology that comes in many storm starter projects. The same behavior happens. My

问题 I am developing a storm topology locally. I am using the Storm 0.9.2-incubating and have developed a simple Topology. When I deploy it using the LocalCluster() option, it works fine, but it will not show up in my Storm UI it just executes. When I deploy it regularly, it will show the Topology in my Storm UI, but no spouts or bolts will be visible when I click it. I have also tried this with example WordCountTopology that comes in many storm starter projects. The same behavior happens. My

问题 I am developing a storm topology locally. I am using the Storm 0.9.2-incubating and have developed a simple Topology. When I deploy it using the LocalCluster() option, it works fine, but it will not show up in my Storm UI it just executes. When I deploy it regularly, it will show the Topology in my Storm UI, but no spouts or bolts will be visible when I click it. I have also tried this with example WordCountTopology that comes in many storm starter projects. The same behavior happens. My

问题 Having a spout which on each tick goes to Postgre database and reads an additional row. The spout code looks as follows: class RawDataLevelSpout extends BaseRichSpout implements Serializable { private int counter; SpoutOutputCollector collector; @Override public void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(new Fields("col1", "col2")); } @Override public void open(Map map, TopologyContext context, SpoutOutputCollector spoutOutputCollector) { collector =

问题 How 'capacity' is calculated? From their documentation The "capacity" metric is very useful and tells you what % of the time in the last 10 minutes the bolt spent executing tuples. If this value is close to 1, then the bolt is "at capacity" and is a bottleneck in your topology. The solution to at-capacity bolts is to increase the parallelism of that bolt. I don't quite understand % of time. So if the value is 0.75 - what does it really mean? 回答1: It's the percent of time that the bolt is busy

问题 I'm new in using storm trying to submit storm-starter but when i mvn package i got that error java.lang.NoClassDefFoundError: org/yaml/snakeyaml/constructor/BaseConstructor, compiling:(word_count.clj:16:1) at clojure.lang.Compiler$InvokeExpr.eval(Compiler.java:3463) POM file here in the link 回答1: I found this solution: add this in pom file. <groupId>org.testng</groupId> <artifactId>testng</artifactId> <version>6.2</version> <type>jar</type> <exclusions> <exclusion> <artifactId>snakeyaml<

问题 I am able to set up zookeeper cluster on 1 machine with 3 different ports, but when I do the same with different IP to have zookeeper instance on different machines, it throws following error: 2014-11-20 12:16:24,819 [myid:1] - INFO [main:QuorumPeerMain@127] - Starting quorum peer 2014-11-20 12:16:24,827 [myid:1] - INFO [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:2181 2014-11-20 12:16:24,842 [myid:1] - INFO [main:QuorumPeer@959] - tickTime set to 2000 2014-11-20 12:16:24

问题 I have a Storm cluster with 2 nodes and 1 ZooKeeper. One of the worker dies because of the following error. Does any one have an idea on why stormconf.ser file is getting deleted? I am using 0.9.2 Storm and 3.4.6 ZK version. o.a.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED 2015-01-31 01:23:06 o.a.c.f.s.ConnectionStateManager [WARN] There are no ConnectionStateListeners registered. 2015-01-31 01:23:07 b.s.d.worker [ERROR] Error on initialization of server mk-worker java.io