spring-xd

问题 Considering any message bus can be deployed with spring-xd, is there any API provided by spring-xd that can write to the message bus deployed, say, Kafka/rabbitmq based on the configurations in xd/config/servers.yml or any other such place. I am writing a processor (itemprocessor), which does some processing of the data and the writer will write the data to a rabbitmq queue for now. Since, in the current deployment scenario, rabbitmq may or may not be deployed, the processor should be able to

问题 I have Spring XD job already deployed which expects 2 jobParameter s ( absoluteFilePath and fileName ). Actually this job is triggered by JMS stream whose output provides those 2 jobParameter s in JSON format and that works fine. I want to launch the job with REST API like: curl -X POST http://localhost:9393/jobs/executions?jobname=loadData&jobParameters=%7B%22absoluteFilePath%22%3A%22C%3A%2FUB%2Fdev%2FBM.txt%22%2C%22fileName%22%3A%22BM.txt%22%7D Error I'm getting: 'jobParameters' is not

问题 In my job I have a database export to csv which is partitioned. The next step merges those files into a single file using MultiResourceItemReader. My problem is that the files don't seem to be available when the merge step starts. I get this exception java.lang.IllegalStateException: No resources to read. Set strict=false if this is not an error condition. at org.springframework.batch.item.file.MultiResourceItemReader.open(MultiResourceItemReader.java:169) at org.springframework.batch.item

问题 I have tried to follow the steps in https://github.com/SpringOne2GX-2014/Spring-XD-Internals/tree/master/jms-message-bus to point to an external Active MQ. But when i start the XD with ./xd-singlenode --transport jms I'm getting an error, i think JMS is not getting recognized provided in the Wiki, what am i missing? Below is the error `2015-02-11 16:29:42,708 1.1.0.RELEASE INFO main` server.SingleNodeApplication - Started SingleNodeApplication in 0.963 seconds (JVM running for 1.313) 'jms' is

问题 Does Spring XD support automatic deployment of new modules? Looking at the documentation, it seems that you need to restart the server to deploy a new module added in ${xd.home}/lib directory. If not supported, is it in the roadmap? Thanks. 回答1: Hot detection of new modules should be working, provided that you deploy them to the ${xd.home}/modules/<type>/<name> directory. Please note that placing jars inside ${xd.home}/lib should now only be needed for classes that need to be referenced from

问题 I have a spring xd source module which pulls file from s3 and splits line by line.I have my spring config as below.But I have 3 container and 1 admin server.Now I see duplicate message being processed by each container as each of them is downloading there own copy. I can solve with making source s3 module deployment count as 1 but my processing of message is getting slow.?Any inputs to solve this? <int:poller fixed-delay="${fixedDelay}" default="true"> <int:advice-chain> <ref bean="pollAdvise

问题 So far I have implemented Spring XD processors, e.g. like this: @MessageEndpoint public class MyTransformer { @Transformer( inputChannel = "input", outputChannel = "output" ) public String transform( String payload ) { ... } }; However, I am stuck at implementing a custom sink now. The current documentation is not very helpful, since it simply configures something "magically" via XML: <beans ...> <int:channel id="input" /> <int-redis:store-outbound-channel-adapter id="redisListAdapter"

问题 Good evening everybody I run with SpringXD-1.3.0.RELEASE (configuration: 3 admin and 3 container) and RabbitMQ 3.5.7 (3 nodes) into following scenario: stream create --name fire --definition "time --timeUnit=MILLISECONDS > topic:fire" --deploy stream create --name fireeater_1 --definition "topic:fire > null" stream create --name fireeater_2 --definition "topic:fire > null" stream create --name fireeater_3 --definition "topic:fire > null" stream create --name fireeater_4 --definition "topic

问题 In the job I read from a file and store something in a database. I would like to have many running jars of the batch job in different processes and partition the data from the file among the running instances. I would also like to be able to keep adding files to be processed and also distribute the reads from those. I read spring xd might be a good fit, but can't find good tutorials on it. YES I am also a noob of spring batch and xd. 回答1: The first thing to understand is how to remotely

问题 I am trying to run a Spark processor on Spring XD for streaming operation. The spark processor module on Spring XD works when spark is pointing to local. The processor fails to run when we point spark to spark standalone (running on the same machine) or yarn-client. Is it possible to run spark processor on spark standalone or yarn inside spring XD or is spark local the only option here ? The processor module is defined as: class WordCount extends Processor[String, (String, Int)] { def process