spring-xd

问题 I am trying to use spring xd to ingest text/xml responses from a web service using HTTP/1.1 protocol. The goal is to convert the xml response to json and insert into mongodb. But right now I am unable to get any responses from the stream. I want to do this programatically rather than in the shell, below is my code public static void main(String[] args) { SpringXDTemplate template = null; try { template = new SpringXDTemplate(new URI("http://localhost:9393")); } catch (URISyntaxException e) {

问题 I am trying to use spring xd to ingest text/xml responses from a web service using HTTP/1.1 protocol. The goal is to convert the xml response to json and insert into mongodb. But right now I am unable to get any responses from the stream. I want to do this programatically rather than in the shell, below is my code public static void main(String[] args) { SpringXDTemplate template = null; try { template = new SpringXDTemplate(new URI("http://localhost:9393")); } catch (URISyntaxException e) {

问题 I am trying to run the Simple Single Project Yarn Application detailed here. I deployed the application as a jar file to our hadoop cluster. When trying to run, I am getting an exception, stack trace below: [2015-06-04 14:10:45.866] boot - 13669 ERROR [main] --- SpringApplication: Application startup failed java.lang.IllegalStateException: Failed to execute CommandLineRunner at org.springframework.boot.SpringApplication.runCommandLineRunners(SpringApplication.java:680) at org.springframework

问题 I successfully installed Spring XD 1.2.0 RC1 on HDP 2.2 using the Ambari plugin. Now that Spring XD 1.2.0 GA is out, how do I go about upgrading my installation? 回答1: Looks like you need to remove the RC1 install and replace it with the 1.2.0 GA. I didn't see an option for updating a service in the Ambari UI. These are the steps I took: 1) stop the Spring XD service from Amabari UI 2) remove old Spring XD plugin: yum remove springxd-plugin-hdp 3) remove Spring XD installation: yum remove

问题 I have a module s3-puller which pulls file from was s3 .In the production i am facing some issue when i try to create a stream.But local single node it works fine and i tried to set up 3 node cluster and 1 admin node in local it works fine. Below is my application context <?xml version="1.0" encoding="UTF-8"?> <beans xmlns="http://www.springframework.org/schema/beans" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:int="http://www.springframework.org/schema/integration" xmlns:int

问题 I've got Sring Xd running in distributed mode and now beginning to run a few JMeter tests. My question is around how the load generated gets distributed across containers in distributed mode. If I generate 1000 messages each for 100 users, I'd like thiis traffic to be split between two or more containers running. Is this possible? Or does one container take on the entire load? In my current setup this is what seems to be happening. 回答1: What is the stream definition? And, specifically, what

问题 The sql query is fairly standard inner join type. For example comparing n tables to see which customerId's exist in all n tables would be a basic WHERE ... AND type query. The problem is the size of the tables are > 10 million records. The database is denormalized. Normalization is not an option. The query either takes to long to complete or never completes. I'm not sure if it's relevant but we are using spring xd job modules for other types of queries. I'm not sure how to partition this sort

问题 The sql query is fairly standard inner join type. For example comparing n tables to see which customerId's exist in all n tables would be a basic WHERE ... AND type query. The problem is the size of the tables are > 10 million records. The database is denormalized. Normalization is not an option. The query either takes to long to complete or never completes. I'm not sure if it's relevant but we are using spring xd job modules for other types of queries. I'm not sure how to partition this sort

问题 Is there a way to launch a set of steams and taps that have been defined when a new instance of spring xd is launched? The scenario is this: We've done some prototyping on our dev systems, but now when we'd like to build and release this to a test team. We'd like to automate most of the background work and the user needs to just worry about the output from the streams and not have to worry about the streams or their definitions or their deployment. To facilitate this is there any runtime

问题 I am trying to deploy two spring-XD streams. Stream 1 and Stream 2. Both the streams are getting deployed fine in the local box (Single node) but when i try to deploy this in higher environment (distributed node) Stream 2 is getting deployed successfully but not stream 1. Here is the Stream Definition Stream --name test definition "CustomSource | Custom Processor 1 | Custom Processor 2 | Custom Processor 3 > queue:TestQueue" Below is the error I am seeing in the admin logs. I believe this is