spring-cloud-task

Spring Cloud Stream App VS Spring Cloud Task App

情到浓时终转凉″ 提交于 2019-12-10 11:06:13
问题 I'm exploring the the SCDF for orchestrating the existing batch task for my system. I noticed that the SC Stream App Starters already provides some OOTB ready to use streaming applications, which suits my use case of: Extracting xml file from FTP -> the ftp source Customize transformation Upload the transformed xml file to another FTP -> the ftp sink But, my system only requires the above mentioned batch job to be executed at every 10 minutes interval. Implementing it using streams app is

Spring cloud task's SimpleTaskConfiguration and spring batch's SimpleBatchConfiguration preventing spring boot auto configuration of XA transactions

限于喜欢 提交于 2019-12-08 19:53:01
问题 I am trying to configure XA/distributed transactions for a spring batch / spring cloud task application configured with spring boot. I have added the following dependency hoping to rely on spring boot auto configuration: compile("org.springframework.boot:spring-boot-starter-jta-atomikos") However the following two classes cause two transaction managers to be configured: org.springframework.cloud.task.configuration.SimpleTaskConfiguration org.springframework.batch.core.configuration.annotation

Spring Cloud Stream App VS Spring Cloud Task App

被刻印的时光 ゝ 提交于 2019-12-06 10:49:06
I'm exploring the the SCDF for orchestrating the existing batch task for my system. I noticed that the SC Stream App Starters already provides some OOTB ready to use streaming applications, which suits my use case of: Extracting xml file from FTP -> the ftp source Customize transformation Upload the transformed xml file to another FTP -> the ftp sink But, my system only requires the above mentioned batch job to be executed at every 10 minutes interval. Implementing it using streams app is fine but it requires the stream app to be running 24-7 (using SCDF with Kubernetes). My concern is that I

Need to configure my JPA layer to use a TransactionManager (Spring Cloud Task + Batch register a PlatformTransactionManager unexpectedly)

蹲街弑〆低调 提交于 2019-12-03 23:33:09
问题 I am using Spring Cloud Task + Batch in a project. I plan to use different datasources for business data and Spring audit data on the task. So I configured something like: @Bean public TaskConfigurer taskConfigurer() { return new DefaultTaskConfigurer(this.singletonNotExposedSpringDatasource()); } @Bean public BatchConfigurer batchConfigurer() { return new DefaultBatchConfigurer(this.singletonNotExposedSpringDatasource()); } whereas main datasource is autoconfigured through

Does spring-cloud-dataflow provide support for scheduling applications defined as tasks?

僤鯓⒐⒋嵵緔 提交于 2019-12-03 20:56:24
I have been looking at using projects built using spring-cloud-task within spring-cloud-dataflow. Having looked at the example projects and the documentation, the indication seems to be that tasks are launched manually through the dashboard or the shell. Does spring-cloud-dataflow provide any way of scheduling task definitions so that they can run for example on a cron schedule? I.e. Can you create a spring-cloud-task app which itself has no knowledge of a schedule, but deploy it to the dataflow server and configure the scheduling there? Among the posts and blogs I have looked at I noticed the

spring-cloud-task how to pass messages or flag between two apps

元气小坏坏 提交于 2019-12-02 07:49:06
I have already made a Ingestion job using spring batch which reads xml file and ingest into AEM and its working fine. Now, I am trying to convert this apps into Spring cloud Task. I want to split this apps into 4 different part which is individual apps. I need to connect them into spring cloud data workflow and pass some data and flags based on that next flow will be execute. Is it possible on spring cloud Task? if yes then how can I bind them? please provide some programming tutorial. In the recent 1.2.0.RELEASE , we have released a new feature called the "Composed Tasks" . With this, you

Issue with configuring Atomikos on a Spring Boot / Spring Batch application

丶灬走出姿态 提交于 2019-12-02 01:56:39
问题 I am trying to get Atomikos to work with my Spring Boot/Spring Batch application. Here is are the relevant portions of my code: Datasource config: @Configuration public class DatasourceConfiguration extends AbstractCloudConfig { @Bean @Qualifier("batch_database") public DataSource batchDatasource() { return connectionFactory().dataSource("batch_database"); } @Bean public PlatformTransactionManager transactionManager(){ return new JtaTransactionManager(); } @Bean public TaskConfigurer

Issue with configuring Atomikos on a Spring Boot / Spring Batch application

*爱你&永不变心* 提交于 2019-12-01 20:58:21
I am trying to get Atomikos to work with my Spring Boot/Spring Batch application. Here is are the relevant portions of my code: Datasource config: @Configuration public class DatasourceConfiguration extends AbstractCloudConfig { @Bean @Qualifier("batch_database") public DataSource batchDatasource() { return connectionFactory().dataSource("batch_database"); } @Bean public PlatformTransactionManager transactionManager(){ return new JtaTransactionManager(); } @Bean public TaskConfigurer configurer(){ return new DefaultTaskConfigurer(batchDatasource()); } } Atomikos auto-config dependency: compile

Need to configure my JPA layer to use a TransactionManager (Spring Cloud Task + Batch register a PlatformTransactionManager unexpectedly)

岁酱吖の 提交于 2019-12-01 01:42:30
I am using Spring Cloud Task + Batch in a project. I plan to use different datasources for business data and Spring audit data on the task. So I configured something like: @Bean public TaskConfigurer taskConfigurer() { return new DefaultTaskConfigurer(this.singletonNotExposedSpringDatasource()); } @Bean public BatchConfigurer batchConfigurer() { return new DefaultBatchConfigurer(this.singletonNotExposedSpringDatasource()); } whereas main datasource is autoconfigured through JpaBaseConfiguration . The problem comes when SimpleBatchConfiguration + DefaultBatchConfigurer expose a

Multiple Spring boot CommandLineRunner based on command line argument

ぐ巨炮叔叔 提交于 2019-11-29 21:08:11
问题 I have created spring boot application with spring cloud task which should executes a few commands(tasks). Each task/command is shorted-lived task, and all tasks are start from command line, do some short ETL job and finish execution. There is one spring boot jar which contain all the commands/tasks. Each task is CommandLineRunner, and I like to decide which tasks (one or more) will be executed based on the params from command line. What is the best practice to do so? I don't like to have