spring-batch-job-monitoring

Spring Batch multiple process for heavy load with multiple thread under every process

阅读更多关于 Spring Batch multiple process for heavy load with multiple thread under every process

问题 I have a scenario where I need to have roughly 50-60 different process running concurrently and executing a task. Every process must fetch the data from DB using a sql query by passing a value and fetching data to be run against in the subsequent task. select col_1, col_2, col_3 from table_1 where col_1 = :Process_1; @Bean public Job partitioningJob() throws Exception { return jobBuilderFactory.get("parallelJob") .incrementer(new RunIdIncrementer()) .flow(masterStep()) .end() .build(); }

How do I kickoff a batch job when input file arrives?

阅读更多关于 How do I kickoff a batch job when input file arrives?

来源： https://stackoverflow.com/questions/49986860/how-do-i-kickoff-a-batch-job-when-input-file-arrives

How do I kickoff a batch job when input file arrives?

阅读更多关于 How do I kickoff a batch job when input file arrives?

来源： https://stackoverflow.com/questions/49986860/how-do-i-kickoff-a-batch-job-when-input-file-arrives

Spring-Batch How skip exceptions works for composite writers

阅读更多关于 Spring-Batch How skip exceptions works for composite writers

问题 I am using Spring Batch and my step configuration is as below: @Bean public Step testStep( JdbcCursorItemReader<TestStep> testStageDataReader, TestStepProcessor testStepProcessor, CompositeItemWriter<Writer> testWriter, PlatformTransactionManager transactionManager, JobRepository jobRepository) { return stepBuilderFactory .get("TESTING") .<>chunk(100) .reader(testStageDataReader) .processor(testStepProcessor) .writer(testWriter) .faultTolerant() .skip(DataIntegrityViolationException.class)

Restarting a Spring batch job after app server failure or spring batch repository DB failure?

阅读更多关于 Restarting a Spring batch job after app server failure or spring batch repository DB failure?

问题 When spring batch DB failure happens or server is shut down, a spring batch job which was running at that time will be in a unknown started state. In spring batch admin, we will not see an option to restart the job. Hence we are not able to resume the job. How to restart the job from last successful commit? The old discussions suggest that it had to be dealt manually by updating tables. I was manually able to update end time, status in batch step execution and batch job execution tables. Is

Spring batch: Retry job if does not complete in particular time

阅读更多关于 Spring batch: Retry job if does not complete in particular time

问题 I am working on a Spring batch application where I have used RetryTemplate with SimpleRetryPolicy . In this application, ItemProcessor usually takes 30-35 mins to complete a particular task. But sometimes, it takes from than 2hrs to complete that same task. Is there a way to retry my ItemProcessor , if the assigned task is not completed within given time period? I am looking for some Java/Spring in-build functionality instead of writing my own timeout logic. 回答1: You can define transactional

Spring batch: Retry job if does not complete in particular time

阅读更多关于 Spring batch: Retry job if does not complete in particular time

I am working on a Spring batch application where I have used RetryTemplate with SimpleRetryPolicy . In this application, ItemProcessor usually takes 30-35 mins to complete a particular task. But sometimes, it takes from than 2hrs to complete that same task. Is there a way to retry my ItemProcessor , if the assigned task is not completed within given time period? I am looking for some Java/Spring in-build functionality instead of writing my own timeout logic. You can define transactional-attributes to a given step. ( https://docs.spring.io/spring-batch/trunk/reference/htmlsingle/