Monday, 15 June 2015

Spring batch job to process a dynamic set of files parallely -


I am trying to create a job for a spring batch, which I would like to process a dynamic set of files evenly Want to When the batch job has started, then the number of files to be understood is not known - files are dynamically available

I have gone through the Spring Batch project page, and I think It shows that, whenever a new file arrives, the job should be run and the files should continue to be processed. The multi-threaded phase is suitable for my case. But what I am not sure about, can it support the dynamic availability of files to process?

Any input will be highly appreciated thanks and relation,

Here are some options:

  1. - It wraps like motherderer a madrofo as flatfileItemReader and expression Through the resources provided through it.
  2. Partition - This option is better for parallel processing of files. Using MultiResourcePartitioner , you can execute files in parallel with all the restartivity etc., which you usually get with a spring batch.

You can read more about the partition here in the document:


No comments:

Post a Comment