8,574 questions
2
votes
0
answers
80
views
Parallel Spring Batch jobs mixing up data
I am trying to run a separate instance of a Spring Batch job for every file, up to 20 at a time. For some reason, the job is being launched with the same parameters multiple times (same filename + ...
- 2,300
0
votes
0
answers
25
views
Getting issues writing test to run End-to-End job flow using JobOperatorTestUtils after Spring Batch 6.0.2 migration
I have recently upgraded my test app to Spring Boot 4.0.2 (transitively upgraded my batch version to 6.0.2). Since the JobLauncherTestUtils is deprecated since 6.0 version, I'm trying to use the ...
Best practices
0
votes
0
replies
112
views
How to automatically detect and map multiple CSV formats into a single entity without unnecessary Java code?
I am building a Spring Boot 4.0.1 application using Spring Batch 6.0.1 to ingest bank transactions from multiple CSV sources (specifically N26 and Revolut).
The Problem
The files are all dropped into ...
- 53
-3
votes
1
answer
129
views
Spring Batch metadata tables are not automatically created in Spring Boot 4
I am trying to set up a Spring Batch project using Spring Boot 4.0.0
The application starts successfully, but the standard Spring Batch meta-data tables (e.g., BATCH_JOB_INSTANCE, BATCH_JOB_EXECUTION, ...
- 81
Best practices
0
votes
2
replies
56
views
Should we use GCP Cloud Run (not Cloud Run Jobs) for Java Spring Batch?
Currently, I have a Java Spring Batch source code that contains multiple batch jobs, with their execution schedules configured directly in the code. The application is currently running on a Windows ...
1
vote
2
answers
140
views
Spring Boot Batch 6.x: Job Parameters are null in Reader despite using @StepScope
I'm trying to pass job parameters from a REST controller to a batch job reader in Spring Boot Batch 6.x, but the parameters are always null in the reader. I'm using @StepScope and SpEL expressions as ...
Best practices
0
votes
2
replies
53
views
What is the most efficient way to validate file data against Couchbase documents using Spring Batch— N1QL timestamp range, KV lookups, or USE KEYS?
I have a validation use-case where an input file contains a list of records that were updated at a certain timestamp. I need to verify that the data in the file matches the data stored in Couchbase.
...
Best practices
0
votes
1
replies
98
views
Hibernate 5: Use @Transactional or manual Transaction with StatelessSession for batch inserts?
I’m migrating batch insert code from Hibernate 4 to Hibernate 5.1 and want to confirm the correct transactional pattern for StatelessSession.
Legacy code (Hibernate 4):
@Transactional
public void ...
- 67
Best practices
0
votes
0
replies
74
views
HikariCP: connection-timeout and maximum-pool-size with long running queries
I am using a Postgres database. I have configured it to support multi-tenancy with a different schema for each tenant.
Overnight, my Spring Boot application runs several processes in parallel (around ...
- 112
Best practices
0
votes
2
replies
48
views
Group and process unordered records in a CSV file with Spring Batch
A CSV file needs to be processed using Spring Batch where multiple rows could be grouped based on a field value. In the below sample, two lines in the CSV have the same GROUP_NAME with the value ...
- 43
0
votes
0
answers
71
views
"DefaultJpaDialect does not support custom isolation levels" when upgrading to spring batch 5
I am upgrading an app to newest Spring Boot 3, and because of that Spring Batch is upgraded to 5.2.3 (from 4.3.10).
The application did not persist batch states previously, it was using the "map ...
- 1,839
1
vote
1
answer
65
views
MultiResourceItemWriter does not work with transactional StaxEventItemWriter
I configured a StaxEventItemWriter like this:
@Bean
public StaxEventItemWriter<Foo> fooWriter() {
return new StaxEventItemWriterBuilder<Foo>()
.name("fooWriter")
...
- 45.3k
0
votes
0
answers
79
views
Partitioned batch intermittently delays In Message Processing
We run through a series of Spring Batch jobs, some normal some partitioned around a cluster. (still on Spring Batch 4.3.10). After a while (sometimes takes a couple of runs) we observe delays in the ...
- 659
0
votes
1
answer
78
views
Spring Batch write multiple chunks at once/ aggregate writing of chunks after reaching threshold
I am using Spring Batch for the first time.
Currently, my setup is as follows:
one Kafka reader, one item processor, one JDBC writer (custom one)
the Kafka reader reads items from Kafka
chunk size is ...
- 868
0
votes
1
answer
101
views
Spring Batch Remote Partitioning: Worker replies reach channel but manager never receives them
I'm implementing Spring Batch remote partitioning with Spring Integration and Kafka as a middleware. Worker replies successfully arrive at the managerInboundReplies channel (confirmed via interceptor ...
