Skip to content

A demo illustrating the use of Spring batch for use with AWS batch

Notifications You must be signed in to change notification settings

jmleoni/batch-demo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AWS Batch and spring Batch demo

This small project is a simple Spring batch application that reads a CSV file from AWS S3 and parses it using Open CSV multithreaded parser. It may run on AWS Batch once package as a docker container (see Dockerfile)

With 40 cores and enough RAM it parses 29Millions rows (10Gb of data) in less than 5 minutes.

About

A demo illustrating the use of Spring batch for use with AWS batch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published