Hi to all, I have a use case where I have to read a huge csv containing ids to fetch from a table in a db. The jdbc input format can handle parameterized queries so I was thinking to fetch data using 1000 id at a time. What is the easiest whay to divide a dataset by slices of 1000 ids each (in order to create parameters for my JDBC Input format)? Is that possible? Or maybe there's an easiest solutions using streaming APIs?
Best, Flavio