What exactly is the error? Is it erroring out while reading the data from db? How are you partitioning the data?
How much memory currently do you have? What is the network time out? Regards, Meena On Mon, May 27, 2024 at 4:22 PM Perez <flinkbyhe...@gmail.com> wrote: > Hi Team, > > I want to extract the data from DB and just dump it into S3. I > don't have to perform any transformations on the data yet. My data size > would be ~100 GB (historical load). > > Choosing the right DPUs(Glue jobs) should solve this problem right? Or > should I move to EMR. > > I don't feel the need to move to EMR but wanted the expertise suggestions. > > TIA. >
