Re: S3 Timeouts with lots of Files Using Flink 0.10.2

2016-03-19 Thread Sourigna Phetsarath
gt; fs.s3a.connection.timeout > 5 > Socket connection timeout in milliseconds. > > > > -- Ken > > > -- > > *From:* Sourigna Phetsarath > > *Sent:* March 17, 2016 2:05:39pm PDT > > *To:* user@flink.apache.org > > *Su

S3 Timeouts with lots of Files Using Flink 0.10.2

2016-03-19 Thread Sourigna Phetsarath
All: I'm trying to read lots of files from S3 and I am getting timeouts from S3: java.io.IOException: Error opening the Input Split [0,558574890]: Input opening request timed out. Opener was alive. Stack of split open thread: at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.

Re: S3 Timeouts with lots of Files Using Flink 0.10.2

2016-03-19 Thread Robert Metzger
;> >> ---------- >> >> *From:* Sourigna Phetsarath >> >> *Sent:* March 17, 2016 2:05:39pm PDT >> >> *To:* user@flink.apache.org >> >> *Subject:* S3 Timeouts with lots of Files Using Flink 0.10.2 >> >> All: >

RE: S3 Timeouts with lots of Files Using Flink 0.10.2

2016-03-19 Thread Ken Krugler
DT > To: user@flink.apache.org > Subject: S3 Timeouts with lots of Files Using Flink 0.10.2 > > All: > > I'm trying to read lots of files from S3 and I am getting timeouts from S3: > > java.io.IOException: Error opening the Input Split [0,558574890]: > Input