Re: s3:// sequence file startup time

2014-08-18 Thread Cheng Lian
art? Is there a way to pipeline >> this with the computation? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/s3-sequence-file-startup-time-tp12242.html >> Sent from the Apache Spark User

Re: s3:// sequence file startup time

2014-08-17 Thread Aaron Davidson
's > communicating with S3, but I don't know what it's doing. Is it just > fetching the metadata from S3 for each part? Is there a way to pipeline > this with the computation? > > > > -- > View this message in context: > http://apache-spark-user-list.100

s3:// sequence file startup time

2014-08-16 Thread kmatzen
to pipeline this with the computation? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/s3-sequence-file-startup-time-tp12242.html Sent from the Apache Spark User List mailing list archive at Nabble.com. ---