Hi,
I found the answer to my problem, and just writing to keep it as KB.
Turns out the problem wasn’t related to S3 performance, it was due my SOURCE
was not fast enough, due the lazy nature of Spark what I saw on the dashboard
was saveAsTextFile at FacebookProcessor.scala:46 instead of the load
Hi,
I’m trying to save about a million of lines containing statistics data,
something like:
233815212529_10152316612422530 233815212529_10152316612422530 1328569332
1404691200 1404691200 1402316275 46 0 0 7
0 0 0
233815212529_101523166124
