Re: Ingesting Large Number of files

2015-11-17 Thread areddyraja
This is about 5gb one time. Network speed lets us say 200mb/sec Let us say you have 10 node cluster. Choose your partition key such a way that, it can write on all nodes. That means about 0.5gb per node. With 200 mb/sec network speed, 500 mb takes 500*8/200 would give 20 secs total time for

Re: Hotspots on Time Series based Model

2015-11-17 Thread areddyraja
13mb seems to very fine in our exp. we have keys that could take more than 100 mb Sent from my iPhone > On 17-Nov-2015, at 7:47 PM, Yuri Shkuro wrote: > > You can also subdivide hourly partition further by adding an artificial > "bucket" field to the partition key, which you populate with a