User in dev env with 4 node cluster , 50k records with inserts of 70k characters (json in text) This will happen daily in some intervals not yet defined on a single table. Its within 1 data center
On Wednesday, August 15, 2018, Durity, Sean R <sean_r_dur...@homedepot.com> wrote: > Might also help to know: > > Size of cluster > > How much data is being loaded (# of inserts/actual data size) > > Single table or multiple tables? > > Is this a one-time or occasional load or more frequently? > > Is the data located in the same physical data center as the cluster? (any > network latency?) > > > > On the client side, prepared statements and ExecuteAsync can really speed > things up. > > > > > > Sean Durity > > > > *From:* Elliott Sims <elli...@backblaze.com> > *Sent:* Wednesday, August 15, 2018 1:13 PM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] Re: Improve data load performance > > > > Step one is always to measure your bottlenecks. Are you spending a lot of > time compacting? Garbage collecting? Are you saturating CPU? Or just a > few cores? Or I/O? Are repairs using all your I/O? Are you just running > out of write threads? > > > > On Wed, Aug 15, 2018 at 5:48 AM, Abdul Patel <abd786...@gmail.com> wrote: > > Application team is trying to load data with leveled compaction and its > taking 1hr to load , what are best options to load data faster ? > > > > On Tuesday, August 14, 2018, @Nandan@ <nandanpriyadarshi...@gmail.com> > wrote: > > Bro, Please explain your question as much as possible. > This is not a single line Q&A session where we will able to understand > your in-depth queries in a single line. > For better and suitable reply, Please ask a question and elaborate what > steps you took for your question and what issue are you getting and all.. > > I hope I am making it clear. Don't take it personally. > > > > Thanks > > > > On Wed, Aug 15, 2018 at 8:25 AM Abdul Patel <abd786...@gmail.com> wrote: > > How can we improve data load performance? > > > > ------------------------------ > > The information in this Internet Email is confidential and may be legally > privileged. It is intended solely for the addressee. Access to this Email > by anyone else is unauthorized. If you are not the intended recipient, any > disclosure, copying, distribution or any action taken or omitted to be > taken in reliance on it, is prohibited and may be unlawful. When addressed > to our clients any opinions or advice contained in this Email are subject > to the terms and conditions expressed in any applicable governing The Home > Depot terms of business or client engagement letter. The Home Depot > disclaims all responsibility and liability for the accuracy and content of > this attachment and for any damages or losses arising from any > inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other > items of a destructive nature, which may be contained in this attachment > and shall not be liable for direct, indirect, consequential or special > damages in connection with this e-mail message or its attachment. >
