cold vs hot data

2018-09-13 Thread Alaa Zubaidi (PDF)
Hi, We are using Apache Cassandra 3.11.2 on RedHat 7 The data can grow to +100TB however the hot data will be in most cases less than 10TB but we still need to keep the rest of data accessible. Anyone has this problem? What is the best way to make the cluster more efficient? Is there a way to some

Re: cold vs hot data

2018-09-19 Thread Alaa Zubaidi (PDF)
taclustr> > > Read our latest technical blog posts here > <https://www.instaclustr.com/blog/>. > > This email has been sent on behalf of Instaclustr Pty. Limited (Australia) > and Instaclustr Inc (USA). > > This email and any attachments may contain confidential and legally &g

Re: cold vs hot data

2018-09-19 Thread Alaa Zubaidi (PDF)
Let me check lvmcache..Thanks On Thu, Sep 13, 2018 at 11:39 PM, Mateusz wrote: > On piątek, 14 września 2018 02:46:43 CEST Alaa Zubaidi (PDF) wrote: > > The data can grow to +100TB however the hot data will be in most cases > less > > than 10TB but we still need to kee

Re: [EXTERNAL] Re: cold vs hot data

2018-09-19 Thread Alaa Zubaidi (PDF)
> > > -Original Message- > From: Mateusz > Sent: Friday, September 14, 2018 2:40 AM > To: user@cassandra.apache.org > Subject: [EXTERNAL] Re: cold vs hot data > > On piątek, 14 września 2018 02:46:43 CEST Alaa Zubaidi (PDF) wrote: > > The data can grow to +100T

Corrupt SSTABLE over and over

2016-08-11 Thread Alaa Zubaidi (PDF)
Hi, I have a 16 Node cluster, Cassandra 2.2.1 on Windows, local installation (NOT on the cloud) and I am getting Error [CompactionExecutor:2] 2016-08-12 06:51:52, 983 Cassandra Daemon.java:183 - Execption in thread Thread[CompactionExecutor:2,1main] org.apache.cassandra.io.FSReaderError: org.apac

Re: Corrupt SSTABLE over and over

2016-08-12 Thread Alaa Zubaidi (PDF)
] Is it possible Cassandra is trying to compact the same file again while its being compacted by another process? Regards, Alaa On Thu, Aug 11, 2016 at 6:20 PM, Alaa Zubaidi (PDF) wrote: > Hi, > > I have a 16 Node cluster, Cassandra 2.2.1 on Windows, local installation > (NOT on the cl

Re: Corrupt SSTABLE over and over

2016-08-12 Thread Alaa Zubaidi (PDF)
rub, still persist, then offline sstablescrub still > persist, wipe the node and it happen again, then i change the hardware > (disk and mem). things went good. > > hth > > jason > > > On Fri, Aug 12, 2016 at 9:20 AM, Alaa Zubaidi (PDF) > wrote: > > Hi, > &g

Re: Corrupt SSTABLE over and over

2016-08-12 Thread Alaa Zubaidi (PDF)
> host). YMMV but in the past Windows was somewhat of a neglected platform >> wrt Cassandra. I think you'd have a lot easier time getting help if running >> Linux is an option here. >> >> >> >> On Fri, Aug 12, 2016 at 9:16 AM, Alaa Zubaidi (PDF) > &g

Spark partitions from CassandraRDD

2015-09-02 Thread Alaa Zubaidi (PDF)
Hi, I testing Spark and Cassandra, Spark 1.4, Cassandra 2.1.7 cassandra spark connector 1.4, running in standalone mode. I am getting 4000 rows from Cassandra (4mb row), where the row keys are random. .. sc.cassandraTable[RES](keyspace,res_name).where(res_where).cache I am expecting that it

Cassandra 2.2.1 stuck at 100% on Windows

2015-10-15 Thread Alaa Zubaidi (PDF)
Hi, We are running Cassandra 2.2.1 on Windows 2008R2, and we see that multiple Nodes are stuck at 99% CPU bringing the whole VM to a halt. We suspect that there is another process that IT/Windows is causing the CPU issue, but the problem is Cassandra does NOT recover, the CPU utilization start clim

Cassandra 2.2.1 stuck at 100% on Windows

2015-10-15 Thread Alaa Zubaidi (PDF)
Hi, We are running Cassandra 2.2.1 on Windows 2008R2, and we see that multiple Nodes are stuck at 100% CPU bringing the whole VM to a halt. We suspect that there is another process that IT/Windows is causing the CPU issue, but the problem is Cassandra does NOT recover, the CPU utilization start cli

Re: Cassandra 2.2.1 stuck at 100% on Windows

2015-10-16 Thread Alaa Zubaidi (PDF)
Thanks Rob, No OOM in any of the log files, and NO long GC at that time. I attached the last 2 minutes before it hangs until we restart cassandra after hour an half. Regards, Alaa On Thu, Oct 15, 2015 at 6:29 PM, Robert Coli wrote: > On Thu, Oct 15, 2015 at 6:04 PM, Alaa Zubaidi (PDF) >

Re: Cassandra 2.2.1 stuck at 100% on Windows

2015-10-16 Thread Alaa Zubaidi (PDF)
able to at least link up the TID to the hex thread # in the > jstack output to figure out who/what is spinning on there. > > On Fri, Oct 16, 2015 at 1:28 PM, Michael Shuler > wrote: > >> On 10/16/2015 12:02 PM, Alaa Zubaidi (PDF) wrote: >> >>> No OOM in any

Re: Cassandra 2.2.1 stuck at 100% on Windows

2015-10-27 Thread Alaa Zubaidi (PDF)
It was a process installed by IT that triggered this, when disabling the process everything went to normal. Thanks. Alaa On Fri, Oct 16, 2015 at 11:32 AM, Alaa Zubaidi (PDF) wrote: > Thanks guys, > I will look into this more, and put an update here, if I find anything > > On Fri,

Cassandra 2.2.1 on Windows

2015-10-27 Thread Alaa Zubaidi (PDF)
Hi, We have Cassandra 2.2.1 on Windows 2008R2-64-bit. We are noticing that during compaction Cassandra consumes all the available memory for the VM and bring the VM to a crawl. compaction settings are default, and we are using sized tiered compaction. When investigating this, we find through VMMA

Re: Cassandra 2.2.1 on Windows

2015-10-28 Thread Alaa Zubaidi (PDF)
Thanks Rob, We are using 7GB JVM on a 32GB RAM VM Alaa On Wed, Oct 28, 2015 at 11:18 AM, Robert Coli wrote: > On Tue, Oct 27, 2015 at 8:47 PM, Alaa Zubaidi (PDF) > wrote: > >> We have Cassandra 2.2.1 on Windows 2008R2-64-bit. >> >> We are noticing that during compac

Re: Cassandra 2.2.1 on Windows (disk_access_mode: mmap_index_only)

2015-10-30 Thread Alaa Zubaidi (PDF)
. Thanks, On Wed, Oct 28, 2015 at 1:57 PM, Alaa Zubaidi (PDF) wrote: > Thanks Rob, > We are using 7GB JVM on a 32GB RAM VM > Alaa > > On Wed, Oct 28, 2015 at 11:18 AM, Robert Coli > wrote: > >> On Tue, Oct 27, 2015 at 8:47 PM, Alaa Zubaidi (PDF) > > wrote: >>

nodetool -h fails Connection refused

2016-04-19 Thread Alaa Zubaidi (PDF)
Hi, I am trying to run nodetool remotely. but its not working: I am running Cassandra 2.2.5 on CentOS 6. listen_address: is set to rpc_address: is set to 0.0.0.0 broadcast_rpc_address: is set to I changed the following in cassadnra-env.sh JVM_OPTS="$JVM_OPTS -Djava.rmi.server.hostname=" -Dcom.s

Re: nodetool -h fails Connection refused

2016-04-20 Thread Alaa Zubaidi (PDF)
/technotes/guides/management/agent.html > > The default config files for JMX authentication and access included in the > JVM also have extensive details in the comments: > $JAVA_HOME/jre/lib/management/jmxremote.access > $JAVA_HOME/jre/lib/management/jmxremote.password.template >

Bring 2 nodes down

2017-12-14 Thread Alaa Zubaidi (PDF)
Hi, I have a cluster of 8 Nodes, 4 physical machines 2 VMs each physical machine. RF=3, and we have read/write with QUORUM consistency requirement. One of the machines needs to be down for an hour or two to fix local disk. What is the best way to do that with out losing data? Regards -- Alaa --

Migrate from Windows to Linux

2018-01-26 Thread Alaa Zubaidi (PDF)
Hi, What is the best way to migrate my Cassandra 2.x cluster from Windows to Linux? - Can I mix Windows and linux nodes in the same cluster? bring linux node one by one, and shutdown windows nodes one by one? - Can I use multiple racks feature? how would this work? - Other ideas? Regards. Alaa --

Re: Migrate from Windows to Linux

2018-01-27 Thread Alaa Zubaidi (PDF)
; case it might fail. > > C*heers, > --- > Alain Rodriguez - @arodream - al...@thelastpickle.com > France / Spain > > The Last Pickle - Apache Cassandra Consulting > http://www.thelastpickle.com > > > 2018-01-26 20:49 GMT+00:00 Alaa Zubaidi (PDF) :

overhead of empty tables

2018-02-15 Thread Alaa Zubaidi (PDF)
Is there any overhead if my keyspace contains many empty tables? Thanks Alaa -- *This message may contain confidential and privileged information. If it has been sent to you in error, please reply to advise the sender of the error and then immediately permanently delete it and all attachments t

Re: overhead of empty tables

2018-02-15 Thread Alaa Zubaidi (PDF)
tax.com/ > en/cassandra/3.0/cassandra/dml/dmlHowDataWritten.html > > Dinesh > > > On Thursday, February 15, 2018, 3:34:49 PM PST, Alaa Zubaidi (PDF) < > alaa.zuba...@pdf.com> wrote: > > > Is there any overhead if my keyspace contains many empty tables? > Thanks

Cassandra on Window with SCOM running

2015-01-14 Thread Alaa Zubaidi (PDF)
Hi, We are running an Old version of Cassandra 0.7.4 on Windows At one point, the average read times is 2.1 seconds when SCOM (System Center Operation Manager) is running, and 0.04 seconds when its disabled. The problem is we CANNOT disable SCOM on these Windows VMs. Any have seen this before? exp

CQL Data Model question

2015-05-11 Thread Alaa Zubaidi (PDF)
Hi, I am trying to port an Oracle Table to Cassandra. the table is a wide table (931 columns) and could have millions of rows. name, filter1, filter2filter30, data1, data2...data900 The user would retrieve multiple rows from this table and filter (30 filter columns) by one or more (up to 3)

Re: CQL Data Model question

2015-05-14 Thread Alaa Zubaidi (PDF)
f_v1, f_n2, f_v2, f_n3, f_v3) > > ); > > > > And denormalize the data when you import to the table : > > One line in Oracle table with K filters become C(3, K) lines in C* table. > > > > Best regards, > > Minh > > > > *From:* Alaa Zubaidi (P

Cassandra Internal error processing get_slice java.lang.AssertionError

2014-03-05 Thread Alaa Zubaidi (PDF)
Hi, I have a new 8 Node cluster, and when started loading data I see the error below showing up a lot in 3 of the 8 Nodes: ERROR [Thrift:65] 2014-03-05 13:19:42,450 Cassandra.java (line 3041) Internal error processing get_slice java.lang.AssertionError at org.apache.cassandra.db.SliceFromReadComma

Re: Cassandra Internal error processing get_slice java.lang.AssertionError

2014-03-05 Thread Alaa Zubaidi (PDF)
Cassandra 1.0.10 with default settings.. On Wed, Mar 5, 2014 at 4:57 PM, Robert Coli wrote: > On Wed, Mar 5, 2014 at 4:35 PM, Alaa Zubaidi (PDF) > wrote: > >> I have a new 8 Node cluster, and when started loading data I see the >> error below showing up a lot in 3 of the

Re: Cassandra Internal error processing get_slice java.lang.AssertionError

2014-03-06 Thread Alaa Zubaidi (PDF)
r will be more work) > > __ > Sent from iPhone > > On 6 Mar 2014, at 9:22 am, "Alaa Zubaidi (PDF)" > wrote: > > Cassandra 1.0.10 with default settings.. > > > On Wed, Mar 5, 2014 at 4:57 PM, Robert Coli wrote: > >> On

Cassandra Caused by: UnavailableException()

2014-03-17 Thread Alaa Zubaidi (PDF)
Hi, We have an 8 Node 1.0.10 Cassandra cluster with Replication of 3, running on customer location, they all should be in the same DC, but we are NOT 100% sure. We are having problem with the our own Cassandra client, the log file of the client shows many "socket timeout" and "socket closed" errors