Re: Hadoop + Yarn / DataStax driver issues

2015-11-23 Thread Cyril Scetbon
Similar tests with Spark and cassandra connector (which uses the native driver too) work well ... I was wondering if Yarn was restricting the network access but even executing spark (using spark-shell) with --master yarn-client or --master yarn-server worked without any issue. You could also see

Re: Upgrade instructions don't make sense

2015-11-23 Thread Sebastian Estevez
We are happy to clarify the docs. I'm ccing docs@datastax. Thanks! all the best, Sebastián On Nov 23, 2015 6:48 PM, "Jacob Hathaway" wrote: > Actually Sebastian, saying one, does not always imply the other. And when > it says this: > > In Cassandra 2.0.x, virtual nodes (vnodes) are enabled by

Re: Hadoop + Yarn / DataStax driver issues

2015-11-23 Thread Patrick McFadin
That's a pretty basic error from the driver. I would look at the target node and make sure that the IP/port combination is actually bound and free of any firewall shenanigans. Patrick On Mon, Nov 23, 2015 at 4:00 PM, Cyril Scetbon wrote: > Let me also add that I use Cassandra 2.1.11 with Hadoop

Re: Hadoop + Yarn / DataStax driver issues

2015-11-23 Thread Cyril Scetbon
Let me also add that I use Cassandra 2.1.11 with Hadoop 2.7.1 (HDP 2.3.2). > Trying to execute an Hadoop job on Yarn, I got errors from Cassandra's > internal code. It seems that connections are closed but I can't understand > why ... > > Here is a subtract of the errors : > > 15/11/22 20:05:5

Hadoop + Yarn / DataStax driver issues

2015-11-23 Thread Cyril Scetbon
Hi, Trying to execute an Hadoop job on Yarn, I got errors from Cassandra's internal code. It seems that connections are closed but I can't understand why ... Here is a subtract of the errors : 15/11/22 20:05:54 [main]: DEBUG core.RequestHandler: Error querying node006.internal.net/192.168.12.2

Re: Upgrade instructions don't make sense

2015-11-23 Thread Robert Wille
I guess I need to learn to read. Yes, I’m using vnodes, and yes, the instructions say to disable them if you aren’t using them, not if you are. Sorry about cluttering up the mailing list. Rboert On Nov 23, 2015, at 4:22 PM, Sebastian Estevez mailto:sebastian.este...@datastax.com>> wrote: If y

Re: Upgrade instructions don't make sense

2015-11-23 Thread Jacob Hathaway
Actually Sebastian, saying one, does not always imply the other. And when it says this: In Cassandra 2.0.x, virtual nodes (vnodes) are enabled by default. Disable vnodes in the 2.0.x version before upgrading. That implies to me to disable vnodes no matter what. How do we get the docs fixed? I

Re: Upgrade instructions don't make sense

2015-11-23 Thread Vasileios Vlachos
Exactly, thanks! On 23 Nov 2015 11:26 pm, "Vasileios Vlachos" wrote: > If you want to go from 2.0 to 2.1 and you are NOT using vnodes on your > current cluster (that is version 2.0), then make sure you disable them on > the new 2.1 config during the upgrade. Otherwise just leave the setting as >

Re: Upgrade instructions don't make sense

2015-11-23 Thread Vasileios Vlachos
If you want to go from 2.0 to 2.1 and you are NOT using vnodes on your current cluster (that is version 2.0), then make sure you disable them on the new 2.1 config during the upgrade. Otherwise just leave the setting as is. That's how I understand it personally. We are going to upgrade at some po

Re: Upgrade instructions don't make sense

2015-11-23 Thread Paulo Motta
This actually means if you *DON'T* use vnodes, you should be careful to set num_tokens in the cassandra.yaml when upgrading, since the default cassandra.yaml is to have vnodes enabled. You should ignore these instructions if you already have a vnodes-enabled cluster, and set num_tokens accordingly.

Re: Upgrade instructions don't make sense

2015-11-23 Thread Sebastian Estevez
> > If your cluster does not use vnodes, disable vnodes in each new > cassandra.yaml If your cluster *does* use vnodes do *not* disable them. All the best, [image: datastax_logo.png] Sebastián Estévez Solutions Architect | 954 905 8615 | sebastian.este...@datastax.

Re: Upgrade instructions don't make sense

2015-11-23 Thread Prem Yadav
*If your cluster does not use vnodes* Are you using vnodes now? On Mon, Nov 23, 2015 at 10:55 PM, Robert Wille wrote: > I’m wanting to upgrade from 2.0 to 2.1. The upgrade instructions at > http://docs.datastax.com/en/upgrade/doc/upgrade/cassandra/upgradeCassandraDetails.html > has > the follo

Upgrade instructions don't make sense

2015-11-23 Thread Robert Wille
I’m wanting to upgrade from 2.0 to 2.1. The upgrade instructions at http://docs.datastax.com/en/upgrade/doc/upgrade/cassandra/upgradeCassandraDetails.html has the following, which leaves me with more questions than it answers: If your cluster does not use vnodes, disable vnodes in each new cassa

Re: Getting code=2200 [Invalid query] message=Invalid column name ... while executing ALTER statement

2015-11-23 Thread Adam Holmberg
Michael, Thanks for pointing that out. It is a driver issue affecting CQL export (but not the execution API). I created a ticket to track and resolve: https://datastax-oss.atlassian.net/browse/PYTHON-447 Adam On Sat, Nov 21, 2015 at 8:38 AM, Laing, Michael wrote: > Quickly reviewing this spec

Re: Triggering Deletion/Updation

2015-11-23 Thread Harikrishnan A
Thanks Jon , Prem .. Regards,Hari From: Jon Haddad To: user@cassandra.apache.org Cc: Harikrishnan A Sent: Sunday, November 22, 2015 10:57 AM Subject: Re: Triggering Deletion/Updation There's no built in way of doing cascading deletes in Cassandra, I really wouldn't recommend using t

Re: Cassandra 3.0.0 connection problem

2015-11-23 Thread Enrico Sola
Thanks for informations, I’m happy to hear that an update is under working, seeing only one version which it’s only partially compatible with 2.1 I feared that the PHP driver project was abandoned. Enrico > Il giorno 20 nov 2015, alle ore 20:05, Alex Popescu ha > scritto: > > Hi Enrico, >

Re: Repair Hangs while requesting Merkle Trees

2015-11-23 Thread Paulo Motta
The issue might be related to the ESTABLISHED connections just in one end. I don't think it might be related to inter_dc_tcp_nodelay or request_timeout_in_ms options. Did you restart the process when you changed the request_timeout_in_ms option? This might be why the problem got fixed and not the o

Re: No query results while expecting results

2015-11-23 Thread Carlos Alonso
Did you tried to observe it using cassandra-cli? (the thrift client) It shows the 'disk-layout' of the data and may help as well. Otherwise, if you can reproduce it having a varint as the last part of the partition key (or at any other location), this may well be a bug. Carlos Alonso | Software E

Re: No query results while expecting results

2015-11-23 Thread Ramon Rockx
Hello Carlos, On Mon, Nov 23, 2015 at 3:31 PM, Carlos Alonso wrote: > Well, this makes me wonder how varints are compared in java vs python > because the problem may be there. > > I'd suggest getting the token, to know which server contains the missing > data. Go there and convert sstables to js

Re: Hints timed out

2015-11-23 Thread Carlos Alonso
Are both nodes using the same Cassandra version? Carlos Alonso | Software Engineer | @calonso On 20 November 2015 at 23:00, Arun Sandu wrote: > Hi, > > 1. What would be the reason for hints getting timed out? None of the nodes > went down. using the storage_port as

Re: Repair Hangs while requesting Merkle Trees

2015-11-23 Thread Anuj Wadehra
Any comments on ESTABLISHED connections at one end? Moreover, inter_dc_tcp_nodelay is false. Can this be the reason that latency between two DC is more and repair messages are getting dropped? Can increasing request_timeout_in_ms deal with the latency issue.. I see some hinted handoffs being

Re: UUID question

2015-11-23 Thread Dongfeng Lu
If you can construct unique primary keys from the data you have, I'd suggest you create your own custom primary keys instead of using UUIDs. It will be easier for you to retrieve the records. If you use UUIDs as your primary keys for a table, you need to have some kind of index so that you can

Re: UUID question

2015-11-23 Thread Jack Krupansky
The point is to have a unique, generated ID for each entity, to ensure absolute uniqueness. In the old days each app had its own technique for generating unique IDs. Now we have UUIDs, which are unique, but are generated uniformly across systems and applications. Uniqueness is guaranteed even if an

Re: UUID question

2015-11-23 Thread Prem Yadav
OK. My question is more about what are the use case of any table uuid as partition key. Will appreciate inputs from others. Thanks, Prem On Mon, Nov 23, 2015 at 4:25 PM, Jay Reddy wrote: > Hi Prem, > > We have two tables, one with email id as partition key and other with > userid(uuid). > Pleas

Re: UUID question

2015-11-23 Thread Jay Reddy
Hi Prem, We have two tables, one with email id as partition key and other with userid(uuid). Please refer to www.killrvideo.com website. It is a great place to understand how a web application is built on Cassandra. Thanks, Jay On Mon, Nov 23, 2015 at 11:18 AM, Prem Yadav wrote: > Thanks Jay.

Re: UUID question

2015-11-23 Thread Prem Yadav
Thanks Jay. Now this is great while creating the user. How does the user change the details? let's say email id or password? How do you lookup the user table? On Mon, Nov 23, 2015 at 4:14 PM, Jay Reddy wrote: > Here is one use case .. > > We are designing a web application using Cassandra. > W

Re: UUID question

2015-11-23 Thread Jay Reddy
Here is one use case .. We are designing a web application using Cassandra. When a user signs on we create user info in user table with userid (uuid) is primary and is responded back to UI. UI uses this UUID for any future communications. UI can also get user id when searched for an user detail

UUID question

2015-11-23 Thread Prem Yadav
Hi, I am trying to understand different use cases related to using UUID as the partition key. I am sure I am missing something trivial and will be grateful and you can help me understand this. When do you use the UUID as the primary key? What can be a use case? Since it is unique, how do you quer

Re: No query results while expecting results

2015-11-23 Thread Prem Yadav
Agree with Carlos. It might be the cql shell doing tricks. Please check the json. On Mon, Nov 23, 2015 at 2:31 PM, Carlos Alonso wrote: > Well, this makes me wonder how varints are compared in java vs python > because the problem may be there. > > I'd suggest getting the token, to know which ser

Re: No query results while expecting results

2015-11-23 Thread Carlos Alonso
Well, this makes me wonder how varints are compared in java vs python because the problem may be there. I'd suggest getting the token, to know which server contains the missing data. Go there and convert sstables to json, find the record and see what's there as the tnt_id. You could also use the t

Re: No query results while expecting results

2015-11-23 Thread Ramon Rockx
Hello Prem, On Mon, Nov 23, 2015 at 2:36 PM, Prem Yadav wrote: > Can you run the trace again for the query "select * " without any > conditions and see if you are getting results for tnt_id=5? > Of course, here are the results, with trace: cqlsh> tracing on Now traci

Re: No query results while expecting results

2015-11-23 Thread Prem Yadav
Can you run the trace again for the query "select * " without any conditions and see if you are getting results for tnt_id=5? On Mon, Nov 23, 2015 at 1:23 PM, Ramon Rockx wrote: > Hello Oded and Carlos, > > Many thanks for your tips. I modified the consistency level in cqlsh, but > with no suc

Re: No query results while expecting results

2015-11-23 Thread Ramon Rockx
Hello Oded and Carlos, Many thanks for your tips. I modified the consistency level in cqlsh, but with no success: cqlsh> consistency ALL Consistency level set to ALL. cqlsh> select * from mls.te where period=62013120356 and tnt_id=5; Tracing session: ef0e6590-91e3-11e5-8c24-6783eab735d4 activi

Re: Help diagnosing performance issue

2015-11-23 Thread Antoine Bonavita
Sebastian, I tried to ramp up volume with this new setting and ran into the same problems. After that I restarted my nodes. This pretty much instantly got read latencies back to normal (< 5ms) on the 32G nodes. I am currently ramping up volumes again and here is what I am seeing on 32G nod

Re: No query results while expecting results

2015-11-23 Thread Carlos Alonso
Ok, so by default the CONSISTENCY LEVEL of CQLSH is ONE. Therefore it could be that the node you're connected to doesn't actually contain any of this data. Try improving the CL for that read and see what happens. Regards. Carlos Alonso | Software Engineer | @calonso

RE: No query results while expecting results

2015-11-23 Thread Peer, Oded
It might be a consistency issue. Assume your data for tnt 5 should be on nodes 1 and 2, but actually never got to node 1 for various reasons, and the hint wasn’t replayed for some reason and you didn’t run repairs. The data for tnt 5 is only on node 2. A query without restrictions on the partitio

No query results while expecting results

2015-11-23 Thread Ramon Rockx
Hello, On our Cassandra 1.2.15 test cluster I'm stuck with querying data on one of our Cassandra tables. This is the table: cqlsh> describe table mls.te; CREATE TABLE te ( period bigint, tnt_id varint, evt_id timeuuid, evt_type varint, data text, PRIMARY KEY ((period, tnt_id), evt_i

Re: Timeout with static column

2015-11-23 Thread Brice Figureau
On Fri, 2015-11-13 at 11:25 +0100, Brice Figureau wrote: > On Thu, 2015-11-12 at 11:13 -0600, Tyler Hobbs wrote: > > Can you try to isolate this to a reproducible test case or script and > > open a jira ticket at https://issues.apache.org/jira/browse/CASSANDRA? > > I just created: > https://issues