Re: Security labels

2016-02-11 Thread oleg yusim
Jack, I asked my management, if I can share with community my assessment spreadsheet (whole thing, with gaps and desired configurations). Let's wait for their answer. I would definitely update the document I shared with the rest of gaps, so you, guys, would have it for sure. Now, in case if my ma

Re: Guava version check in 3.0

2016-02-11 Thread Andrew Jorgensen
To answer my own question I was able to shade the dependencies in my jar which fixed the issue and allow the job to run on Hadoop org.apache.maven.plugins maven-shade-plugin

Re: Session timeout

2016-02-11 Thread oleg yusim
Jack, This document doesn't cover all the areas where user will need to get engaged in explicit mitigation, it only covers those, I wasn't sure about. But - you are making a good point here. Let me update the document with the rest of the gaps, so community would have a complete list here. Thanks

Re: Rows with same key

2016-02-11 Thread Jack Krupansky
(Note to self... check docs to see if they give this troubleshooting tip. I didn't see it at first glance.) -- Jack Krupansky On Thu, Feb 11, 2016 at 2:45 PM, Kai Wang wrote: > Are you supplying timestamps from the client side? Are clocks in sync > cross your nodes? > > > On Thu, Feb 11, 2016 a

Re: Session timeout

2016-02-11 Thread Jack Krupansky
Thanks! A useful contribution, no matter what the outcome. I trust your ability to read of the doc, so I don't expect a lot of change to the responses, but we'll see. At a minimum, it will probably be good to have doc to highlight areas where users will need to engage in explicit mitigation efforts

Re: Security labels

2016-02-11 Thread Jack Krupansky
Thanks for putting the items together in a list. This allows people to see things with more context. Give people in the user community a little time to respond. A week, maybe. Hopefully some of the senior Cassandra committers will take a look as well. Will the final assessment become a public docu

Re: Security labels

2016-02-11 Thread oleg yusim
Thanks Dani. Oleg On Thu, Feb 11, 2016 at 2:27 PM, Dani Traphagen wrote: > Hi Oleg, > > I'm happy to take a look. Will update after review. > > Thanks, > Dani > > On Thu, Feb 11, 2016 at 12:23 PM, oleg yusim wrote: > >> Hi Dani, >> >> As promised, I sort of put all my questions under the "one

Guava version check in 3.0

2016-02-11 Thread Andrew Jorgensen
Hello, I am trying to get a cassandra v3.0 cluster up and running with the v3.0.0 of the datastax client. I am hitting a number of cases where I am running into the following exception: java.lang.IllegalStateException: Detected Guava issue #1635 which indicates that a version of Guava less than 1

Security assessment of Cassandra

2016-02-11 Thread oleg yusim
Greetings, Performing security assessment of Cassandra with the goal of generating STIG for Cassandra (iase.disa.mil/stigs/Pages/a-z.aspx) I ran across some questions regarding the way certain security features are implemented (or not) in Cassandra. I composed the list of questions on these topic

Re: Security labels

2016-02-11 Thread Dani Traphagen
Hi Oleg, I'm happy to take a look. Will update after review. Thanks, Dani On Thu, Feb 11, 2016 at 12:23 PM, oleg yusim wrote: > Hi Dani, > > As promised, I sort of put all my questions under the "one roof". I would > really appreciate you opinion on them. > > https://drive.google.com/open?id=0

Re: Security labels

2016-02-11 Thread oleg yusim
Hi Dani, As promised, I sort of put all my questions under the "one roof". I would really appreciate you opinion on them. https://drive.google.com/open?id=0B2L9nW4Cyj41YWd1UkI4ZXVPYmM Thanks, Oleg On Fri, Jan 29, 2016 at 3:28 PM, Dani Traphagen wrote: > ​Hi Oleg, > > Thanks that helped clear

Re: Session timeout

2016-02-11 Thread oleg yusim
Robert, Jack, Bryan, As you suggested, I put together document, titled Cassandra_Security_Topics_to_Discuss, put it on Google Drive and shared it with everybody on this list. The document contains list of questions I have on Cassandra, my take on it, and has a place for notes Community would like

Re: Rows with same key

2016-02-11 Thread Kai Wang
Are you supplying timestamps from the client side? Are clocks in sync cross your nodes? On Thu, Feb 11, 2016 at 11:52 AM, Yulian Oifa wrote: > Hello to all > I have multiple rows with same id on one of cfs, one row is completely > empty ,another one has vaues. > Values are wrotten into new row

Re: Increase compaction performance

2016-02-11 Thread Michał Łowicki
On Thu, Feb 11, 2016 at 5:38 PM, Alain RODRIGUEZ wrote: > Also, are you using incremental repairs (not sure about the available > options in Spotify Reaper) what command did you run ? > > No. > 2016-02-11 17:33 GMT+01:00 Alain RODRIGUEZ : > >> CPU load is fine, SSD disks below 30% utilization,

ApacheCon NA 2016 - Important Dates!!!

2016-02-11 Thread Melissa Warnkin
Hello everyone! I hope this email finds you well.  I hope everyone is as excited about ApacheCon as I am! I'd like to remind you all of a couple of important dates, as well as ask for your assistance in spreading the word! Please use your social media platform(s) to get the word out! The more v

Re: OpsCenter 5.2

2016-02-11 Thread Ted Yu
The installation partially failed. Please let me know how I can resume the installation or, the error below can be ignored. I verified on the Linux host that setuptools-0.6c11-py2.7.egg can be downloaded. Python 2.7.11 (default, Jan 5 2016, 11:21:51) -- python ez_setup.py Downloading h

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
> > On restart of one node 1 could see repeated errors like " Mutation of > 22076203 bytes is too large for the maxiumum size of 16777216" Commitlog segment size is the right lever to get C* to accept larger writes but this is not a traditional use for cassandra. Cassandra is built to handle lots

Re: OpsCenter 5.2

2016-02-11 Thread Sebastian Estevez
Confirmed. all the best, Sebastián On Feb 11, 2016 12:44 PM, "Ted Yu" wrote: > Thanks for the pointer. > > Just want to confirm that OpsCenter 5.2 is compatible with DSE 4.8.4 which > I have deployed. > > Cheers > > On Thu, Feb 11, 2016 at 7:00 AM, Sebastian Estevez < > sebastian.este...@datast

OpsCenter 5.2

2016-02-11 Thread Ted Yu
Thanks for the pointer. Just want to confirm that OpsCenter 5.2 is compatible with DSE 4.8.4 which I have deployed. Cheers On Thu, Feb 11, 2016 at 7:00 AM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > The monitoring UI is called DataStax OpsCenter and it has its own install > pr

Rows with same key

2016-02-11 Thread Yulian Oifa
Hello to all I have multiple rows with same id on one of cfs, one row is completely empty ,another one has vaues. Values are wrotten into new row , however they are retreived from old row... I guess one row is created due to removed values, and stucked somehow. I am trying to remove it with no luck

Re: Increase compaction performance

2016-02-11 Thread Alain RODRIGUEZ
Also, are you using incremental repairs (not sure about the available options in Spotify Reaper) what command did you run ? 2016-02-11 17:33 GMT+01:00 Alain RODRIGUEZ : > CPU load is fine, SSD disks below 30% utilization, no long GC pauses > > > > What is your current compaction throughput ? The

Re: Increase compaction performance

2016-02-11 Thread Alain RODRIGUEZ
> > CPU load is fine, SSD disks below 30% utilization, no long GC pauses What is your current compaction throughput ? The current value of 'concurrent_compactors' (cassandra.yaml or through JMX) ? nodetool getcompactionthroughput How to speed up compaction? Increased compaction throughput and

Re: Cassandra Collections performance issue

2016-02-11 Thread Jack Krupansky
Just to help other users reading along here, what is your access pattern with maps? I mean, do you typically have a large or small number of keys set, are you typically mostly adding keys or deleting keys a lot, adding one at a time or adding and deleting a lot in a single request, or... what? And

Increase compaction performance

2016-02-11 Thread Michał Łowicki
Hi, Using 2.1.12 across 3 DCs. Each DC has 8 nodes. Trying to run repair using Cassandra Reaper but nodes after couple of hours are full of pending compaction tasks (regular not the ones about validation) CPU load is fine, SSD disks below 30% utilization, no long GC pauses. How to speed up compa

Re: Cassandra Collections performance issue

2016-02-11 Thread Clint Martin
I have experienced excessive performance issues while using collections as well. Mostly my issue was due to the excessive number of cells per partition that having a modest map size requires. Since you are reading and writing the entire map, you can probably gain some performance the same way I di

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks a ton Sebastian. On restart of one node 1 could see repeated errors like " Mutation of 22076203 bytes is too large for the maxiumum size of 16777216" So I increased commitlog_segment_size_in_mb from 32 to 64mb. Followed by a rolling restart again. And now there is a single version and

Re: stefania.alborghe...@datastax.com

2016-02-11 Thread Sebastian Estevez
The monitoring UI is called DataStax OpsCenter and it has its own install process. Check out our documentation on the subject: http://docs.datastax.com/en/opscenter/5.2/opsc/install/opscInstallOpsc_g.html all the best, Sebastián On Feb 9, 2016 8:01 PM, "Ted Yu" wrote: > Hi, > I am using DSE 4

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
If its a tarball then root should be fine but there were some files owned by the Cassandra user so you may want to chown those back to root. I haven't seen your exact issue before but you have two schema versions from your describe cluster so a rolling restart should help. all the best, Sebastiá

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Ryan Svihla
Kedar, I recommend asking the user list user@cassandra.apache.org this list is for the development of cassandra and you're more likely to find someone on the user list who may have hit this issue. Curious issue though I haven't seen that myself. Regards, Ryan Svihla > On Feb 11, 2016, at 7:56

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks Sebastian, Cassandra installation in our case is simply an untar. Cassandra is started using supervisord and user as root, would you still recommend I try using Cassandra user. ./nodetool describecluster Cluster Information: Name: Test Cluster Snitch: org.apache.cassandra.loca

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Sebastian Estevez
Keep this on. The user list, it's not appropriate for the dev list. 1) I noticed that some of your files are owned by root and others by Cassandra. If this is a package install you should always start C* as a service and chown your files and directories so they are owned by the Cassandra user, not

Re: reducing disk space consumption

2016-02-11 Thread Ted Yu
Thanks, Mohammed and Romain. On Thu, Feb 11, 2016 at 12:54 AM, Romain Hardouin wrote: > As Mohammed said "nodetool clearsnaphost" will do the trick. > Cassandra takes a snapshot by default before keyspace/table dropping or > truncation. > You can disable this feature if it's a dev node (see auto

Re: 3k sstables during a repair incremental !!

2016-02-11 Thread Jean Carlo
Hi ! @Paulo . Yes we are using vnodes, 256 per node and we have 6 nodes in the cluster. RF=3. The data is inserted using jmeter with consistency=LOCAL_ONE. Because this is a test, we generate our data and we insert them using jmeter. After the repair finished, all the nodes seems to be freezed, n

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks, kindly refer the following: https://gist.github.com/anonymous/3dddbe728a52c07d7c52 https://gist.github.com/anonymous/302ade0875dd6410087b Thanks, Kedar Parikh Ext : 2224 Dir : +91 22 61782224 Mob : +91 9819634734 Email : kedar.par...@netcore.co.in Web : www.netcore.co.in On Thursday 1

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Romain Hardouin
Would you mind pasting the ouput for both nodes in gist/paste/whatever? https://gist.github.com http://paste.debian.net Le Jeudi 11 février 2016 11h57, kedar a écrit : Thanks for the reply. ls -l cassandra/data/* lists various *.db files This problem is on both nodes. Thanks, Kedar Parikh

Re: Keyspaces not found in cqlsh

2016-02-11 Thread kedar
Thanks for the reply. ls -l cassandra/data/* lists various *.db files This problem is on both nodes. Thanks, Kedar Parikh Ext : 2224 Dir : +91 22 61782224 Mob : +91 9819634734 Email : kedar.par...@netcore.co.in Web : www.netcore.co.in On Thursday 11 February 2016 03:57 PM, Romain Hardouin wro

Re: Keyspaces not found in cqlsh

2016-02-11 Thread Romain Hardouin
What is the output on both nodes of the following command? ls -l /var/lib/cassandra/data/system/* If one node seems odd you can try "nodetool resetlocalschema" but the other node must be in clean state. Best, Romain Le Jeudi 11 février 2016 11h10, kedar a écrit : I am using cqlsh 5.0.1 | Cas

Keyspaces not found in cqlsh

2016-02-11 Thread kedar
I am using cqlsh 5.0.1 | Cassandra 2.1.2, recently we are unable to see / desc keyspaces and query tables through cqlsh on either of the two nodes cqlsh> desc keyspaces cqlsh> use user_index; cqlsh:user_index> desc table list_1_10; Keyspace 'user_index' not found. cqlsh:user_index> cqlsh> s

Re: Schema Versioning

2016-02-11 Thread Carlos Alonso
Here we use the Cassanity gem: https://github.com/jnunemaker/cassanity This one suggests using schema migration files that are then registered in a column family to keep track of the version. Carlos Alonso | Software Engineer | @calonso On 10 February 2016 at 21:29,

Re: reducing disk space consumption

2016-02-11 Thread Romain Hardouin
As Mohammed said "nodetool clearsnaphost" will do the trick. Cassandra takes a snapshot by default before keyspace/table dropping or truncation. You can disable this feature if it's a dev node (see auto_snapshot in cassandra.yaml) but if it's a production node is a good thing to keep auto snapsh

Re: Debugging write timeouts on Cassandra 2.2.5

2016-02-11 Thread Fabrice Facorat
Are your commitlog and data on the same disk ? If yes, you should put commitlogs on a separate disk which don't have a lot of IO. Others IO may have great impact impact on your commitlog writing and it may even block. An example of impact IO may have, even for Async writes: https://engineering.li