AUTO : Samuel CARRIERE is out of the office (retour 09/03/2014)

[Samuel CARRIERE]

Je suis absent(e) du bureau jusqu'au 09/03/2014




Remarque : ceci est une réponse automatique à votre message  "Re: CQL and
reserved keywords" envoyé le 04/03/2014 10:56:02.

C'est la seule notification que vous recevrez pendant l'absence de cette
personne.

Re: Question regarding java DowngradingConsistencyRetryPolicy

[Sylvain Lebresne]

Let me first note that the DataStax Java driver has a dedicated mailing
list:
https://groups.google.com/a/lists.datastax.com/forum/#!forum/java-driver-user,
it would better to use that list for driver specific questions in the
future.

But to answer your question, a SIMPLE write is any write (INSERT, UPDATE,
DELETE) that is not in a batch. Concretely, if you do:
  session.execute("INSERT INTO ...");
it's a SIMPLE write.

--
Sylvain


On Tue, Mar 4, 2014 at 7:21 PM, HAITHEM JARRAYA wrote:

> Hi All,
>
> I might be missing something and I would like some clarification on this.
> We are using the java driver with the Downgrading Retry policy, we see in
> our logs that are only the reads are retried.
>
> In the code and the docs, it says that the write method will retry a
> maximum of one retry, when the WriteType is UNLOGGED_BATCH or BATCH_LOG.
> My question is, when a write is considered as SIMPLE?
>
> Thanks,
>
> Haithem
>
> /**
>  * Defines whether to retry and at which consistency level on a write
> timeout.
>  * 
>  * This method triggers a maximum of one retry. If {@code writeType ==
>  * WriteType.BATCH_LOG}, the write is retried with the initial
>  * consistency level. If {@code writeType == WriteType.UNLOGGED_BATCH}
>  * and at least one replica acknowledged, the write is retried with a
>  * lower consistency level (with unlogged batch, a write timeout can
>  * always mean that part of the batch haven't been persisted at
>  * all, even if {@code receivedAcks > 0}). For other {@code writeType},
>  * if we know the write has been persisted on at least one replica, we
>  * ignore the exception. Otherwise, an exception is thrown.
>  *
>  * @param statement the original query that timed out.
>  * @param cl the original consistency level of the write that timed
> out.
>  * @param writeType the type of the write that timed out.
>  * @param requiredAcks the number of acknowledgments that were
> required to
>  * achieve the requested consistency level.
>  * @param receivedAcks the number of acknowledgments that had been
> received
>  * by the time the timeout exception was raised.
>  * @param nbRetry the number of retry already performed for this
> operation.
>  * @return a RetryDecision as defined above.
>  */
> @Override
> public RetryDecision onWriteTimeout(Statement statement,
> ConsistencyLevel cl, WriteType writeType, int requiredAcks, int
> receivedAcks, int nbRetry) {
> if (nbRetry != 0)
> return RetryDecision.rethrow();
>
> switch (writeType) {
> case SIMPLE:
> case BATCH:
> // Since we provide atomicity there is no point in retrying
> return RetryDecision.ignore();
> case UNLOGGED_BATCH:
> // Since only part of the batch could have been persisted,
> // retry with whatever consistency should allow to persist
> all
> return maxLikelyToWorkCL(receivedAcks);
> case BATCH_LOG:
> return RetryDecision.retry(cl);
> }
> // We want to rethrow on COUNTER and CAS, because in those case
> "we don't know" and don't want to guess
> return RetryDecision.rethrow();
> }
>
>
>

Re: Question regarding java DowngradingConsistencyRetryPolicy

[Edward Capriolo]

"INSERT INTO x (a,b.c) values (1,2,3)"

Doesn't this sometimes turn into a batch mutation if b and c are separate
columns?




On Wed, Mar 5, 2014 at 5:03 AM, Sylvain Lebresne wrote:

> Let me first note that the DataStax Java driver has a dedicated mailing
> list:
> https://groups.google.com/a/lists.datastax.com/forum/#!forum/java-driver-user,
> it would better to use that list for driver specific questions in the
> future.
>
> But to answer your question, a SIMPLE write is any write (INSERT, UPDATE,
> DELETE) that is not in a batch. Concretely, if you do:
>   session.execute("INSERT INTO ...");
> it's a SIMPLE write.
>
> --
> Sylvain
>
>
> On Tue, Mar 4, 2014 at 7:21 PM, HAITHEM JARRAYA wrote:
>
>> Hi All,
>>
>> I might be missing something and I would like some clarification on this.
>> We are using the java driver with the Downgrading Retry policy, we see in
>> our logs that are only the reads are retried.
>>
>> In the code and the docs, it says that the write method will retry a
>> maximum of one retry, when the WriteType is UNLOGGED_BATCH or BATCH_LOG.
>> My question is, when a write is considered as SIMPLE?
>>
>> Thanks,
>>
>> Haithem
>>
>> /**
>>  * Defines whether to retry and at which consistency level on a write
>> timeout.
>>  * 
>>  * This method triggers a maximum of one retry. If {@code writeType ==
>>  * WriteType.BATCH_LOG}, the write is retried with the initial
>>  * consistency level. If {@code writeType == WriteType.UNLOGGED_BATCH}
>>  * and at least one replica acknowledged, the write is retried with a
>>  * lower consistency level (with unlogged batch, a write timeout can
>>  * always mean that part of the batch haven't been persisted at
>>  * all, even if {@code receivedAcks > 0}). For other {@code
>> writeType},
>>  * if we know the write has been persisted on at least one replica, we
>>  * ignore the exception. Otherwise, an exception is thrown.
>>  *
>>  * @param statement the original query that timed out.
>>  * @param cl the original consistency level of the write that timed
>> out.
>>  * @param writeType the type of the write that timed out.
>>  * @param requiredAcks the number of acknowledgments that were
>> required to
>>  * achieve the requested consistency level.
>>  * @param receivedAcks the number of acknowledgments that had been
>> received
>>  * by the time the timeout exception was raised.
>>  * @param nbRetry the number of retry already performed for this
>> operation.
>>  * @return a RetryDecision as defined above.
>>  */
>> @Override
>> public RetryDecision onWriteTimeout(Statement statement,
>> ConsistencyLevel cl, WriteType writeType, int requiredAcks, int
>> receivedAcks, int nbRetry) {
>> if (nbRetry != 0)
>> return RetryDecision.rethrow();
>>
>> switch (writeType) {
>> case SIMPLE:
>> case BATCH:
>> // Since we provide atomicity there is no point in
>> retrying
>> return RetryDecision.ignore();
>> case UNLOGGED_BATCH:
>> // Since only part of the batch could have been persisted,
>> // retry with whatever consistency should allow to
>> persist all
>> return maxLikelyToWorkCL(receivedAcks);
>> case BATCH_LOG:
>> return RetryDecision.retry(cl);
>> }
>> // We want to rethrow on COUNTER and CAS, because in those case
>> "we don't know" and don't want to guess
>> return RetryDecision.rethrow();
>> }
>>
>>
>>
>

Re: Commit logs building up

[Jacob Rhoden]

I've been seeing commit logs grow much much larger than the actual data under 
2.0.5, even after flushing and draining a node. Especially so on the node doing 
bulk data loads.  I've been doing intermittent drain/shutdown/delete commit 
logs to keep things in check.

I suspect a either a bug, or a non intuitive timing related to the lifetime of 
these files is not what I expect. (What is the log if of keeping these files 
after a drain anyway?)

__
Sent from iPhone

> On 27 Feb 2014, at 2:18 am, Christopher Wirt  wrote:
> 
> We’re running 2.0.5, recently upgraded from 1.2.14.
>  
> Sometimes we are seeing CommitLogs starting to build up.
>  
> Is this a potential bug? Or a symptom of something else we can easily address?
>  
> We have
> commitlog_sync: periodic
> commitlog_sync_period_in_ms:1
> commitlog_segment_size_in_mb: 512
>  
>  
> Thanks,
> Chris

Re: C++ build under Ubuntu 12.04

[Michael Shuler]

On 03/04/2014 05:33 PM, Michael Dykman wrote:

I am getting errors running the cmake file in a *very* recent download
of the C++ driver's source tree.  It seems to be failing to find
either boost::asio or openssl libraries.  I defineately have these
both installed having developed against them recently (and rechecked
with dpkg today).

While I have brushed up against cmake before, I have never had to
modify CMakeLists.txt before.  Could someone please advise me how to
adjust that filoe so it can find the external dependencies?



You shouldn't need to edit.  Perhaps you are just missing one of the 
dependencies and think you have everything installed  :)


From a fresh ec2 instance:  http://12.am/tmp/cpp-driver_setup.txt

That's how I work through build dependencies - granted that was quick, 
without searching apt-cache, since I've done this before and have a list 
of build deps.  Hope this helps!


--
Kind regards,
Michael

Re: C++ build under Ubuntu 12.04

[Michael Dykman]

The only listed dependencies: boost and libssh.  I am not even
slightly uncertain if they are installed. Not only did I confirm them
yesterday via dpkg (having installed both via apt-get from Ubuntu's
core repos), I have been explicitly coding against them both for the
past several months on this same workstation.  I can see them all at
thier relative paths and have a couple of working make files then
reference them.  They are also the only items mentioned in the error
message when my build fails:

mdykman@sage:~/projects/datastax-cpp-driver$ cmake .
-- info CMAKE_BINARY_DIR: /home/mdykman/projects/datastax-cpp-driver
-- Could NOT find Boost
CMake Error at 
/usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:91
(MESSAGE):
  Could NOT find LIBSSH2 (missing: LIBSSH2_LIBRARIES LIBSSH2_INCLUDE_DIRS)
Call Stack (most recent call first):
  /usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:252
(_FPHSA_FAILURE_MESSAGE)
  extra/ccm_bridge/cmake/Modules/FindLIBSSH2.cmake:51
(find_package_handle_standard_args)
  extra/ccm_bridge/CMakeLists.txt:37 (find_package)


-- Configuring incomplete, errors occurred!

open ssl is installed in an obvious place "/usr/include/openssl/ssl.h"

as is boost:asio  "/usr/include/boost/asio.hpp"

Does anyone have a hint as to how to edit/debug the search paths being
used by cmake?

On Wed, Mar 5, 2014 at 11:39 AM, Michael Shuler  wrote:
> On 03/04/2014 05:33 PM, Michael Dykman wrote:
>>
>> I am getting errors running the cmake file in a *very* recent download
>> of the C++ driver's source tree.  It seems to be failing to find
>> either boost::asio or openssl libraries.  I defineately have these
>> both installed having developed against them recently (and rechecked
>> with dpkg today).
>>
>> While I have brushed up against cmake before, I have never had to
>> modify CMakeLists.txt before.  Could someone please advise me how to
>> adjust that filoe so it can find the external dependencies?
>>
>
> You shouldn't need to edit.  Perhaps you are just missing one of the
> dependencies and think you have everything installed  :)
>
> From a fresh ec2 instance:  http://12.am/tmp/cpp-driver_setup.txt
>
> That's how I work through build dependencies - granted that was quick,
> without searching apt-cache, since I've done this before and have a list of
> build deps.  Hope this helps!
>
> --
> Kind regards,
> Michael



-- 
 - michael dykman
 - mdyk...@gmail.com

 May the Source be with you.

Re: Thrift Server Implementations

[Chris Burroughs]

On 02/13/2014 01:37 PM, Christopher Wirt wrote:

Anyway, today I moved the old HsHa implementation and the new
TThreadSelectorServer into a 2.0.5 checkout, hooked them in, built, did a
bit of testing and I'm now running live.



We found the TThreadSelectorServer performed the best getting us back under
our SLA.


Are you still running with the upstream TThreadSelectorServer?  Based on 
your experience is there any reason Cassandra should not adapt it.

Re: mixed nodes, some SSD some HD

[Chris Burroughs]

No.  If you have a heterogeneous clusters you should consider adjusting 
the number of vnodes per physical node.


On 03/04/2014 10:47 PM, Elliot Finley wrote:

Using Cassandra 2.0.x

If I have a 3 node cluster and 2 of the nodes use spinning drives and 1 of
them uses SSD,  will the majority of the reads be routed to the SSD node
automatically because it has faster responses?

TIA,
Elliot

RE: Datastax C++ driver on Windows x64

[Green, John M (HP Education)]

Sorry, I forgot to mention that I'm trying to build release_0_2_0 of the 
driver.

I still haven't figured this out but, knowing that it's possible, I started 
digging deeper.   

It appears to be an issue with the cmm_bridge depending on libssh2 (i.e., 
libssh2-1.4.3) and libssh2 depending on pthreads -- which I don't have.The  
other parts of the C++ driver seem to be getting their thread requirements 
satisfied by boost (i.e., boost_thread-vc100-mt-1_54.lib).  

Again, I'm still digging deeper but thought I toss this detail out in case it 
sparks the memory of anyone who's blazed this trail before.

John 

-Original Message-
From: Green, John M (HP Education) 
Sent: Tuesday, March 04, 2014 3:02 PM
To: user@cassandra.apache.org
Subject: RE: Datastax C++ driver on Windows x64

Thanks Michael.This is the "ray of hope" I desperately needed.  I'll let 
you know how it goes.
 
-Original Message-
From: Michael Shuler [mailto:mshu...@pbandjelly.org] On Behalf Of Michael Shuler
Sent: Tuesday, March 04, 2014 2:58 PM
To: user@cassandra.apache.org
Subject: Re: Datastax C++ driver on Windows x64

On 03/04/2014 04:30 PM, Michael Shuler wrote:
> On 03/04/2014 04:22 PM, Michael Shuler wrote:
>> On 03/04/2014 04:12 PM, Dwight Smith wrote:
>>> Second that question
>>>
>>> *From:*Green, John M (HP Education) [mailto:john.gr...@hp.com]
>>> *Sent:* Tuesday, March 04, 2014 2:03 PM
>>> *To:* user@cassandra.apache.org
>>> *Subject:* Datastax C++ driver on Windows x64
>>>
>>> Has anyone successfully built the Datastax C++ driver for a Windows 
>>> 64-bit platform?
>>>
>>> While I've made some progress I'm still not there and wondering if I 
>>> should give-up and use a local socket to another process (e.g., JVM or
>>> .NET runtime) instead.I'd prefer to use C++ because that's what the
>>> rest of the application is using.However, my C++ and makefile
>>> experience is very dated and I've never used cmake before.Still I'd
>>> be very interested to know if anyone had success using the C++ 
>>> driver on Windows x64.
>>
>> http://cassci.datastax.com/job/y_cpp_driver_win32/lastBuild/consoleFu
>> ll
>>
>> Please, let me know, and I'll dig for some further details, if this 
>> doesn't fully help.  I did not set this particular job up, but 
>> jenkins runs the following batch script after git pull:
>>
>> 
>> @echo off
>> cd C:\jenkins\workspace
>> mkdir y_cpp_driver_win32\bin
>> copy CMakeCache.txt y_cpp_driver_win32\bin cd y_cpp_driver_win32\bin 
>> cmake .
>> msbuild ALL_BUILD.vcxproj
>> msbuild UNINSTALL.vcxproj
>> msbuild INSTALL.vcxproj
>> 
>
> I may have replied a bit too quickly - it does look like this is using 
> all 32-bit libs in the includes, even though it's built on a 64-bit 
> machine.
>
> You might be able to touch base with the developers on the freenode 
> #datastax-drivers channel.
>

I uploaded the CMakeCache.txt that is being copied over so you could peek at 
it, too.

http://cassci.datastax.com/userContent/y_cpp_driver_win32-config/

--
Michael

Re: C++ build under Ubuntu 12.04

[Michael Shuler]

On 03/05/2014 10:55 AM, Michael Dykman wrote:

The only listed dependencies: boost and libssh.  I am not even
slightly uncertain if they are installed. Not only did I confirm them
yesterday via dpkg (having installed both via apt-get from Ubuntu's
core repos), I have been explicitly coding against them both for the
past several months on this same workstation.  I can see them all at
thier relative paths and have a couple of working make files then
reference them.  They are also the only items mentioned in the error
message when my build fails:

mdykman@sage:~/projects/datastax-cpp-driver$ cmake .
-- info CMAKE_BINARY_DIR: /home/mdykman/projects/datastax-cpp-driver
-- Could NOT find Boost
CMake Error at 
/usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:91
(MESSAGE):
   Could NOT find LIBSSH2 (missing: LIBSSH2_LIBRARIES LIBSSH2_INCLUDE_DIRS)
Call Stack (most recent call first):
   /usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:252
(_FPHSA_FAILURE_MESSAGE)
   extra/ccm_bridge/cmake/Modules/FindLIBSSH2.cmake:51
(find_package_handle_standard_args)
   extra/ccm_bridge/CMakeLists.txt:37 (find_package)


-- Configuring incomplete, errors occurred!

open ssl is installed in an obvious place "/usr/include/openssl/ssl.h"


libssl != libssh

The LIBSSH2 error is in the output I posted, along with the next command 
being the solution: 'apt-get install libssh2-1-dev'



as is boost:asio  "/usr/include/boost/asio.hpp"

Does anyone have a hint as to how to edit/debug the search paths being
used by cmake?


It's also documented in 
https://github.com/datastax/cpp-driver/blob/master/instruction_win_lin.txt.txt 
with the exception that libboost-filesystem-dev and libboost-log-dev 
(not available in wheezy/12.04) are no longer needed, per 
https://datastax-oss.atlassian.net/browse/CPP-36


All in one line:

sudo apt-get install build-essential cmake libasio-dev 
libboost-system-dev libboost-thread-dev libboost-test-dev 
libboost-program-options-dev libssh2-1-dev


--
Michael

Re: Datastax C++ driver on Windows x64

[Michael Shuler]

CCM won't run on windows, so don't bother.  Unless you wish to get it 
working on windows - I'm sure that patch would be gladly accepted  :) 
Just build the driver in bin/ as below, instead of trying the whole project.


--
Michael

On 03/05/2014 11:13 AM, Green, John M (HP Education) wrote:

Sorry, I forgot to mention that I'm trying to build release_0_2_0 of the driver.

I still haven't figured this out but, knowing that it's possible, I started 
digging deeper.

It appears to be an issue with the cmm_bridge depending on libssh2 (i.e., 
libssh2-1.4.3) and libssh2 depending on pthreads -- which I don't have.The  
other parts of the C++ driver seem to be getting their thread requirements 
satisfied by boost (i.e., boost_thread-vc100-mt-1_54.lib).

Again, I'm still digging deeper but thought I toss this detail out in case it 
sparks the memory of anyone who's blazed this trail before.

John

-Original Message-
From: Green, John M (HP Education)
Sent: Tuesday, March 04, 2014 3:02 PM
To: user@cassandra.apache.org
Subject: RE: Datastax C++ driver on Windows x64

Thanks Michael.This is the "ray of hope" I desperately needed.  I'll let 
you know how it goes.

-Original Message-
From: Michael Shuler [mailto:mshu...@pbandjelly.org] On Behalf Of Michael Shuler
Sent: Tuesday, March 04, 2014 2:58 PM
To: user@cassandra.apache.org
Subject: Re: Datastax C++ driver on Windows x64

On 03/04/2014 04:30 PM, Michael Shuler wrote:

On 03/04/2014 04:22 PM, Michael Shuler wrote:

On 03/04/2014 04:12 PM, Dwight Smith wrote:

Second that question

*From:*Green, John M (HP Education) [mailto:john.gr...@hp.com]
*Sent:* Tuesday, March 04, 2014 2:03 PM
*To:* user@cassandra.apache.org
*Subject:* Datastax C++ driver on Windows x64

Has anyone successfully built the Datastax C++ driver for a Windows
64-bit platform?

While I've made some progress I'm still not there and wondering if I
should give-up and use a local socket to another process (e.g., JVM or
.NET runtime) instead.I'd prefer to use C++ because that's what the
rest of the application is using.However, my C++ and makefile
experience is very dated and I've never used cmake before.Still I'd
be very interested to know if anyone had success using the C++
driver on Windows x64.


http://cassci.datastax.com/job/y_cpp_driver_win32/lastBuild/consoleFu
ll

Please, let me know, and I'll dig for some further details, if this
doesn't fully help.  I did not set this particular job up, but
jenkins runs the following batch script after git pull:


@echo off
cd C:\jenkins\workspace
mkdir y_cpp_driver_win32\bin
copy CMakeCache.txt y_cpp_driver_win32\bin cd y_cpp_driver_win32\bin
cmake .
msbuild ALL_BUILD.vcxproj
msbuild UNINSTALL.vcxproj
msbuild INSTALL.vcxproj



I may have replied a bit too quickly - it does look like this is using
all 32-bit libs in the includes, even though it's built on a 64-bit
machine.

You might be able to touch base with the developers on the freenode
#datastax-drivers channel.



I uploaded the CMakeCache.txt that is being copied over so you could peek at 
it, too.

http://cassci.datastax.com/userContent/y_cpp_driver_win32-config/

--
Michael

Re: Datastax C++ driver on Windows x64

[Michael Shuler]

On 03/05/2014 11:20 AM, Michael Shuler wrote:

CCM won't run on windows, so don't bother.  Unless you wish to get it
working on windows - I'm sure that patch would be gladly accepted  :)
Just build the driver in bin/ as below, instead of trying the whole
project.


Oh, looking at the log on cassci, it does look like it's using openssl, 
which we do have installed under C:\jenkins\workspace\thirdparty\


I suppose you'd need to get that installed.

--
Michael

RE: Thrift Server Implementations

[Christopher Wirt]

Yes I am still running thrift 0.9 TThreadedSelectorServer without any serious 
problems.

I didn't realise before, but the old Cassandra CustomTHsHaServer implementation 
is very similar to TTSS. So this could easily be seen as a step backwards.

But given my current situation I'd love to see TTSS as an option.

The idea was mentioned in the comments here 
https://issues.apache.org/jira/browse/CASSANDRA-6285


-Original Message-
From: Chris Burroughs [mailto:chris.burrou...@gmail.com] 
Sent: 05 March 2014 17:02
To: user@cassandra.apache.org
Subject: Re: Thrift Server Implementations

On 02/13/2014 01:37 PM, Christopher Wirt wrote:
> Anyway, today I moved the old HsHa implementation and the new 
> TThreadSelectorServer into a 2.0.5 checkout, hooked them in, built, 
> did a bit of testing and I'm now running live.
>
>
>
> We found the TThreadSelectorServer performed the best getting us back 
> under our SLA.

Are you still running with the upstream TThreadSelectorServer?  Based on your 
experience is there any reason Cassandra should not adapt it.

DataStax Driver Mailing Lists and IRC Channel

[Michael Shuler]

While drivers are relevant to using C*, messages about having problems 
building the drivers, conversation about development, discussing bugs or 
patches, etc. would probably be better done on their respective mailing 
lists, IRC channel, and JIRAs.


Mailing Lists:
Java: 
https://groups.google.com/a/lists.datastax.com/forum/#!forum/java-driver-user
Python: 
https://groups.google.com/a/lists.datastax.com/forum/#!forum/python-driver-user
C++: 
https://groups.google.com/a/lists.datastax.com/forum/#!forum/cpp-driver-user
C#: 
https://groups.google.com/a/lists.datastax.com/forum/#!forum/csharp-driver-user


IRC (all drivers):
/connect irc.freenode.net
/join #datastax-drivers
or: http://webchat.freenode.net/?channels=#datastax-drivers

JIRA:
Java:  https://datastax-oss.atlassian.net/browse/JAVA
Python:  https://datastax-oss.atlassian.net/browse/PYTHON
C++:  https://datastax-oss.atlassian.net/browse/CPP
C#:  https://datastax-oss.atlassian.net/browse/CSHARP

The above are also listed in the READMEs for the respective drivers: 
https://github.com/datastax


--
Kind regards,
Michael

Re: Datastax C++ driver on Windows x64

[Michael Shuler]

On 03/05/2014 11:34 AM, Green, John M (HP Education) wrote:

Yes, I have openssl, boost, and zlib.   It's just been this nastiness of the 
cmm_bridge which you've just confirmed I don't  need (thank goodness!).   I'm 
still not sure how to


Just build the driver in bin/ as below, instead of trying the whole project.


I don't have a bin subirectory.


It's being made, first.  Here's that block again:


@echo off
cd C:\jenkins\workspace
mkdir y_cpp_driver_win32\bin
copy CMakeCache.txt y_cpp_driver_win32\bin
cd y_cpp_driver_win32\bin
cmake .
msbuild ALL_BUILD.vcxproj
msbuild UNINSTALL.vcxproj
msbuild INSTALL.vcxproj


--
Michael




#dir
  Volume in drive D is development
  Volume Serial Number is 8C95-EF28

  Directory of D:\dvlp\git\cpp-driver-release_0_2_0

03/05/2014  08:45 AM  .
03/05/2014  08:45 AM  ..
03/03/2014  10:18 AM   472 .gitignore
03/05/2014  08:45 AM25,792 CMakeCache.txt
03/05/2014  08:45 AM  CMakeFiles
03/05/2014  08:44 AM 7,330 CMakeLists.txt
03/03/2014  12:44 PM 1,129 cmake_uninstall.cmake
03/03/2014  10:18 AM 1,032 cmake_uninstall.cmake.in
03/03/2014  10:18 AM   458 config.txt
03/03/2014  10:18 AM   505 cpp_driver.cppcheck
03/03/2014  10:18 AM  debian
03/04/2014  06:09 PM  demo
03/03/2014  10:18 AM79,730 Doxyfile
03/03/2014  10:18 AM  extra
03/03/2014  10:18 AM  include
03/03/2014  10:18 AM 2,787 instruction_win_lin.txt.txt
03/03/2014  10:18 AM11,358 LICENSE.txt
03/03/2014  10:18 AM 2,145 macosx_instruction.txt
03/03/2014  10:18 AM  nbproject
03/03/2014  10:18 AM 4,364 README.md
03/03/2014  10:18 AM  src
03/03/2014  10:18 AM  test
   12 File(s)137,102 bytes
   10 Dir(s)  209,041,293,312 bytes free


-Original Message-
From: Michael Shuler [mailto:mshu...@pbandjelly.org] On Behalf Of Michael Shuler
Sent: Wednesday, March 05, 2014 9:23 AM
To: user@cassandra.apache.org
Subject: Re: Datastax C++ driver on Windows x64

On 03/05/2014 11:20 AM, Michael Shuler wrote:

CCM won't run on windows, so don't bother.  Unless you wish to get it
working on windows - I'm sure that patch would be gladly accepted  :)
Just build the driver in bin/ as below, instead of trying the whole
project.


Oh, looking at the log on cassci, it does look like it's using openssl, which 
we do have installed under C:\jenkins\workspace\thirdparty\

I suppose you'd need to get that installed.

--
Michael

Fw: Security at ApacheCon Denver

[Melissa Warnkin]

Hello Security Enthusiasts, 


As you are no doubt aware, ApacheCon North America will be held in Denver, 
Colorado starting on April 7th.  Security has 4 talks; check it out here:  
http://apacheconnorthamerica2014.sched.org/overview/type/security#.UxccIYV9JUE

We would love to see you in Denver next month.  Register soon, as prices go up 
on March 14th. http://na.apachecon.com/.

Best regards,

Melissa
ApacheCon Planning Team

RE: Datastax C++ driver on Windows x64

[Green, John M (HP Education)]

Yes, I have openssl, boost, and zlib.   It's just been this nastiness of the 
cmm_bridge which you've just confirmed I don't  need (thank goodness!).   I'm 
still not sure how to 

>> Just build the driver in bin/ as below, instead of trying the whole project.

I don't have a bin subirectory.  

#dir
 Volume in drive D is development
 Volume Serial Number is 8C95-EF28

 Directory of D:\dvlp\git\cpp-driver-release_0_2_0

03/05/2014  08:45 AM  .
03/05/2014  08:45 AM  ..
03/03/2014  10:18 AM   472 .gitignore
03/05/2014  08:45 AM25,792 CMakeCache.txt
03/05/2014  08:45 AM  CMakeFiles
03/05/2014  08:44 AM 7,330 CMakeLists.txt
03/03/2014  12:44 PM 1,129 cmake_uninstall.cmake
03/03/2014  10:18 AM 1,032 cmake_uninstall.cmake.in
03/03/2014  10:18 AM   458 config.txt
03/03/2014  10:18 AM   505 cpp_driver.cppcheck
03/03/2014  10:18 AM  debian
03/04/2014  06:09 PM  demo
03/03/2014  10:18 AM79,730 Doxyfile
03/03/2014  10:18 AM  extra
03/03/2014  10:18 AM  include
03/03/2014  10:18 AM 2,787 instruction_win_lin.txt.txt
03/03/2014  10:18 AM11,358 LICENSE.txt
03/03/2014  10:18 AM 2,145 macosx_instruction.txt
03/03/2014  10:18 AM  nbproject
03/03/2014  10:18 AM 4,364 README.md
03/03/2014  10:18 AM  src
03/03/2014  10:18 AM  test
  12 File(s)137,102 bytes
  10 Dir(s)  209,041,293,312 bytes free


-Original Message-
From: Michael Shuler [mailto:mshu...@pbandjelly.org] On Behalf Of Michael Shuler
Sent: Wednesday, March 05, 2014 9:23 AM
To: user@cassandra.apache.org
Subject: Re: Datastax C++ driver on Windows x64

On 03/05/2014 11:20 AM, Michael Shuler wrote:
> CCM won't run on windows, so don't bother.  Unless you wish to get it 
> working on windows - I'm sure that patch would be gladly accepted  :) 
> Just build the driver in bin/ as below, instead of trying the whole 
> project.

Oh, looking at the log on cassci, it does look like it's using openssl, which 
we do have installed under C:\jenkins\workspace\thirdparty\

I suppose you'd need to get that installed.

--
Michael

Re: C++ build under Ubuntu 12.04

[Michael Dykman]

I stand corrected. I did not have libssh2 and while I did have
libboost-all-dev (see below), I did not have the all the specific
packages indicated

 ii  libboost-all-dev   1.48.0.2
 Boost C++ Libraries development files (ALL, default
version)

So, I ran the full apt-get command that you suggested (as indicated in
instruction_win_lin.txt.txt):

  sudo apt-get install build-essential cmake libasio-dev
libboost-system-dev libboost-thread-dev libboost-test-dev
libboost-program-options-dev libssh2-1-dev

which succeeded and repeated the cmake steps.  As you can see from the
messages below, the boost::asio library is *still* not being found.

mdykman@sage:~/projects/datastax-cpp-driver$ cmake  .
-- info CMAKE_BINARY_DIR: /home/mdykman/projects/datastax-cpp-driver
-- Could NOT find Boost
-- Found LIBSSH2: /usr/lib/libssh2.so
-- Configuring done
-- Generating done
-- Build files have been written to: /home/mdykman/projects/datastax-cpp-driver

I have thoroughly read instruction_win_lin.txt.txt but no solution is
presenting itself to me.  I am more than happy to do my own deep-dive
if someone could suggest how I go about instructing cmake to find the
boost libraries? Expand the search paths?

On Wed, Mar 5, 2014 at 12:14 PM, Michael Shuler  wrote:
> On 03/05/2014 10:55 AM, Michael Dykman wrote:
>>
>> The only listed dependencies: boost and libssh.  I am not even
>> slightly uncertain if they are installed. Not only did I confirm them
>> yesterday via dpkg (having installed both via apt-get from Ubuntu's
>> core repos), I have been explicitly coding against them both for the
>> past several months on this same workstation.  I can see them all at
>> thier relative paths and have a couple of working make files then
>> reference them.  They are also the only items mentioned in the error
>> message when my build fails:
>>
>> mdykman@sage:~/projects/datastax-cpp-driver$ cmake .
>> -- info CMAKE_BINARY_DIR: /home/mdykman/projects/datastax-cpp-driver
>> -- Could NOT find Boost
>> CMake Error at
>> /usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:91
>> (MESSAGE):
>>Could NOT find LIBSSH2 (missing: LIBSSH2_LIBRARIES
>> LIBSSH2_INCLUDE_DIRS)
>> Call Stack (most recent call first):
>>/usr/share/cmake-2.8/Modules/FindPackageHandleStandardArgs.cmake:252
>> (_FPHSA_FAILURE_MESSAGE)
>>extra/ccm_bridge/cmake/Modules/FindLIBSSH2.cmake:51
>> (find_package_handle_standard_args)
>>extra/ccm_bridge/CMakeLists.txt:37 (find_package)
>>
>>
>> -- Configuring incomplete, errors occurred!
>>
>> open ssl is installed in an obvious place "/usr/include/openssl/ssl.h"
>
>
> libssl != libssh
>
> The LIBSSH2 error is in the output I posted, along with the next command
> being the solution: 'apt-get install libssh2-1-dev'
>
>
>> as is boost:asio  "/usr/include/boost/asio.hpp"
>>
>> Does anyone have a hint as to how to edit/debug the search paths being
>> used by cmake?
>
>
> It's also documented in
> https://github.com/datastax/cpp-driver/blob/master/instruction_win_lin.txt.txt
> with the exception that libboost-filesystem-dev and libboost-log-dev (not
> available in wheezy/12.04) are no longer needed, per
> https://datastax-oss.atlassian.net/browse/CPP-36
>
> All in one line:
>
> sudo apt-get install build-essential cmake libasio-dev libboost-system-dev
> libboost-thread-dev libboost-test-dev libboost-program-options-dev
> libssh2-1-dev
>
> --
> Michael



-- 
 - michael dykman
 - mdyk...@gmail.com

 May the Source be with you.

Re: C++ build under Ubuntu 12.04

[Michael Shuler]

On 03/05/2014 11:53 AM, Michael Dykman wrote:

I stand corrected. I did not have libssh2 and while I did have
libboost-all-dev (see below), I did not have the all the specific
packages indicated

  ii  libboost-all-dev   1.48.0.2
  Boost C++ Libraries development files (ALL, default
version)

So, I ran the full apt-get command that you suggested (as indicated in
instruction_win_lin.txt.txt):

   sudo apt-get install build-essential cmake libasio-dev
libboost-system-dev libboost-thread-dev libboost-test-dev
libboost-program-options-dev libssh2-1-dev

which succeeded and repeated the cmake steps.  As you can see from the
messages below, the boost::asio library is *still* not being found.

mdykman@sage:~/projects/datastax-cpp-driver$ cmake  .
-- info CMAKE_BINARY_DIR: /home/mdykman/projects/datastax-cpp-driver
-- Could NOT find Boost
-- Found LIBSSH2: /usr/lib/libssh2.so
-- Configuring done
-- Generating done
-- Build files have been written to: /home/mdykman/projects/datastax-cpp-driver

I have thoroughly read instruction_win_lin.txt.txt but no solution is
presenting itself to me.  I am more than happy to do my own deep-dive
if someone could suggest how I go about instructing cmake to find the
boost libraries? Expand the search paths?


Oh, I missed the NOT in my example, too.  Could you report this as a 
bug?  I'm not sure if just the cmake message is an error, since it 
builds fine, or if it is, in fact, not finding/using the libs.


https://datastax-oss.atlassian.net/browse/CPP

--
Michael

Re: C++ build under Ubuntu 12.04

[Michael Dykman]

It looks like a cmake message error, as you suggested. Running 'make'
against the result of 'cmake' grinds through without an error and the
result is indeed linked to boost although it is not the multi-threaded
version of boost (which is installed on my system) as I would have
expected.

mdykman@sage:~/projects/datastax-cpp-driver$ ldd libcql.so
linux-vdso.so.1 =>  (0x7fff61e88000)
libboost_system.so.1.46.1 => /usr/lib/libboost_system.so.1.46.1
(0x7fe490a8b000)
libboost_thread.so.1.46.1 => /usr/lib/libboost_thread.so.1.46.1
(0x7fe490872000)
libssl.so.1.0.0 => /lib/x86_64-linux-gnu/libssl.so.1.0.0 (0x7fe490613000)
libcrypto.so.1.0.0 => /lib/x86_64-linux-gnu/libcrypto.so.1.0.0
(0x7fe490238000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x7fe49001b000)
libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x7fe48fd1a000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x7fe48fa1e000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x7fe48f808000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x7fe48f447000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x7fe48f243000)
libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x7fe48f02c000)
/lib64/ld-linux-x86-64.so.2 (0x7fe4912dd000)

I will write up that bug report.  After lunch.

On Wed, Mar 5, 2014 at 1:08 PM, Michael Shuler  wrote:
> On 03/05/2014 11:53 AM, Michael Dykman wrote:
>>
>> I stand corrected. I did not have libssh2 and while I did have
>> libboost-all-dev (see below), I did not have the all the specific
>> packages indicated
>>
>>   ii  libboost-all-dev   1.48.0.2
>>   Boost C++ Libraries development files (ALL, default
>> version)
>>
>> So, I ran the full apt-get command that you suggested (as indicated in
>> instruction_win_lin.txt.txt):
>>
>>sudo apt-get install build-essential cmake libasio-dev
>> libboost-system-dev libboost-thread-dev libboost-test-dev
>> libboost-program-options-dev libssh2-1-dev
>>
>> which succeeded and repeated the cmake steps.  As you can see from the
>> messages below, the boost::asio library is *still* not being found.
>>
>> mdykman@sage:~/projects/datastax-cpp-driver$ cmake  .
>> -- info CMAKE_BINARY_DIR: /home/mdykman/projects/datastax-cpp-driver
>> -- Could NOT find Boost
>> -- Found LIBSSH2: /usr/lib/libssh2.so
>> -- Configuring done
>> -- Generating done
>> -- Build files have been written to:
>> /home/mdykman/projects/datastax-cpp-driver
>>
>> I have thoroughly read instruction_win_lin.txt.txt but no solution is
>> presenting itself to me.  I am more than happy to do my own deep-dive
>> if someone could suggest how I go about instructing cmake to find the
>> boost libraries? Expand the search paths?
>
>
> Oh, I missed the NOT in my example, too.  Could you report this as a bug?
> I'm not sure if just the cmake message is an error, since it builds fine, or
> if it is, in fact, not finding/using the libs.
>
> https://datastax-oss.atlassian.net/browse/CPP
>
> --
> Michael



-- 
 - michael dykman
 - mdyk...@gmail.com

 May the Source be with you.

RE: Datastax C++ driver on Windows x64

[Green, John M (HP Education)]

Build succeeded.
0 Warning(s)
0 Error(s)

I commented out the integration_tests and cmm_bridge from CMakeLists.txt since 
Windows in the only platform I care about. 
# add_subdirectory(extra/ccm_bridge)   <-- Doesn't work on windows!
# add_subdirectory(test/integration_tests)

An idiot probably would have figured this out days ago but I'm not that smart.

THANK YOU for all your help! 

John 
-Original Message-
From: Michael Shuler [mailto:mshu...@pbandjelly.org] On Behalf Of Michael Shuler
Sent: Wednesday, March 05, 2014 9:41 AM
To: user@cassandra.apache.org
Subject: Re: Datastax C++ driver on Windows x64

On 03/05/2014 11:34 AM, Green, John M (HP Education) wrote:
> Yes, I have openssl, boost, and zlib.   It's just been this nastiness of the 
> cmm_bridge which you've just confirmed I don't  need (thank goodness!).   I'm 
> still not sure how to
>
>>> Just build the driver in bin/ as below, instead of trying the whole project.
>
> I don't have a bin subirectory.

It's being made, first.  Here's that block again:


@echo off
cd C:\jenkins\workspace
mkdir y_cpp_driver_win32\bin
copy CMakeCache.txt y_cpp_driver_win32\bin cd y_cpp_driver_win32\bin cmake .
msbuild ALL_BUILD.vcxproj
msbuild UNINSTALL.vcxproj
msbuild INSTALL.vcxproj


--
Michael


>
> #dir
>   Volume in drive D is development
>   Volume Serial Number is 8C95-EF28
>
>   Directory of D:\dvlp\git\cpp-driver-release_0_2_0
>
> 03/05/2014  08:45 AM  .
> 03/05/2014  08:45 AM  ..
> 03/03/2014  10:18 AM   472 .gitignore
> 03/05/2014  08:45 AM25,792 CMakeCache.txt
> 03/05/2014  08:45 AM  CMakeFiles
> 03/05/2014  08:44 AM 7,330 CMakeLists.txt
> 03/03/2014  12:44 PM 1,129 cmake_uninstall.cmake
> 03/03/2014  10:18 AM 1,032 cmake_uninstall.cmake.in
> 03/03/2014  10:18 AM   458 config.txt
> 03/03/2014  10:18 AM   505 cpp_driver.cppcheck
> 03/03/2014  10:18 AM  debian
> 03/04/2014  06:09 PM  demo
> 03/03/2014  10:18 AM79,730 Doxyfile
> 03/03/2014  10:18 AM  extra
> 03/03/2014  10:18 AM  include
> 03/03/2014  10:18 AM 2,787 instruction_win_lin.txt.txt
> 03/03/2014  10:18 AM11,358 LICENSE.txt
> 03/03/2014  10:18 AM 2,145 macosx_instruction.txt
> 03/03/2014  10:18 AM  nbproject
> 03/03/2014  10:18 AM 4,364 README.md
> 03/03/2014  10:18 AM  src
> 03/03/2014  10:18 AM  test
>12 File(s)137,102 bytes
>10 Dir(s)  209,041,293,312 bytes free
>
>
> -Original Message-
> From: Michael Shuler [mailto:mshu...@pbandjelly.org] On Behalf Of Michael 
> Shuler
> Sent: Wednesday, March 05, 2014 9:23 AM
> To: user@cassandra.apache.org
> Subject: Re: Datastax C++ driver on Windows x64
>
> On 03/05/2014 11:20 AM, Michael Shuler wrote:
>> CCM won't run on windows, so don't bother.  Unless you wish to get it
>> working on windows - I'm sure that patch would be gladly accepted  :)
>> Just build the driver in bin/ as below, instead of trying the whole
>> project.
>
> Oh, looking at the log on cassci, it does look like it's using openssl, which 
> we do have installed under C:\jenkins\workspace\thirdparty\
>
> I suppose you'd need to get that installed.
>
> --
> Michael
>

Re: Cassandra cpp driver call to local cassandra colo

[Michael Shuler]

On 03/04/2014 12:28 PM, Check Peck wrote:

I guess you are not right.. Cluster.builder.addContactPoint(...) will
add nodes in the connection pool.. And it will discover all the other
nodes in the connection pool automatically.. To filter out nodes only
for local colo we need to use to different settings in Java driver..


In both the python and java drivers, I found DCAwareRoundRobinPolicy 
which appears to have the functionality you are looking for.


http://datastax.github.io/python-driver/api/cassandra/policies.html#cassandra.policies.DCAwareRoundRobinPolicy


There should be similar stuff in cpp driver as well..


I'm sure it's on the roadmap, if it is not in there already - I may just 
not be finding a datacenter aware policy in the source.  The C++ driver 
is under heavy development and is not as featured as the python and java 
drivers, yet, so you may want to consider one of the other drivers if 
you have an immediate need.  I'm sure they would enjoy getting a patch 
for a dc aware policy or at least a feature request for this, if you 
have the time to hit up JIRA - https://datastax-oss.atlassian.net/browse/CPP


--
Kind regards,
Michael

Re: mixed nodes, some SSD some HD

[Elliot Finley]

Keep in mind, for this 3 node cluster, N = 3.

I did a bit more digging and I found this (for future searches on this
topic):

http://www.datastax.com/documentation/cassandra/2.0/cassandra/architecture/architectureSnitchDynamic_c.html

http://www.datastax.com/dev/blog/dynamic-snitching-in-cassandra-past-present-and-future

So, according to this, if I'm reading it right, the SSD node WILL take the
majority of reads.

Any comments welcome.



On Wed, Mar 5, 2014 at 10:04 AM, Chris Burroughs
wrote:

> No.  If you have a heterogeneous clusters you should consider adjusting
> the number of vnodes per physical node.
>
>
> On 03/04/2014 10:47 PM, Elliot Finley wrote:
>
>> Using Cassandra 2.0.x
>>
>> If I have a 3 node cluster and 2 of the nodes use spinning drives and 1 of
>> them uses SSD,  will the majority of the reads be routed to the SSD node
>> automatically because it has faster responses?
>>
>> TIA,
>> Elliot
>>
>>
>

Re: mixed nodes, some SSD some HD

[Russell Bradberry]

Are you using the dynamic snitch? Because the SimpleSnitch is the default.



On March 5, 2014 at 5:27:03 PM, Elliot Finley (efinley.li...@gmail.com) wrote:

Keep in mind, for this 3 node cluster, N = 3.

I did a bit more digging and I found this (for future searches on this topic):

http://www.datastax.com/documentation/cassandra/2.0/cassandra/architecture/architectureSnitchDynamic_c.html

http://www.datastax.com/dev/blog/dynamic-snitching-in-cassandra-past-present-and-future

So, according to this, if I'm reading it right, the SSD node WILL take the 
majority of reads.

Any comments welcome.



On Wed, Mar 5, 2014 at 10:04 AM, Chris Burroughs  
wrote:
No.  If you have a heterogeneous clusters you should consider adjusting the 
number of vnodes per physical node.


On 03/04/2014 10:47 PM, Elliot Finley wrote:
Using Cassandra 2.0.x

If I have a 3 node cluster and 2 of the nodes use spinning drives and 1 of
them uses SSD,  will the majority of the reads be routed to the SSD node
automatically because it has faster responses?

TIA,
Elliot

Re: mixed nodes, some SSD some HD

[Tyler Hobbs]

The dynamic snitch wraps whatever snitch you configure (SimpleSnitch,
PropertyFileSnitch, etc).

The dynamic snitch *will* favor faster replicas, but it might still
under-utilize the SSD nodes.  Chris's suggestion to give the SSD nodes a
higher number of tokens will result in them being replicas for a larger
portion of the data, so you may still want to do that.


On Wed, Mar 5, 2014 at 4:29 PM, Russell Bradberry wrote:

> Are you using the dynamic snitch? Because the SimpleSnitch is the default.
>
>
>
> On March 5, 2014 at 5:27:03 PM, Elliot Finley (efinley.li...@gmail.com)
> wrote:
>
> Keep in mind, for this 3 node cluster, N = 3.
>
> I did a bit more digging and I found this (for future searches on this
> topic):
>
> http://www.datastax.com/documentation/cassandra/2.0/cassandra/architecture/architectureSnitchDynamic_c.html
>
> http://www.datastax.com/dev/blog/dynamic-snitching-in-cassandra-past-present-and-future
>
> So, according to this, if I'm reading it right, the SSD node WILL take the
> majority of reads.
>
> Any comments welcome.
>
>
>
> On Wed, Mar 5, 2014 at 10:04 AM, Chris Burroughs <
> chris.burrou...@gmail.com> wrote:
>
>> No.  If you have a heterogeneous clusters you should consider adjusting
>> the number of vnodes per physical node.
>>
>>
>> On 03/04/2014 10:47 PM, Elliot Finley wrote:
>>
>>> Using Cassandra 2.0.x
>>>
>>> If I have a 3 node cluster and 2 of the nodes use spinning drives and 1
>>> of
>>> them uses SSD,  will the majority of the reads be routed to the SSD node
>>> automatically because it has faster responses?
>>>
>>> TIA,
>>> Elliot
>>>
>>>
>>
>


-- 
Tyler Hobbs
DataStax 

Re: mixed nodes, some SSD some HD

[Elliot Finley]

How does giving the SSD node a higher number of tokens help anything if
it's a 3 node cluster with 3 replicas?



On Wed, Mar 5, 2014 at 3:41 PM, Tyler Hobbs  wrote:

> The dynamic snitch wraps whatever snitch you configure (SimpleSnitch,
> PropertyFileSnitch, etc).
>
> The dynamic snitch *will* favor faster replicas, but it might still
> under-utilize the SSD nodes.  Chris's suggestion to give the SSD nodes a
> higher number of tokens will result in them being replicas for a larger
> portion of the data, so you may still want to do that.
>
>
> On Wed, Mar 5, 2014 at 4:29 PM, Russell Bradberry wrote:
>
>> Are you using the dynamic snitch? Because the SimpleSnitch is the default.
>>
>>
>>
>> On March 5, 2014 at 5:27:03 PM, Elliot Finley (efinley.li...@gmail.com)
>> wrote:
>>
>> Keep in mind, for this 3 node cluster, N = 3.
>>
>> I did a bit more digging and I found this (for future searches on this
>> topic):
>>
>> http://www.datastax.com/documentation/cassandra/2.0/cassandra/architecture/architectureSnitchDynamic_c.html
>>
>> http://www.datastax.com/dev/blog/dynamic-snitching-in-cassandra-past-present-and-future
>>
>> So, according to this, if I'm reading it right, the SSD node WILL take
>> the majority of reads.
>>
>> Any comments welcome.
>>
>>
>>
>> On Wed, Mar 5, 2014 at 10:04 AM, Chris Burroughs <
>> chris.burrou...@gmail.com> wrote:
>>
>>> No.  If you have a heterogeneous clusters you should consider adjusting
>>> the number of vnodes per physical node.
>>>
>>>
>>> On 03/04/2014 10:47 PM, Elliot Finley wrote:
>>>
 Using Cassandra 2.0.x

 If I have a 3 node cluster and 2 of the nodes use spinning drives and 1
 of
 them uses SSD,  will the majority of the reads be routed to the SSD node
 automatically because it has faster responses?

 TIA,
 Elliot


>>>
>>
>
>
> --
> Tyler Hobbs
> DataStax 
>

Re: mixed nodes, some SSD some HD

[Tyler Hobbs]

On Wed, Mar 5, 2014 at 4:48 PM, Elliot Finley wrote:

> How does giving the SSD node a higher number of tokens help anything if
> it's a 3 node cluster with 3 replicas?


Ah, I missed that part.  If the replication factor matches the number of
nodes in the cluster, then you're correct, it doesn't matter what tokens
you assign.


-- 
Tyler Hobbs
DataStax 

Cassandra Internal error processing get_slice java.lang.AssertionError

[Alaa Zubaidi (PDF)]

Hi,

I have a new 8 Node cluster, and when started loading data I see the error
below showing up a lot in 3 of the 8 Nodes:
ERROR [Thrift:65] 2014-03-05 13:19:42,450 Cassandra.java (line 3041)
Internal error processing get_slice
java.lang.AssertionError
at
org.apache.cassandra.db.SliceFromReadCommand.maybeGenerateRetryCommand(SliceFromReadCommand.java:78)
at
org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:724)
at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:564)
at
org.apache.cassandra.thrift.CassandraServer.readColumnFamily(CassandraServer.java:128)
at
org.apache.cassandra.thrift.CassandraServer.getSlice(CassandraServer.java:283)
at
org.apache.cassandra.thrift.CassandraServer.multigetSliceInternal(CassandraServer.java:365)
at
org.apache.cassandra.thrift.CassandraServer.get_slice(CassandraServer.java:326)
at
org.apache.cassandra.thrift.Cassandra$Processor$get_slice.process(Cassandra.java:3033)
at
org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2889)
at
org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:187)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

Any idea?

-- 

Alaa

-- 
*This message may contain confidential and privileged information. If it 
has been sent to you in error, please reply to advise the sender of the 
error and then immediately permanently delete it and all attachments to it 
from your systems. If you are not the intended recipient, do not read, 
copy, disclose or otherwise use this message or any attachments to it. The 
sender disclaims any liability for such unauthorized use. PLEASE NOTE that 
all incoming e-mails sent to PDF e-mail accounts will be archived and may 
be scanned by us and/or by external service providers to detect and prevent 
threats to our systems, investigate illegal or inappropriate behavior, 
and/or eliminate unsolicited promotional e-mails ("spam"). If you have any 
concerns about this process, please contact us at *
*legal.departm...@pdf.com* *.*

Re: Cassandra Internal error processing get_slice java.lang.AssertionError

[Robert Coli]

On Wed, Mar 5, 2014 at 4:35 PM, Alaa Zubaidi (PDF) wrote:

> I have a new 8 Node cluster, and when started loading data I see the error
> below showing up a lot in 3 of the 8 Nodes:
>

What version of cassandra? What mode of thrift server operation, sync or
hsha?

=Rob

Re: mixed nodes, some SSD some HD

[Robert Coli]

On Wed, Mar 5, 2014 at 2:53 PM, Tyler Hobbs  wrote:

>
> Ah, I missed that part.  If the replication factor matches the number of
> nodes in the cluster, then you're correct, it doesn't matter what tokens
> you assign.
>

And you get no benefit from 3x256 vnodes, but you do pay all the penalties
for having them... in order to get benefit from vnodes you have to add a
node such that RF != N

=Rob

Re: Datastax C++ driver on Windows x64

[Robert Coli]

On Wed, Mar 5, 2014 at 1:24 PM, Green, John M (HP Education) <
john.gr...@hp.com> wrote:

> # add_subdirectory(extra/ccm_bridge)   <-- Doesn't work on windows!
>

If CCM doesn't work on Windows, and Cassandra's dtests have CCM as a
dependency, doesn't this mean that Cassandra for Windows is not exercised
by dtests?

This would seem to be a rather serious difference between operating
Cassandra on Windows and on Linux. I already recommend not running
Cassandra on Windows; this information strengthens that view.

=Rob

RE: Datastax C++ driver on Windows x64

[Green, John M (HP Education)]

Just to clarify, do recommend not running Cassandra on Windows or not using the 
client C++ driver from Windows?The former doesn't seem like much of a 
limitation but the latter certainly does.

From: Robert Coli [mailto:rc...@eventbrite.com]
Sent: Wednesday, March 05, 2014 5:02 PM
To: user@cassandra.apache.org
Subject: Re: Datastax C++ driver on Windows x64

On Wed, Mar 5, 2014 at 1:24 PM, Green, John M (HP Education) 
mailto:john.gr...@hp.com>> wrote:
# add_subdirectory(extra/ccm_bridge)   <-- Doesn't work on windows!

If CCM doesn't work on Windows, and Cassandra's dtests have CCM as a 
dependency, doesn't this mean that Cassandra for Windows is not exercised by 
dtests?

This would seem to be a rather serious difference between operating Cassandra 
on Windows and on Linux. I already recommend not running Cassandra on Windows; 
this information strengthens that view.

=Rob

Re: Cassandra Internal error processing get_slice java.lang.AssertionError

[Alaa Zubaidi (PDF)]

Cassandra 1.0.10 with default settings..


On Wed, Mar 5, 2014 at 4:57 PM, Robert Coli  wrote:

> On Wed, Mar 5, 2014 at 4:35 PM, Alaa Zubaidi (PDF) 
> wrote:
>
>> I have a new 8 Node cluster, and when started loading data I see the
>> error below showing up a lot in 3 of the 8 Nodes:
>>
>
> What version of cassandra? What mode of thrift server operation, sync or
> hsha?
>
> =Rob
>
>



-- 

Alaa Zubaidi
PDF Solutions, Inc.
333 West San Carlos Street, Suite 1000
San Jose, CA 95110  USA
Tel: 408-283-5639
fax: 408-938-6479
email: alaa.zuba...@pdf.com

-- 
*This message may contain confidential and privileged information. If it 
has been sent to you in error, please reply to advise the sender of the 
error and then immediately permanently delete it and all attachments to it 
from your systems. If you are not the intended recipient, do not read, 
copy, disclose or otherwise use this message or any attachments to it. The 
sender disclaims any liability for such unauthorized use. PLEASE NOTE that 
all incoming e-mails sent to PDF e-mail accounts will be archived and may 
be scanned by us and/or by external service providers to detect and prevent 
threats to our systems, investigate illegal or inappropriate behavior, 
and/or eliminate unsolicited promotional e-mails ("spam"). If you have any 
concerns about this process, please contact us at *
*legal.departm...@pdf.com* *.*

Re: Datastax C++ driver on Windows x64

[Edward Capriolo]

The vast majority of Java code should be portable. Reiterating "should be".
It sounds like what we need is CCM via ssh.

On Wed, Mar 5, 2014 at 8:07 PM, Green, John M (HP Education) <
john.gr...@hp.com> wrote:

>  Just to clarify, do recommend not running Cassandra on Windows or not
> using the client C++ driver from Windows?The former doesn't seem like
> much of a limitation but the latter certainly does.
>
>
>
> *From:* Robert Coli [mailto:rc...@eventbrite.com]
> *Sent:* Wednesday, March 05, 2014 5:02 PM
> *To:* user@cassandra.apache.org
> *Subject:* Re: Datastax C++ driver on Windows x64
>
>
>
> On Wed, Mar 5, 2014 at 1:24 PM, Green, John M (HP Education) <
> john.gr...@hp.com> wrote:
>
> # add_subdirectory(extra/ccm_bridge)   <-- Doesn't work on windows!
>
>
>
> If CCM doesn't work on Windows, and Cassandra's dtests have CCM as a
> dependency, doesn't this mean that Cassandra for Windows is not exercised
> by dtests?
>
>
>
> This would seem to be a rather serious difference between operating
> Cassandra on Windows and on Linux. I already recommend not running
> Cassandra on Windows; this information strengthens that view.
>
>
>
> =Rob
>
>
>

Re: Noticing really high read latency

[Eric Plowe]

Disregard... heh. Was reading the latency as SECONDS. Sorry, it's been one
of those weeks.


On Wed, Mar 5, 2014 at 1:44 AM, Eric Plowe  wrote:

> Background info:
>
> 6 node cluster.
> 24 gigs of ram per machine
> 8 gigs of ram dedicated to c*
> 4 4 core cpu's
> 2 250 gig SSD's raid 0
> Running c* 1.2.6
>
> The CF is configured as followed
>
> CREATE TABLE behaviors (
>   uid text,
>   buid int,
>   name text,
>   expires text,
>   value text,
>   PRIMARY KEY (uid, buid, name)
> ) WITH
>   bloom_filter_fp_chance=0.01 AND
>   caching='KEYS_ONLY' AND
>   comment='' AND
>   dclocal_read_repair_chance=0.00 AND
>   gc_grace_seconds=864000 AND
>   read_repair_chance=0.10 AND
>   replicate_on_write='true' AND
>   populate_io_cache_on_flush='false' AND
>   compaction={'sstable_size_in_mb': '160', 'class':
> 'LeveledCompactionStrategy'} AND
>   compression={'sstable_compression': 'SnappyCompressor'};
>
> I am noticing that the read latency is very high considering when I look
> at the output of nodetool cfstats.
>
> This is the example output of one of the nodes:
>
>   Column Family: behaviors
> SSTable count: 2
> SSTables in each level: [1, 1, 0, 0, 0, 0, 0, 0, 0]
> Space used (live): 171496198
> Space used (total): 171496591
> Number of Keys (estimate): 1153664
> Memtable Columns Count: 14445
> Memtable Data Size: 1048576
> Memtable Switch Count: 1
> Read Count: 1894
> Read Latency: 0.497 ms.
> Write Count: 7169
> Write Latency: 0.041 ms.
> Pending Tasks: 0
> Bloom Filter False Positives: 4
> Bloom Filter False Ratio: 0.00862
> Bloom Filter Space Used: 3533152
> Compacted row minimum size: 125
> Compacted row maximum size: 9887
> Compacted row mean size: 365
>
> The write latency is awesome, but the read latency, not so much. The
> output of iostat doesn't show anything out of the ordinary. The cpu
> utilization is between 1% to 5%.
>
> All read queries are issued with a CL of ONE. We always include "WHERE uid
> = ''" for the queries.
>
> If there is any more info I can provide, please let me know. At this point
> in time, I am a bit stumped.
>
> Regards,
>
> Eric Plowe
>
>
>
>

Re: mixed nodes, some SSD some HD

[Elliot Finley]

What are the penalties for having them?



On Wed, Mar 5, 2014 at 5:59 PM, Robert Coli  wrote:

> On Wed, Mar 5, 2014 at 2:53 PM, Tyler Hobbs  wrote:
>
>>
>> Ah, I missed that part.  If the replication factor matches the number of
>> nodes in the cluster, then you're correct, it doesn't matter what tokens
>> you assign.
>>
>
> And you get no benefit from 3x256 vnodes, but you do pay all the penalties
> for having them... in order to get benefit from vnodes you have to add a
> node such that RF != N
>
> =Rob
>
>
>

Re: Cassandra Internal error processing get_slice java.lang.AssertionError

[Jacob Rhoden]

If this is a _new_ 8 node cluster, is there a specific reason you starting with 
1.0.x, not 1.2.x? (Upgrading later will be more work)

__
Sent from iPhone

> On 6 Mar 2014, at 9:22 am, "Alaa Zubaidi (PDF)"  wrote:
> 
> Cassandra 1.0.10 with default settings..
> 
> 
>> On Wed, Mar 5, 2014 at 4:57 PM, Robert Coli  wrote:
>>> On Wed, Mar 5, 2014 at 4:35 PM, Alaa Zubaidi (PDF)  
>>> wrote:
>>> I have a new 8 Node cluster, and when started loading data I see the error 
>>> below showing up a lot in 3 of the 8 Nodes:
>> 
>> What version of cassandra? What mode of thrift server operation, sync or 
>> hsha?
>> 
>> =Rob
> 
> 
> 
> -- 
> Alaa Zubaidi
> PDF Solutions, Inc.
> 333 West San Carlos Street, Suite 1000
> San Jose, CA 95110  USA
> Tel: 408-283-5639
> fax: 408-938-6479
> 
> email: alaa.zuba...@pdf.com 
> 
> This message may contain confidential and privileged information. If it has 
> been sent to you in error, please reply to advise the sender of the error and 
> then immediately permanently delete it and all attachments to it from your 
> systems. If you are not the intended recipient, do not read, copy, disclose 
> or otherwise use this message or any attachments to it. The sender disclaims 
> any liability for such unauthorized use. PLEASE NOTE that all incoming 
> e-mails sent to PDF e-mail accounts will be archived and may be scanned by us 
> and/or by external service providers to detect and prevent threats to our 
> systems, investigate illegal or inappropriate behavior, and/or eliminate 
> unsolicited promotional e-mails (“spam”). If you have any concerns about this 
> process, please contact us at legal.departm...@pdf.com.