Build Cassandra under Windows

2011-09-23 Thread Viktor Jevdokimov
Hello, I'm trying to build Cassandra 0.8 and 1.0.0 branches with no success on Windows, getting errors: ... maven-ant-tasks-retrieve-build: [artifact:dependencies] Downloading: asm/asm/3.2/asm-3.2-sources.jar from repository central at http://repo1.maven.org/maven2 [artifact:dependencies] Unable

Re: is it possible for light-traffic CF to hold down many commit logs?

2011-09-23 Thread Sylvain Lebresne
In 1.0.0, you have: # Total space to use for commitlogs. # If space gets above this value (it will round up to the next nearest # segment multiple), Cassandra will flush every dirty CF in the oldest # segment and remove it. # commitlog_total_space_in_mb: 4096 In 0.8, you're supposed to use the me

Re: is it possible for light-traffic CF to hold down many commit logs?

2011-09-23 Thread Yang
Thanks Sylvain, this is exactly what I need. On Fri, Sep 23, 2011 at 12:10 AM, Sylvain Lebresne wrote: > In 1.0.0, you have: > > # Total space to use for commitlogs. > # If space gets above this value (it will round up to the next nearest > # segment multiple), Cassandra will flush every dirty

Re: MessagingService.sendOneWay sending blank bytes?

2011-09-23 Thread Jonathan Ellis
Yes. This is one of the things fixed for 1.0 in https://issues.apache.org/jira/browse/CASSANDRA-1788 On Thu, Sep 22, 2011 at 11:16 PM, Greg Hinkle wrote: > I noticed that on the 0.8 branch the implementation of > MessagingService.sendOneWay is building up a DataOutputBuffer with a default > si

Re: Performance degradation observed through embedded cassandra server - pointers needed

2011-09-23 Thread Roshan Dawrani
Thanks for sharing your inputs, Edward. Some comments inline below: On Thu, Sep 22, 2011 at 7:31 PM, Edward Capriolo wrote: > > >> 1) Should should try to dig in an determine why the truncate is slower. > Look for related jira issues on truncation. > I should give it a try. I thought I might get

RE: Build Cassandra under Windows

2011-09-23 Thread Viktor Jevdokimov
Spolved - just used appropriate ant's targets to get jars built. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063. Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania [cid:signature-logo793c.png]

Re: shutdown by drain

2011-09-23 Thread Radim Kolar
Dne 10.9.2011 21:48, Chris Goffinet napsal(a): For things like rolling restarts, we do: disablethrift disablegossip (...wait for all nodes to see this node go down..) drain I discovered problem with this advice. If i do nodetool drain before killing node nodetool returns just after flush and

RE: How to enable JNA for Cassandra on Windows?

2011-09-23 Thread Viktor Jevdokimov
I found that there's no C library under Windows, and msvcrt does not provide mlockall function, so currently there's no way to use JNA under Windows. That way mmap is not a good idea? Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phon

Re: Storing (python) objects

2011-09-23 Thread David Allsopp
We have done exactly as you describe (nested dicts etc) - works fine as long as you are happy to read the whole lump of data, i.e. don't need to read at a finer granularity. This approach can also save a lot of storage space as you don't have the overhead of many small columns. Some folks also wri

RE: shutdown by drain

2011-09-23 Thread Viktor Jevdokimov
More of it, Cassandra 0.8.6 still leaves all commit logs under Windows. Best regards/ Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063 Fax: +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Disclaimer: The information contai

Re: LevelDB type compaction

2011-09-23 Thread Sam Overton
On 17 September 2011 00:58, mcasandra wrote: > > > >> and updates could be scattered all over > >> before compaction? > > > > No, updates to a given row will be still be in a single sstable. > > Can you please explain little more? You mean that if Level 1 file contains > range from 1-100 all the

Re: shutdown by drain

2011-09-23 Thread Sylvain Lebresne
On Fri, Sep 23, 2011 at 11:04 AM, Radim Kolar wrote: > Dne 10.9.2011 21:48, Chris Goffinet napsal(a): >> >> For things like rolling restarts, we do: >> >> disablethrift >> disablegossip >> (...wait for all nodes to see this node go down..) >> drain > > I discovered problem with this advice. > > If

Compression in v1.0

2011-09-23 Thread David McNelis
I just read through the DataStax compression post ( http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-0-compression). My question is around good use cases for enabling compression. In my scenario I have very wide rows with many thousands of columns where its essentially time-series inform

Re: Build Cassandra under Windows

2011-09-23 Thread Jonathan Ellis
What was the target you were using that didn't work? On Fri, Sep 23, 2011 at 5:00 AM, Viktor Jevdokimov < viktor.jevdoki...@adform.com> wrote: > Spolved – just used appropriate ant‘s targets to get jars built. > > ** ** > ** > > ** ** > > Best regards/ Pagarbiai > > ** ** > > *Viktor Jevd

Re: How to enable JNA for Cassandra on Windows?

2011-09-23 Thread Jonathan Ellis
mmap is supported by the JDK, jna is not required. On Fri, Sep 23, 2011 at 5:07 AM, Viktor Jevdokimov < viktor.jevdoki...@adform.com> wrote: > I found that there‘s no C library under Windows, and msvcrt does not > provide mlockall function, so currently there‘s no way to use JNA under > Windows.

Re: MessagingService.sendOneWay sending blank bytes?

2011-09-23 Thread Greg Hinkle
Is it worth a back-port or at least switch to asByteArray for 0.8.7? It's a sizable amount of wasted network traffic and the fix seems pretty safe. (It's working for me) Greg Hinkle On Sep 23, 2011, at 3:32 AM, Jonathan Ellis wrote: > Yes. This is one of the things fixed for 1.0 in > https://

Re: user Digest 23 Sep 2011 12:49:40 -0000 Issue 1371

2011-09-23 Thread David Semeria
user-digest-h...@cassandra.apache.org wrote: > >user Digest 23 Sep 2011 12:49:40 - Issue 1371 > >Topics (messages 20995 through 21004): > >Re: shutdown by drain > 20995 by: Radim Kolar > 20998 by: Viktor Jevdokimov > 21001 by: Sylvain Lebresne > >Re: How to enable JNA for C

Re: Storing (python) objects

2011-09-23 Thread Koert Kuipers
i would advise not to use a language specific storage format, you might regret it later on if you want to add an application to your system that is written in anything else than python. i mean python is great, but it is not necessary the right tool for every job look at thrift/protobuf/avro/bson/j

Re: Storing (python) objects

2011-09-23 Thread Tristan Seligmann
On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc wrote: > For data accessed through a single path, I use the same trick: pickle, bz2 > and insert. Note that unpickling a pickle in Python involves a) arbitrary code execution, and b) relies on your code being the same (or close enough) to what it wa

Bulk uploader issue on multi-node cluster

2011-09-23 Thread Thamizh
Hi All, I am using bulk-loading to upload data(from lab02) to multi-node cluster of 3 machines(lab02,lab03 & lab04) with sigle ethernet card. I have created SSTable instance on lab02 by duplicating look back address( sudo ifconfig lo:2 127.0.0.2 netmask 255.0.0.0 up; ) "127.0.0.2" as rpc and st

Re: Bulk uploader issue on multi-node cluster

2011-09-23 Thread Benoit Perroud
On the sstableloader config, make sure you have the seed set and rpc_address and rpc_port pointing to your cassandra instance (127.0.0.2) 2011/9/23 Thamizh > Hi All, > > I am using bulk-loading to upload data(from lab02) to multi-node cluster of > 3 machines(lab02,lab03 & lab04) with sigle eth

Re: Storing (python) objects

2011-09-23 Thread Ian Danforth
Good feedback from all. Thanks! Ian On Fri, Sep 23, 2011 at 7:48 AM, Tristan Seligmann wrote: > On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc wrote: > > For data accessed through a single path, I use the same trick: pickle, > bz2 > > and insert. > > Note that unpickling a pickle in Python inv

Re: MessagingService.sendOneWay sending blank bytes?

2011-09-23 Thread Jonathan Ellis
The full backport is beyond the scope of what I'm comfortable in a stable release series, but the asByteArray fix sounds reasonable to me. Can you create a ticket + patch? On Fri, Sep 23, 2011 at 8:04 AM, Greg Hinkle wrote: > Is it worth a back-port or at least switch to asByteArray for 0.8.7? I

Re: [VOTE] Release Mojo's Cassandra Maven Plugin 0.8.6-1

2011-09-23 Thread Stephen Connolly
This vote has passed: +1: Me, Colin & Nate 0: -1: I will proceed with the release -Stephen On 20 September 2011 15:27, Stephen Connolly wrote: > Hi, > > I'd like to release version 0.8.6-1 of Mojo's Cassandra Maven Plugin > to sync up with the recent 0.8.6 release of Apache Cassandra. > > > We

Increasing thrift_framed_transport_size_in_mb

2011-09-23 Thread Sanjeev Kulkarni
Hey guys, Are there any side-effects of increasing the thrift_framed_transport_size_in_mb and thrift_max_message_length_in_mb variables from their default values to something like 100mb? Thanks!

Re: Storing (python) objects

2011-09-23 Thread Edward Capriolo
On Fri, Sep 23, 2011 at 1:41 PM, Ian Danforth wrote: > Good feedback from all. Thanks! > > Ian > > On Fri, Sep 23, 2011 at 7:48 AM, Tristan Seligmann < > mithra...@mithrandi.net> wrote: > >> On Fri, Sep 23, 2011 at 1:09 AM, Alexis Lê-Quôc >> wrote: >> > For data accessed through a single path, I

ColumnFamily per Index?

2011-09-23 Thread Ron Siemens
I have a column family for my main data, and I have been using an additional column family to store indexes to the data: row per index style. I now want to be able to update a set of indexes by the field being indexed on. To access that set, I can maintain meta indexes for each field, or I can

Re: ColumnFamily per Index?

2011-09-23 Thread Edward Capriolo
On Fri, Sep 23, 2011 at 5:28 PM, Ron Siemens wrote: > > I have a column family for my main data, and I have been using an > additional column family to store indexes to the data: row per index style. > > I now want to be able to update a set of indexes by the field being indexed > on. To access t

Re: Increasing thrift_framed_transport_size_in_mb

2011-09-23 Thread Jonathan Ellis
Really large messages are not encouraged because they will fragment your heap quickly. Other than that, no. On Fri, Sep 23, 2011 at 3:40 PM, Sanjeev Kulkarni wrote: > Hey guys, > Are there any side-effects of increasing > the thrift_framed_transport_size_in_mb and thrift_max_message_length_in_mb