Re: [ANNOUNCEMENT] Website update

2016-09-12 Thread Brice Dutheil
Really nice update ! There's still some todos ;) http://cassandra.apache.org/doc/latest/architecture/storage_engine.html http://cassandra.apache.org/doc/latest/architecture/guarantees.html http://cassandra.apache.org/doc/latest/operating/read_repair.html ... -- Brice On Mon, Sep 12, 2016 at 6:

cql-maven-plugin

2016-10-07 Thread Brice Dutheil
Hi there, I’d like to share a very simple project around handling CQL files with maven. We were using the cassandra-maven-plugin before, but with limitations on the authentication and the use of thrift protocol. I was tempted to write a replacement focused only the execution of CQL statements, in

Re: cql-maven-plugin

2016-10-07 Thread Brice Dutheil
On Fri, Oct 7, 2016 at 2:40 PM, Brice Dutheil > wrote: > >> Hi there, >> >> I’d like to share a very simple project around handling CQL files with >> maven. We were using the cassandra-maven-plugin before, but with >> limitations on the authentication and the u

Re: Data migration from Oracle to Cassandra

2016-11-21 Thread Brice Dutheil
Hi Shashidhar, I have done something like that at reasonably high scale, migrating a few billions of Oracle records to Cassandra. Basically the process we used is : the app will perform the write in cassandra for new or updated records, the batch will backfeed old data in cassandra. We wrote eve

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-21 Thread Brice Dutheil
The problem described in this article is different than what you have on your servers and I’ll add this article should be reaad with caution, as The Register is known for sensationalism. The article itself has no substantial proof or enough details. In my opinion this article is clickbait. Anyway

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-21 Thread Brice Dutheil
better to stay away from Oracle as we never know when they > would switch open source to closed source. Given their history of practices > their statements are not credible. > > I am pretty sure the community would take care of OpenJDK. > > > > > > On Wed, Dec 21, 20

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-22 Thread Brice Dutheil
Pretty much a non-story, it seems like. Clickbait imho. Search ‘The Register’ in this wikipedia page @Ben Manes Agreed, OpenJDK and Oracle JDK are now pretty close, but there is still some differences in the VM c

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2016-12-26 Thread Brice Dutheil
the same thing. >>>>> >>>>> "I don't really have any opinions on Oracle per say, but Cassandra is >>>>> a >>>>> Free Software project and I would prefer that we not depend on >>>>> commercial software, (a

Re: Why does Cassandra recommends Oracle JVM instead of OpenJDK?

2017-02-13 Thread Brice Dutheil
The Android battle is another thing that I wouldn't consider for OracleJDK / OpenJDK. While I do like what Google did from a technical point of view, Google may have overstepped fair use (or not – I don't know). Anyway Sun didn't like what Google did, they probably considered going to court at that

BATCH consistency level VS. individual statement consistency level

2015-07-06 Thread Brice Dutheil
Hi, I’m not sure how consistency level is applied on batch statement. I didn’t found detailed information on datastax.com (1) regarding that. - It is possible to set a CL on individual statements. - It is possible to set a

Re: Realtime data and (C)AP

2015-10-09 Thread Brice Dutheil
On Fri, Oct 9, 2015 at 2:27 AM, Steve Robenalt wrote: In general, if you write at QUORUM and read at ONE (or LOCAL variants > thereof if you have multiple data centers), your apps will work well > despite the theoretical consistency issues. Nit-picky comment : if consistency is something importa

Re: Cassandra query degradation with high frequency updated tables.

2015-10-10 Thread Brice Dutheil
What do you mean by that *And since this is a test , this is just running on a single node.* ? What is the hardware spec ? Also from the schema in CASSANDRA-10502 there’s a lot of maps, what is the size fo these maps ? I’ve seen cassandra hav

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Brice Dutheil
Additionally if the time uuid is generated client side, make sure the boxes that will perform the write hava correct ntp/ptp configuration. @John Haddad Keep in mind that in a distributed environment you probably have so much variance that nanosecond precision is pointless. Even google notes that

Re: Oracle TIMESTAMP(9) equivalent in Cassandra

2015-10-29 Thread Brice Dutheil
e, it's > unlikely to be happening anywhere. The fact that dapper was written in the > context of tracing is irrelevant. > On Thu, Oct 29, 2015 at 7:27 PM Brice Dutheil > wrote: > >> Additionally if the time uuid is generated client side, make sure the >> boxes that w

Re: Cassandra Java Driver

2015-12-26 Thread Brice Dutheil
Not yet. The latestest DSE (4.8.3) is shipped with a patched version of Cassandra 2.11. You can find this information on their website. 4.8 Release note : https://docs.datastax.com/en/datastax_enterprise/4.8/datastax_enterprise/RNdse.html >From this page in the menu you can navigate and unroll the

Re: NTP Synchronization Setup Changes

2016-03-31 Thread Brice Dutheil
Hi another tip, make sure the OS doesn't come with pre-configured NTP synchronisation services. We had a proper NTP setup, but we missed a service that came with CentOS that synced to a low stratum NTP server. -- Brice On Thu, Mar 31, 2016 at 10:00 AM -0700, "Eric Evans" wrote: On

Re: Copy from CSV on OS X problem with varint values <= -2^63

2017-04-07 Thread Brice Dutheil
@Boris, what formula did you use on homebrew and what is the git version of this formula ? Anyway the current cassandra formula is here : https://github.com/Homebrew/homebrew-core/blob/master/Formula/cassandra.rb I am not a Homebrew developper, the formula does a lot of facy stuff, yet I see a re

Re: Help with approach to remove RDBMS schema from code to move to C*?

2014-09-20 Thread Brice Dutheil
I’m fairly new to cassandra, but here’s my input. Think of your column families as a projection of how the application needs them. Thinking with CQRS in mind helps. So with more CFs that may require more space, as data may be written differently in different column families for different usage. Fo

Re: using dynamic cell names in CQL 3

2014-09-26 Thread Brice Dutheil
I’m not sure I understand correctly “for example column.name would be event_name("temperature")“, what I gather however is that you have multiple events that may or may not have certain properties, in your example I believe you mean you want a CF for events with a type event_name that contains a co

Re: Repair taking long time

2014-09-26 Thread Brice Dutheil
Unfortunately DSE 4.5.0 is still on 2.0.x -- Brice On Fri, Sep 26, 2014 at 7:40 PM, Jonathan Haddad wrote: > Are you using Cassandra 2.0 & vnodes? If so, repair takes forever. > This problem is addressed in 2.1. > > On Fri, Sep 26, 2014 at 9:52 AM, Gene Robichaux > wrote: > > I am fairly new

Re: paging through an entire table in chunks?

2014-09-29 Thread Brice Dutheil
You may be using the async feature of the java driver. In order to manage complexity related to do several queries I used RxJava, it leverages readability and asynchronicity in a very elegant way (much

Re: Better option to load data to cassandra

2014-11-12 Thread Brice Dutheil
On our project we wrote ourself a custom batch to load the data to cassandra the way we wanted. -- Brice On Tue, Nov 11, 2014 at 2:33 PM, srinivas rao wrote: > hi Alexey, > > i tried with sqoop, and data stax copy command. any other options we can > use. > > i have one more question that, have

Re: CQL 3.x Update ...USING TIMESTAMP...

2015-03-13 Thread Brice Dutheil
I agree with Tyler, in the normal run of a live application I would not recommend the use of the timestamp, and use other ways to *version* *inserts*. Otherwise you may fall in the *upsert* pitfalls that Tyler mentions. However I find there’s a legitimate use the USING TIMESTAMP trick, when migrat

Re: Delayed events processing / queue (anti-)pattern

2015-03-27 Thread Brice Dutheil
Would it help here to not actually issue a delete statement but instead use date based compaction and a dynamically calculated ttl that is some safe distance in the future from your key? I’m not sure about about this part *date based compaction*, do you mean DateTieredCompationStrategy ? Anyway w

Re: Frequent timeout issues

2015-04-01 Thread Brice Dutheil
And the keyspace? What is the replication factor. Also how are the inserts done? On Wednesday, April 1, 2015, Amlan Roy wrote: > Write consistency level is ONE. > > This is the describe output for one of the tables. > > CREATE TABLE event_data ( > event text, > week text, > bucket int, >

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
Could it that the app is inserting _duplicate_ keys ? -- Brice On Tue, Apr 21, 2015 at 1:52 PM, Marcus Eriksson wrote: > nope, but you can correlate I guess, tools/bin/sstablemetadata gives you > sstable level information > > and, it is also likely that since you get so many L0 sstables, you wi

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
key across threads -- do u >> think that will cause a problem ? As far as i have read LCS is recommended >> for such cases. should i just switch back to SizeTiredCompactionStrategy. >> >> >> On Tue, Apr 21, 2015 at 6:13 PM, Brice Dutheil >> wrote: >> >>

Re: Handle Write Heavy Loads in Cassandra 2.0.3

2015-04-21 Thread Brice Dutheil
This is an intricate matter, I cannot say for sure what are good parameters from the wrong ones, too many things changed at once. However there’s many things to consider - What is your OS ? - Do your nodes have SSDs or mechanical drives ? How many cores do you have ? - Is it the CPUs

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
y and transactional backbone of choice for the worlds > most innovative companies such as Netflix, Adobe, Intuit, and eBay. > > On Tue, Apr 21, 2015 at 9:06 AM, Brice Dutheil > wrote: > >> I’m not sure I get everything about storm stuff, but my understanding of >> LCS is t

Re: Handle Write Heavy Loads in Cassandra 2.0.3

2015-04-21 Thread Brice Dutheil
ahoo Mail on Android > <https://overview.mail.yahoo.com/mobile/?.src=Android> > -- > *From*:"Brice Dutheil" > *Date*:Tue, 21 Apr, 2015 at 10:22 pm > > *Subject*:Re: Handle Write Heavy Loads in Cassandra 2.0.3 > > This is an intricate matter, I cannot say for sure what are

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-21 Thread Brice Dutheil
, and predictably scalable to any > size. With more than 500 customers in 45 countries, DataStax is the > database technology and transactional backbone of choice for the worlds > most innovative companies such as Netflix, Adobe, Intuit, and eBay. > > On Tue, Apr 21, 2015 at 5:46 PM

Re: LCS Strategy, compaction pending tasks keep increasing

2015-04-22 Thread Brice Dutheil
a new keyspace for him, initially there > will be lots of new keys ( i think size tired might work better here) > -- as time progresses we are going to update the existing keys very > frequently ( i think LCS will work better here -- we are going with this > strategy for long term benefit)

Re: Handle Write Heavy Loads in Cassandra 2.0.3

2015-04-22 Thread Brice Dutheil
andra infact > provides very good wide rows format suitable for time series and other > scenarios. The problem is that when my in_memory_compaction_in_mb limit is > 125 mb why Cassandra is printing "compacting large rows" when row is less > than 100mb. > > > > Thanks