a search engine.
Personally for what you are asking I would use Pig and stock that in CF. I
would update those CF regularly. For simple statistics you can generate them
with your favorite language or a specialized language such as R as long as
it concerns small sets.
Hope it helps,
Victor Kabdebon
2011/6
Ok thanks for the update. I thought the query string was translated to
Thrift, then send to a server.
Victor Kabdebon
2011/6/15 Eric Evans
> On Tue, 2011-06-14 at 09:49 -0400, Victor Kabdebon wrote:
> > Actually from what I understood (please correct me if I am wrong) CQL
> &
Hello Markus,
Actually from what I understood (please correct me if I am wrong) CQL is
based on Thrift / Avro.
Victor Kabdebon
2011/6/14 Markus Wiesenbacher | Codefreun.de
>
> Hi,
>
> what is the future API for Cassandra? Thrift, Avro, CQL?
>
> I just released an early
Again I don't really know the specifics of Solandra but in Solr (so Solandra
being a cousin of Solr it should be true too) you have XML fields like this
:
Just turn indexed to false and it's not going to be indexed...
Thrift won't affect Solandra at all.
2011/6/4 Jean-Nicolas Boulay Desjardins
some fields.
Victor Kabdebon
http://www.victorkabdebon.com
2011/6/4 Jean-Nicolas Boulay Desjardins
> Hi,
>
> I am planning to use Cassandra to store my users passwords and at the same
> time data for my website that need to be accessible via search. My Question
> is should I use tw
a for long term storage. Here is an example with Redis :
http://redis.io/commands/append
The "append" command is said to be in O(1) but it is a little bit suspicious
to me...
Best regards,
Victor Kabdebon
http://www.voxnucleus.fr
2011/5/31 Jonathan Ellis
> On Tue, May 31, 2011 at 2:22
me.
Again just experiment and be ready to change your organization if you begin
with Cassandra, this is the best way to figure out what to do for your data
organization.
Victor Kabdebon
http://www.voxnucleus.fr
http://www.victorkabdebon.net
2011/5/24 Jian Fang
> Does anyone have a good sug
Thank you, I will look into that and I will probably wait until there is an
"out of the box" comparator. But it's an excellent new feature !
Regards,
Victor K.
2011/5/5 Eric Evans
> On Thu, 2011-05-05 at 10:49 -0400, Victor Kabdebon wrote:
> > Hello Eric,
> >
>
Hello Eric,
Compound columns seem to be a very interesting feature. Do you have any idea
in which Cassandra version it is going to be introduced : 0.8.X or 0.9.X ?
Thanks,
Victor
2011/5/5 Eric Evans
> On Thu, 2011-05-05 at 18:19 +0800, Guofeng Zhang wrote:
> > I read the CQL v1.0 document. Th
ite needed. Now I found an
alternative I use : Cassandra (data vault) + Redis (Sessions and other
volatile data) + SolR (Search engine) + PostGreSQL ( for relational
queries).
Best regards,
Victor Kabdebon
http://www.voxnucleus.fr
2011/4/13 Edward Capriolo
> On Wed, Apr 13, 2011 at 10:39 AM, Jea
And about the production 7Gb or RAM is sufficient ? Or 11 Gb is the minimum
?
Thank you for your inputs for the JVM I'll try to tune that
2011/4/4 Peter Schuller
> > You can change VM settings and tweak things like memtable thresholds
> > and in-memory compaction limits to get it down and get a
ode to standard if you want to reduce the overall memory
> usage.
>
> Aaron
>
> On 18 Feb, 2011,at 09:34 AM, Victor Kabdebon
> wrote:
>
> Sorry I forgot to say that this is the partial result of :
> ps aux | grep cassandra
>
> Best regards
>
> 2011/2/17
Sorry I forgot to say that this is the partial result of :
ps aux | grep cassandra
Best regards
2011/2/17 Victor Kabdebon
> Oh right but Cassandra doesn't really respect that, I thought there was
> another option to set that.
>
> Just for your information, I set xms and xm
my result :
105 26115 0.2 27.3 1125328 755316 ? Sl Feb09 23:58
/usr/bin/java -ea -Xms64M -Xmx128M
2011/2/17 Aaron Morton
> bin/cassandra.in.sh
> set Xms and Xmx in the JVM_OPTS
>
> Aaron
>
>
> On 18 Feb, 2011,at 09:10 AM, Victor Kabdebon
> wrote:
>
&
Is it possible to change the maximum JVM heap memory use in 0.6.X ?
2011/2/17 Aaron Morton
> What are you using for disk_access_mode ?
> Have you tried reducing the JVM head size?
> Have you added the Jna.jar file to lib/ ? This will allow Cassandra to lock
> the JVM memory.
>
>
> Aaron
>
>
> On
Thanks robert, and do you know if there is a way to control the maximum
likely number of memtables ? (I'd like to cap it at 2)
2011/2/16 Robert Coli
> On Wed, Feb 16, 2011 at 7:12 AM, Victor Kabdebon
> wrote:
> > Someone please correct me if I am wrong, but I think the
Someone please correct me if I am wrong, but I think the overhead you can
expect is something like :
16* MemTableThroughtPutInMB
but I don't know when BinaryMemTableThroughputInMb come into account..
2011/2/16 ruslan usifov
>
>
> 2011/2/16 Victor Kabdebon
>
>
>>
Yes I didn't see there was 2 different parameters. I was personally setting
( in cassandra 0.6.6 ) MemTableThoughputInMB, but I don't know what
BinaryMemtableThroughtputInMB is.
And I take this opportunity to ask a question :
If you have a small amount of data per key so that your memtable is mayb
Looks like your wish has been granted.
2011/2/15 Chris Goffinet
> I would like to subscribe to your newsletter.
>
> On Tue, Feb 15, 2011 at 8:04 AM, A J wrote:
>
>>
>>
>
t it might give you ideas on how to deal with
that problem (I am not sure that DB are the best way to deal with that...
but it's just my opinion).
Victor Kabdebon
http://www.voxnucleus.fr
2011/2/15 Sasha Dolgy
> thanks for the response. thinking about this, this would not allow fo
Yes i have done a mistake I know ! But I hoped nobody would notice :).
It is the odds of winning 3 days in a row (standard probability fail). Still
it is totally unlikely
Sorry about this mistake,
Best regards,
Victor K.
etting rid of used memory ... I really am puzzled. (by
the way it is not a Amazon EC2 server this is a dedicated server).
Regards,
Victor K.
2011/2/8 Edward Capriolo
> On Tue, Feb 8, 2011 at 4:56 PM, Victor Kabdebon
> wrote:
> > I will do that in the future and I will post my res
non-heap memory on a 0.7 box I have is around 27M. You numbers seem
> large but it would be interesting to know what the JVM is reporting.
>
> Aaron
>
> On 09 Feb, 2011,at 05:57 AM, Victor Kabdebon
> wrote:
>
> Information on the system :
>
> *Debian 5*
> *Jvm :*
>
Information on the system :
*Debian 5*
*Jvm :*
victor@testhost:~/database/apache-cassandra-0.6.6$ java -version
java version "1.6.0_22"
Java(TM) SE Runtime Environment (build 1.6.0_22-b04)
Java HotSpot(TM) 64-Bit Server VM (build 17.1-b03, mixed mode)
*RAM :* 2Go
2011/2/8 Victo
're getting your numbers
> from.
>
> On Tue, Feb 8, 2011 at 9:32 AM, Victor Kabdebon
> wrote:
> > It is really weird that I am the only one to have this issue.
> > I restarted Cassandra today and already the memory compution is over the
> > limit :
> >
>
.jar:bin/../lib/uuid-3.1.jar
org.apache.cassandra.thrift.CassandraDaemon
It is really an annoying problem if we cannot really foresee memory
consumption.
Best regards,
Victor K
2011/2/8 Victor Kabdebon
> Dear all,
>
> Sorry to come back again to this point but I am really worried about
&g
m ? Bad garbage
collection ? Something that I ignore ?
Thank you for your help I really need to get rid of that problem.
Best regards,
Victor Kabdebon
lottery for 1e11 days in a row ( for 270 million years).
Well if you do have a collision you should play the lottery :).
Best regards,
Victor Kabdebon
http://www.voxnucleus.fr
2011/2/7 Kallin Nagelberg
> Hey,
>
> I am developing a session management system using Cassandra and need
>
ong)
Columns : {
name
other fields
update time (long [date])
...}
CF2 : "ObjectOrder"
Key : "myorderedobjects
Column:{
{ name : identifier that can be sorted
value :ObjectID},
...
}
Best regards,
Victor Kabdebon,
http://www.voxnucleus.fr
2011/2/5 Raj Bakhru
Dear Brendan,
I would really be interested by your findings too. I need a system to store
various documents, I am thinking of Cassandra (that I am already using) or
using a second type of database or any other system. Maybe like dan
suggested, using mogilefs.
Thank you,
Victor Kabdebon
http
Buddasystem is right.
A count returns columns to the client which count it. My advice : do not
count big columns / supercolumns. People in the dev team are trying to
develop distributed counters but I don't know the state of this research.
Best regards,
Victor Kabdebon
http://www.voxnucle
Dear Sasha,
I am currently thinking about using secondary index in the future. I have
seen two pros :
_Simplicity, it is "more simple" to query based on a second index than going
for a first column then a second.
_ "Consistency" : depending on where you store your inverted index, it may
be unavail
Peter : What do you recommand ? using Aaron Morton solution and using JNA or
just disable mmap ? (Or is it the same and I missed something ?)
Thank you all for your advice, I am surprised to be the only one to have
this problem even if I'm using a pretty standard distribution.
Best regards,
Victo
Thank you very much,
Best Regards,
Victor Kabdebon
PS : memory consumption :
root 19093 0.1 35.8 *1362108 722312* ? Sl Jan11 14:01
/usr/bin/java -ea -Xms128M -Xmx512M -XX:+UseParNewGC -XX:+UseConcMarkSweepGC
-XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringT
Comparator comparates only the column inside a Key.
Key sorting is done by your partitionner.
Best regards,
Victor Kabdebon
2011/1/16 kh jo
> I am having some problems with creating column families and sorting them,
>
> I want to create a countries column family where I can get a so
Capriolo
> wrote:
> > On Fri, Jan 14, 2011 at 2:13 PM, Victor Kabdebon
> > wrote:
> >> Dear rajat,
> >>
> >> Yes it is possible, I have the same constraints. However I must warn
> you,
> >> from what I see Cassandra memory consumption is not boun
Dear rajat,
Yes it is possible, I have the same constraints. However I must warn you,
from what I see Cassandra memory consumption is not bounded in 0.6.X on
debian 64 Bit
Here is an example of an instance launch in a node :
root 19093 0.1 28.3 1210696 *570052* ? Sl Jan11 9:08
/usr
Same here Hector + java
Best Regards,
Victor K
2011/1/14 Ran Tavory
> Java
> On Jan 14, 2011 8:25 PM, "Ertio Lew" wrote:
> > what is the technology stack do you use?
> >
> > On 1/14/11, Ran Tavory wrote:
> >> I use Hector, if that counts. ..
> >> On Jan 14, 2011 7:25 PM, "Ertio Lew" wrote:
>
gosh, sorry for the mistakes I am tired !
Victor K.
2011/1/14 Victor Kabdebon
> I personnally did it the other way around : from Cassandra to PostGreSQL, I
> needed an hybrid system : Cassandra solidly holds all data while PostGreSQL
> holds fewer data but request are simple and
I personnally did it the other way around : from Cassandra to PostGreSQL, I
needed an hybrid system : Cassandra solidly holds all data while PostGreSQL
holds fewer data but request are simple and efficient ( with SELECT WHERE).
This is pretty easy once you master key browsing and iterating.
I thin
Ok thank you very much for these information !
If somebody has more insights on this matter I am still interested !
Victor K.
2011/1/13 Ryan King
> On Thu, Jan 13, 2011 at 2:44 PM, Victor Kabdebon
> wrote:
> > Is there any recommanded maximum size for a Column ? (not the very upp
Is there any recommanded maximum size for a Column ? (not the very upper
limit which is 2Gb)
Why is it useful to chunk the content into multiple columns ?
Thank you,
Victor K.
2011/1/13 Ryan King
> On Thu, Jan 13, 2011 at 2:38 PM, Victor Kabdebon
> wrote:
> > Dear all,
> &
Dear all,
In a project I would like to store "big" objects in columns, serialized. For
example entire images (several Ko to several Mo), flash animations (several
Mo) etc...
Does someone use Cassandra with those relatively big columns and if yes does
it work well ? Is there any drawbacks using thi
Hello Peter,
So more information on that problem :
Yes I am using this node with very few data, it is used to design requests
so I don't need a very large dataset.
I am running Apache Cassandra 0.6.6 on a Debian Stable, with java version
"1.6.0_22".
I recently restarted cassandra, thus I have thi
Hello everybody,
I actually have the exact same problem. I have very little amount of data (
few hundred kb) and the memory consumption goes up without any end. in
sight. For
On my node I have limited ram ( 2 Gb) to run cassandra, but since I have
very little data, I fought it was not a problem, h
45 matches
Mail list logo
