Re: Cassandra 5.0 Beta1 - vector searching results

2024-03-21 Thread Jonathan Ellis
nt5large > order by embeddings ANN OF [768 dimension vector] limit 20; > > Works fine - typically less than 5 seconds to return. Subsequent > queries are even faster. If I'm activity adding data to the table, the > searches can sometimes timeout (using cqlsh). > If I ad

Re: DataStax Accelerate CFP

2020-01-07 Thread Jonathan Ellis
Happy new year, everyone! Reminder, the Accelerate CFP closes in just over two weeks: https://www.datastax.com/blog/2019/11/datastax-accelerate-20-call-papers-now-open On Mon, Nov 11, 2019 at 1:28 PM Jonathan Ellis wrote: > This spring DataStax kicked off Accelerate, a new conference carry

[Announce] DataStax Support for Apache Cassandra, New Tools

2019-12-17 Thread Jonathan Ellis
release are here <https://www.datastax.com/blog/2019/12/tools-for-apache-cassandra>. * -- Jonathan Ellis co-founder, http://www.datastax.com @spyced

DataStax Accelerate CFP

2019-11-11 Thread Jonathan Ellis
x-accelerate-20-call-papers-now-open> . The CFP closes Jan 22. Hope to hear from you soon! -- Jonathan Ellis co-founder, http://www.datastax.com @spyced

Re: Released an ACID-compliant transaction library on top of Cassandra

2018-10-16 Thread Jonathan Ellis
Which was followed up by https://www.researchgate.net/profile/Akon_Dey/publication/282156834_Scalable_Distributed_Transactions_across_Heterogeneous_Stores/links/56058b9608ae5e8e3f32b98d.pdf On Tue, Oct 16, 2018 at 1:02 PM Jonathan Ellis wrote: > It looks like it's based on this

Re: Released an ACID-compliant transaction library on top of Cassandra

2018-10-16 Thread Jonathan Ellis
-- > > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > > For additional commands, e-mail: user-h...@cassandra.apache.org > > > > - > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > For additional commands, e-mail: user-h...@cassandra.apache.org > > -- Jonathan Ellis co-founder, http://www.datastax.com @spyced

Reminder: don't listen on public addresses

2017-01-20 Thread Jonathan Ellis
ublic interfaces. Of course additional security measures are useful as defense in depth, but bottom line if the bad guys can't connect to your cluster they can't harm it. -- Jonathan Ellis co-founder, http://www.datastax.com @spyced

Re: Disabling all caching in Cassandra

2016-06-22 Thread Jonathan Ellis
AND dclocal_read_repair_chance = 0.1 AND default_time_to_live = 0 AND > gc_grace_seconds = 864000 AND max_index_interval = 10240 AND > memtable_flush_period_in_ms = 360 AND min_index_interval = 10240 AND > read_repair_chance = 0.0 AND speculative_retry = '99PERCENTILE' AND caching

Announcement: Thrift API deprecation

2016-01-04 Thread Jonathan Ellis
committed for 3.4. In the meantime, I thought it best to give people more notice rather than less.) [1] https://issues.apache.org/jira/browse/CASSANDRA-10857 -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Cassandra users survey

2015-10-20 Thread Jonathan Ellis
uot;128 GB or more" than I expected. - Including the "both" responses, a majority of users are deploying SSD now. On Wed, Sep 30, 2015 at 1:18 PM, Jonathan Ellis wrote: > With 3.0 approaching, the Apache Cassandra team would appreciate your > feedback as we work on the proj

Re: Cassandra users survey

2015-10-07 Thread Jonathan Ellis
ur application." We have multiple applications > using Cassandra. Are you looking for information about each application > separately, or the sum of all of them? > > Jim > > On Wed, Sep 30, 2015 at 2:18 PM, Jonathan Ellis wrote: > >> With 3.0 approaching, the Apache Ca

Cassandra users survey

2015-09-30 Thread Jonathan Ellis
a few minutes to fill it out! -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Cassandra 2.2, 3.0, and beyond

2015-06-11 Thread Jonathan Ellis
;> instance, including cross-version repair. >> >> What will be the EOL policy for releases after 3.0? Given your example, >> will 3.1 still see bugfixes at this point when I decide to upgrade to 3.7? >> > -- > -- > Daniel > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Cassandra 2.2, 3.0, and beyond

2015-06-11 Thread Jonathan Ellis
As soon as 8099 is done. On Thu, Jun 11, 2015 at 11:53 AM, Pierre Devops wrote: > Hi, > > 3.x beta release date ? > > 2015-06-11 16:21 GMT+02:00 Jonathan Ellis : > >> 3.1 is EOL as soon as 3.3 (the next bug fix release) comes out. >> >> On Thu, Jun 11,

Re: Cassandra 2.2, 3.0, and beyond

2015-06-11 Thread Jonathan Ellis
sly from 3.1 to 3.7, for > instance, including cross-version repair. > > What will be the EOL policy for releases after 3.0? Given your example, > will 3.1 still see bugfixes at this point when I decide to upgrade to 3.7? > -- Jonathan Ellis Project Chair, Apache Cassandra co-fo

Cassandra 2.2, 3.0, and beyond

2015-06-10 Thread Jonathan Ellis
intain the 2.2 stability series until 4.0 is released, and 3.0 for six months after that.Thanks for reading this far, and I look forward to hearing how 2.2rc1 works for you!* -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: How expensive are additional keyspaces?

2014-03-11 Thread Jonathan Ellis
to be in a >> different keyspace from others? Is any sort of file fragmentation >> potentially introduced just by doing this in a new keyspace as opposed >> to an exiting one? >> >> 4) Does it add any metadata overhead to the system keyspace? >> >> 5) Why m

HSHA Thrift server corruption in Cassandra 2.0.0 - 2.0.5

2014-03-08 Thread Jonathan Ellis
tps://issues.apache.org/jira/secure/attachment/12632583/CASSANDRA-6285-disruptor-heap.patch -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: GCInspector GC for ConcurrentMarkSweep running every 15 seconds

2014-02-18 Thread Jonathan Ellis
t. > > flush_largest_memtables_at: 0.75 > reduce_cache_sizes_at: 0.85 > reduce_cache_capacity_to: 0.6 > in_memory_compaction_limit_in_mb: 64 > > Does anyone have any ideas why we are seeing this so selectively on one box? > > Any cures??? > -- > John Pyeatt > Singlewire Softwa

Re: Introducing farsandra: A different way to integration test with c*

2014-01-22 Thread Jonathan Ellis
yaml configurations across versions, fetching binary > cassandra from the internet), but it opens up new opportunities to developer > complicated multi-node testing scenarios which are impossible due to > re-entrant embedded cassandra code! > > Have fun. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Upgrading Cassandra from 1.2.11 to 2.0

2013-11-21 Thread Jonathan Ellis
rName(FBUtilities.java:469) > > at > org.apache.cassandra.locator.AbstractReplicationStrategy.getClass(AbstractReplicationStrategy.java:290) > > at org.apache.cassandra.config.KSMetaData.fromSchema(KSMetaData.java:266) > > ... 6 more > > > > > > Thanks, >

Wiki popularity

2013-11-19 Thread Jonathan Ellis
x27;t already on the wiki contributors whitelist, please contact me. We had to add the whitelist to stop spam. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Failure detection false positives and vnodes

2013-11-05 Thread Jonathan Ellis
lusters as well. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: CQL & Thrift

2013-08-30 Thread Jonathan Ellis
_on_write='true' AND >> populate_io_cache_on_flush='false' AND >> compaction={'class': 'SizeTieredCompactionStrategy'} AND >> compression={'sstable_compression': 'SnappyCompressor'}; >> >> cqlsh:cql3usage> select * from user; >> >> user_id >> - >> @mevivs >> >> >> >> >> >> I understand that, CQL3 and thrift interoperability is an issue. But this >> looks to me a very basic scenario. >> >> >> >> Any suggestions? Or If anybody can explain a reason behind this? >> >> -Vivek >> >> >> >> >> >> > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Dynamic Columns Question Cassandra 1.2.5, Datastax Java Driver 1.0

2013-06-06 Thread Jonathan Ellis
, as each row is not > required to have the same set of columns. Columns and their metadata can be > added by your application as they are needed without incurring downtime to > your application. > > here: http://www.datastax.com/docs/1.2/ddl/index > > Is it a limitation of CQL3 and its connection vs. thrift? > Or more likely i'm just doing something wrong? > > Thanks, > Joe -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Cassandra performance decreases drastically with increase in data size.

2013-05-29 Thread Jonathan Ellis
ache, but does not tell me how to tune it. > > So, my question is, are there any optimizations that I can do to handle > these large datatasets ? > > and why does my performance go back to normal when I restart Cassandra ? > > Thanks ! -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Using CQL to insert a column to a row dynamically

2013-05-27 Thread Jonathan Ellis
ore sense to just stuff into a relational > database? There's nothing wrong with the relational model per se (subject to the usual explanation about needing to denormalize to scale). Cassandra is about making applications scale, not throwing the SQL baby out with the bathwater for the sak

Re: Commit Log Magic

2013-05-23 Thread Jonathan Ellis
s Cassandra because it perform I/O to > insert data on disk and Cassandra also perform's I/O to insert data on > commit log. Is commit log is less expensive ? I didn't really understood the > magic :) Would you like to elaborate it more ? > > Thank you in advance

Re: CQL3 question

2013-05-13 Thread Jonathan Ellis
the columns limit is 20 billion, how can this > be avoided. I do not understand how CQL3 unpacking helps in this situation? > > Sorry for any inconvenience :) > > Thanks a lot, > Sam -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: index_interval

2013-05-08 Thread Jonathan Ellis
? (we have been having to play with this setting a lot lately as too > big and it gets slow yet too small and cassandra uses way too much RAM…we are > still trying to find the right balance with this setting). > > Thanks, > Dean -- Jonathan Ellis Project Chair, Ap

Re: Backup and restore between different node-sized clusters

2013-05-08 Thread Jonathan Ellis
d? > > FYI, I'm following the instructions below, but only doing per column family > backup and restore. > > http://www.datastax.com/docs/1.2/operations/backup_restore > > Thanks, > Ron > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Ten talks you shouldn’t miss at the Cassandra Summit

2013-05-08 Thread Jonathan Ellis
svc.com/E2 (Want to go, but your company won't pay? Let me know off-list and I'll see what I can do.) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Cassandra NYC event followup

2013-05-02 Thread Jonathan Ellis
The videos from the NYC* Big Data Tech Day are all up. I blogged about my favorites here: http://www.datastax.com/dev/blog/my-top-five-talks-from-nyc-big-data-tech-day Good to meet the NYC community again! -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com

Re: ordered partitioner

2013-04-22 Thread Jonathan Ellis
t; ‘new DecoratedKey(…)’ statement and is not using the partitioner function > decorateKey(…). > > > > Would it be logical to always call the partitioner function decorateKey such > that the creation of an own partitioner and key decoration is possible? > > > > Ign

Cassandra Summit 2013

2013-04-12 Thread Jonathan Ellis
See you there! [1] http://www.datastax.com/company/news-and-events/events/cassandrasummit2012/presentations -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: Vnodes - HUNDRED of MapReduce jobs

2013-03-29 Thread Jonathan Ellis
map tasks instead of > 2,560? > > > On Fri, Mar 29, 2013 at 10:28 AM, Jonathan Ellis wrote: >> >> I still don't see the hole in the following reasoning: >> >> - Input splits are 64k by default. At this size, map processing time >> dominates job creat

Re: Vnodes - HUNDRED of MapReduce jobs

2013-03-29 Thread Jonathan Ellis
1.2.3 & edited the cassandra.yaml for vnodes. >> >> When I execute a M/R job .. the console showed HUNDRED of Map tasks. >> >> May I know, is the normal since is vnodes? If yes, this have slow the M/R >> job to finish/complete. >> >> >> Thanks > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: virtual nodes + map reduce = too many mappers

2013-02-16 Thread Jonathan Ellis
cts the performance since >> the range queries have a lot of overhead. >> >> Any suggestion to improve the performance? It seems like I need to lower the >> number of virtual nodes. >> >> Best Regards, >> Cem >> >> -- Jonathan Ellis Project Chair, Apache Cassandra co-founder, http://www.datastax.com @spyced

Re: [RELEASE] Apache Cassandra 1.2 released

2013-01-07 Thread Jonathan Ellis
p://www.datastax.com/dev/blog/atomic-batches-in-cassandra-1-2 > [6]: http://www.datastax.com/dev/blog/tracing-in-cassandra-1-2 > [7]: > http://www.datastax.com/dev/blog/performance-improvements-in-cassandra-1-2 > [8]: http://www.datastax.com/dev/blog/binary-protocol > [9]: http://ww

Re: Hinted Handoff runs every ten minutes

2012-11-11 Thread Jonathan Ellis
; > I'm running 1.1.5; the bug says it's fixed in 1.0.9/1.1.0. >> > >> > How can I check to see why it keeps running HintedHandoff? >> you have tombstone is system.HintsColumnFamily use list command in >> cassandra-cli to check >> > > > > -- > > Mike Heffner > Librato, Inc. > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Read during digest mismatch

2012-11-11 Thread Jonathan Ellis
I am readind the code wrong? > > Also if this is correct, look like if the third node is in other DC, the > read will slow down even when the consistency was TWO? > > Thanks, > Sankalp > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax,

Re: Fw: Fwd: Compound primary key: Insert after delete

2012-10-22 Thread Jonathan Ellis
not working with 1.1.5. > > -Vivek > > On Mon, Oct 22, 2012 at 5:20 AM, aaron morton > wrote: > > Yes AFAIK. > > Cheers > > ----- > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 20/10/2012, at 12:15 AM, Vivek Mishra wrote: > > Hi, > Is it possible to reuse same compound primary key after delete? I guess it > works fine for non composite keys. > > -Vivek > > > > > > > > > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: potential data loss in Cassandra 1.1.0 .. 1.1.4

2012-10-18 Thread Jonathan Ellis
r in any other place > where this could be useful ? Good idea, I'll get that noted. Thanks! -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

potential data loss in Cassandra 1.1.0 .. 1.1.4

2012-10-17 Thread Jonathan Ellis
en flushed. Replaying already-flushed data a second time is harmless -- except for counters. So, to avoid replaying flushed counter data, we recommend performing drain when shutting down the pre-1.1.6 C* prior to upgrade. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataSta

Re: Any way to put a hard limit on memory cap for Cassandra ?

2012-10-03 Thread Jonathan Ellis
250M that I observed in the behavior of my > application ? What about later releases of Cassandra (e.g. 1.1, or 1.2) ? Is > there any option to help on this front ? > > Thanks in advance for any pointers that you can provide to help me understand > this issue. > > B

Re: JVM 7, Cass 1.1.1 and G1 garbage collector

2012-09-11 Thread Jonathan Ellis
e had any experience with this ? Anyone tried it ? > > -- > Regards, > Oleg Dulin > NYC Java Big Data Engineer > http://www.olegdulin.com/ > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Dynamic Column Families in CQLSH v3

2012-08-29 Thread Jonathan Ellis
e a dynamic > column family is to create a table with no named columns and alter the > table later but that also does not work: > > "create table data (key varchar PRIMARY KEY);" > > yields: > > "Bad Request: No definition found that is not part of the PRIMAR

Re: Problem while configuring key and row cache?

2012-08-21 Thread Jonathan Ellis
Bloom Filter Space Used: 41104 > Compacted row minimum size: 150 > Compacted row maximum size: 179 > Compacted row mean size: 179 * > > I am unable to see the effect of above setcachecapacity command. Let me > know how i can configure the cache capacity, and check it

Re: RE Restore snapshot

2012-08-07 Thread Jonathan Ellis
Yes. On Thu, Aug 2, 2012 at 5:33 AM, Radim Kolar wrote: > >> 1) I assume that I have to call the loadNewSSTables() on each node? > > this is same as "nodetool refresh?" -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for profe

Fwd: Call for Papers for ApacheCon Europe 2012 now open!

2012-07-24 Thread Jonathan Ellis
ve a little over weeks to send in your talk proposal. Don't put it off! We'll look forward to seeing some great ones shortly! Thanks Nick (On behalf of the Conferences committee) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

2012 Cassandra MVP nominations

2012-07-13 Thread Jonathan Ellis
lease take five minutes and submit your nomination today at [2]. Nominations will be open throughout the next week. Those selected will be notified in advance. [1] http://www.datastax.com/events/cassandrasummit2012 [2] http://www.surveymonkey.com/s/WVBZGHR -- Jonathan Ellis Project Chair, Apache

Cassandra Summit 2012

2012-07-13 Thread Jonathan Ellis
More information at http://www.datastax.com/services/training -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Java heap space on Cassandra start up version 1.0.10

2012-07-09 Thread Jonathan Ellis
at > org.apache.cassandra.io.sstable.SSTableMetadata$SSTableMetadataSerializer.deserialize(SSTableMetadata.java:204) > at > org.apache.cassandra.io.sstable.SSTableMetadata$SSTableMetadataSerializer.deserialize(SSTableMetadata.java:194) > at > org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:155) > at > org.apache.cassandra.io.sstable.SSTableReader$1.run(SSTableReader.java:224) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Service exit with a return value of 100 -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Memtable tuning in 1.0 and higher

2012-07-02 Thread Jonathan Ellis
dn't improve our safety margin since you'd basically need to rewrite the patch. On Sun, Jul 1, 2012 at 6:40 AM, Joost Van De Wijgerd wrote: > Hi Jonathan, > > Looks good, any chance of porting this fix to the 1.0 branch? > > Kind regards > > Joost > > Sent f

Re: Memtable tuning in 1.0 and higher

2012-07-01 Thread Jonathan Ellis
ASSANDRA-4399 to fix this. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: jscv CPU Consumption

2012-06-30 Thread Jonathan Ellis
10 00 > Fax: (33) 1 58 56 10 01 > > http://www.octo.com > Octo Talks! http://blog.octo.com > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Question on pending tasks in compaction manager

2012-06-30 Thread Jonathan Ellis
7,000 > tasks still pending. No more tasks will be executed until I start another > test and the 7000 pending will never be executed. > > I'm using leveled compaction with 5MB SS tables and my tests have a 50:50 > read:write ratio. Each value is a 10K byte array with random conten

Re: upgrade issue

2012-06-30 Thread Jonathan Ellis
nd >> property 'commitlog_rotation_threshold_in_mb' on class: org.apache. >> cassandra.config.Config >>         at org.yaml.snakeyaml.constructor. >> Constructor$ConstructMapping.getProperty(Constructor.java:342) >>         at org.yaml.snakeyaml.constructor. >&

Re: items removed from 1.1.0 cfstats output

2012-06-30 Thread Jonathan Ellis
cfstats in 1.1.0? I can see them in 1.0.8 but not 1.1.0. If so, > was wondering why, as they're fairly useful :) > > Bill -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Ball is rolling on High Performance Cassandra Cookbook second edition

2012-06-30 Thread Jonathan Ellis
.datastax.com/dev/blog/schema-in-cassandra-1-1 -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Failed to solve Digest mismatch

2012-06-30 Thread Jonathan Ellis
8026790552830793920833138736, > 31333430383431363030303030):ColumnFamily(queue.idxRecvTimeRange > [7878323239537570657254616e67307878:true:4@1340870382109010,]) > DEBUG [MutationStage:10] 2012-06-28 15:59:42,193 KeysIndex.java (line 103) > removed index entry for cleaned-up value DecoratedKey(test, > 74657374):ColumnFamily(queue.idxServiceProvider > [7878323239537570657254616e67307878:true:4@1340870382109007,]) > DEBUG [MutationStage:10] 2012-06-28 15:59:42,193 RowMutationVerbHandler.java > (line 56) RowMutation(keyspace='drc', > key='7878323239537570657254616e67307878', modifications=[ColumnFamily(queue > -deleted at 1340870382185000- [])]) applied.  Sending response to > 6553@/192.168.0.3 > DEBUG [ReadStage:17] 2012-06-28 15:59:42,198 CollationController.java (line > 77) collectTimeOrderedData > DEBUG [ReadStage:17] 2012-06-28 15:59:42,199 ReadVerbHandler.java (line 58) > Read key 7878323239537570657254616e67307878; sending response to > 6556@/192.168.0.3 > > BRs > //Ares -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Memtable tuning in 1.0 and higher

2012-06-28 Thread Jonathan Ellis
The default > being what's there now. > > Also, in the current version the live ration can never adjust downwards, I > see you guys have already made a fix for this in 1.1 but I have not seen it > on the 1.0 branch. > > Let me know what you think > > Kind regards, > > Joost > > -- > Joost van de Wijgerd > joost.van.de.wijgerd@Skype > http://www.linkedin.com/in/jwijgerd -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Distinct with Cql

2012-06-28 Thread Jonathan Ellis
No. (Moving to user list.) On Jun 28, 2012 8:17 AM, "Fábio Caldas" wrote: > It´s possible to use distinct on cql? > > -- > Atenciosamente, > Fábio Caldas >

Re: cassandra secondary index with

2012-06-19 Thread Jonathan Ellis
een.com > > The information contained in this e-mail is for the exclusive use of the > intended recipient(s) and may be confidential, proprietary, and/or legally > privileged. Inadvertent disclosure of this message does not constitute a > waiver of any privilege.  If you receive this message in error, please do > not directly or indirectly print, copy, retransmit, disseminate, or > otherwise use the information. In addition, please delete this e-mail and > all copies and notify the sender. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Row caching in Cassandra 1.1 by column family

2012-06-19 Thread Jonathan Ellis
t;> Dear distinguished colleagues: >> >> I don't want all of my CFs cached, but one in particular I do. >> >> How can I configure that ? >> >> Thanks, >> Oleg >> > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Rules for Major Compaction

2012-06-19 Thread Jonathan Ellis
nt of expired data (default 20%). So you won't have to force a major for this use case anymore. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: FYI: Java 7u4 on Linux requires higher stack size

2012-05-25 Thread Jonathan Ellis
Adform: watch this short video <http://vimeo.com/adform/display> > [image: Adform News] <http://www.adform.com> > > Disclaimer: The information contained in this message and attachments is > intended solely for the attention and use of the named addressee and may be > confid

Re: supercolumns with TTL columns not being compacted correctly

2012-05-22 Thread Jonathan Ellis
Correction: the first compaction after expiration + gcgs can remove it, even if it hasn't been turned into a tombstone previously. On Tue, May 22, 2012 at 9:37 AM, Jonathan Ellis wrote: > Additionally, it will always take at least two compaction passes to > purge an expired column:

Re: supercolumns with TTL columns not being compacted correctly

2012-05-22 Thread Jonathan Ellis
s compacted bytes > total  progress > >    Compaction  MapData007 HOS 11518215662 > 532355279724 2.16% > > > > And when I ls the directory I find this: > > -rw-rw-r--. 1 cassandra cassandra 3.9G May 22 14:12 > /data/MapData007/H

Re: CQL 3.0 Features

2012-05-19 Thread Jonathan Ellis
012 at 12:04 AM, Tamil selvan R.S >> wrote: >>> >>> Hi, >>>  Is there a tutorial or reference on CQL 3.0 Features. In cassandra >>> download site the reference is still pointing to 2.0 >>>  Specifically Composite Types >>> Regards, >>> Tamil.s >> >> > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Snapshot failing on JSON files in 1.1.0

2012-05-19 Thread Jonathan Ellis
May 15 20:51 >> > /var/lib/cassandra/data/blotter/twitter_users/twitter_users.json >> > >> > [root@cassandra-n6 blotter]# ls -al >> > >> > /var/lib/cassandra/data/blotter/twitter_users/snapshots/1337115022389/twitter_users.json >> > -rw-r--r-- 1 root root 38778 May 15 20:50 >> > &g

Re: while compaction occur EOFException

2012-05-19 Thread Jonathan Ellis
ker(ThreadPoolExecutor.java:1110) >     at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >     at java.lang.Thread.run(Thread.java:722) > Caused by: java.io.EOFException >     at > org.apache.cassandra.io.sstable.IndexHelper.skipIndex

Re: Migrating a column family from one cluster to another

2012-05-19 Thread Jonathan Ellis
quot; compaction on the 3 nodes > > =Rob > [1] https://issues.apache.org/jira/browse/CASSANDRA-1983 > > -- > =Robert Coli > AIM>ALK - rc...@palominodb.com > YAHOO - rcoli.palominob > SKYPE - rcoli_palominodb -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Migration from cassandra 0.8.6 to 1.1.0

2012-05-19 Thread Jonathan Ellis
makemytrip.com/signature/images/facebook-icon.gif]<http://www.facebook.com/pages/MakeMyTrip-Deals/120740541030?ref=search&sid=10077980239.1422657277..1> > *Facebook* > > [image: Description: > http://www.mailmktg.makemytrip.com/signature/images/twitter-icon.gif]<http://

Re: Exception when truncate

2012-05-19 Thread Jonathan Ellis
ssandra.io.util.FileUtils.createDirectory(FileUtils.java:131) >        at > org.apache.cassandra.db.ColumnFamilyStore.snapshotWithoutFlush(ColumnFamilyStore.java:1409) >        ... 7 more > > > Also i see that in snapshort dir already exists > 1337242754356-purchase_history

Re: need some clarification on recommended memory size

2012-05-19 Thread Jonathan Ellis
ed: more efficient snapshots >> and advising the OS when file operations should not be cached. >> >>  Our environment is virtualized, and the disks are actually SAN through >> fiber channels, so I don't know if that has impact on performance as well. >> >> memory speed > network speed >> >> - >> Aaron Morton >> Freelance Developer >> @aaronmorton >> http://www.thelastpickle.com >> >> > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: stream data using bulkoutputformat

2012-05-04 Thread Jonathan Ellis
lper can only set one output column family. Is there a way > that I can set multiple column families in one keyspace and output data to > all the cfs? > > > Thx > Shawna > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Cql 3 wide rows filter expressions in where clause

2012-04-30 Thread Jonathan Ellis
ons-in-where-clause-tp7486344p7486344.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: incremental_backups

2012-04-30 Thread Jonathan Ellis
implications? > Thanks, > > *Tamar Fraenkel * > Senior Software Engineer, TOK Media > > [image: Inline image 1] > > ta...@tok-media.com > Tel: +972 2 6409736 > Mob: +972 54 8356490 > Fax: +972 2 5612956 > > > > -- Jonathan Ellis Project Chair

Re: JNA + Cassandra security

2012-04-30 Thread Jonathan Ellis
ots of places where we explicitly allow arbitrary Java code to be injected into Cassandra. You don't need native code to do dangerous things with that! -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: AssertionError: originally calculated column size ...

2012-04-30 Thread Jonathan Ellis
On Mon, Apr 30, 2012 at 2:11 PM, Patrik Modesto wrote: > I think the problem is somehow connected to an IntegerType secondary > index. Could be, but my money is on the supercolumns in the HH data model. Can you create a jira ticket? -- Jonathan Ellis Project Chair, Apache Cassandra co-f

Re: Resident size growth

2012-04-18 Thread Jonathan Ellis
which does depend on > JNA. mlockall does depend on JNA, but we only lock the JVM itself in memory. The OS is free to page data files in and out as needed. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: size tiered compaction - improvement

2012-04-18 Thread Jonathan Ellis
nes. >> >> Then, any subsequent pass that includes A *and all other sstables >> containing rows with the same key* will drop the tombstones. > > thats why i proposed to attach TTL to entire CF. Tombstones would not be > needed -- Jonathan Ellis Project Chair, Apache C

Re: size tiered compaction - improvement

2012-04-17 Thread Jonathan Ellis
efinedCompaction? If you want them all compacted together into one big sstable, yes. -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: java.nio.BufferOverflowException from cassandra server

2012-04-17 Thread Jonathan Ellis
consistency level is also set to ONE. > -The max heap size and new heap size is set to 4G and 800M(I tried without > setting them as well) > -Java is run in the interpreted mode(-Xint) > -I'm using user mode linux > > Any pointers to what I might be doing wrong will be very helpfu

Re: swap grows

2012-04-17 Thread Jonathan Ellis
gt;>> -/+ buffers/cache:    7901296   16832368 >>>>> Swap:  1998840   2352    1996488 >>>>> >>>>> >>>>> And swap space slowly grows, but i misunderstand why? >>>>> >>>>> >>>>> PS: We have JNA mlock, and set  vm.swappiness = 0 >>>>> PS: OS ubuntu 10.0.4(2.6.32-40-generic) >>>>> >>>>> >>>> >>> >>> >>> >>> -- >>> With kind regards, >>> >>> Robin Verlangen >>> www.robinverlangen.nl >>> >> > > > > -- > With kind regards, > > Robin Verlangen > www.robinverlangen.nl > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Long start-up times

2012-04-17 Thread Jonathan Ellis
On Sun, Apr 15, 2012 at 2:47 PM, sj.climber wrote: > Also, I see in 1.0.9 there's a fix for a potentially related issue (see > https://issues.apache.org/jira/browse/CASSANDRA-4023).  Any thoughts on > this? My thought is, upgrading is a no-brainer if that's a pain point for yo

Re: Off-heap row cache and mmapped sstables

2012-04-17 Thread Jonathan Ellis
pages? > > Thanks, > Omid > > [1] http://pubs.opengroup.org/onlinepubs/007908799/xsh/mlockall.html -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: size tiered compaction - improvement

2012-04-17 Thread Jonathan Ellis
ime T and > probably passed gc_grace period, so it shoould be wiped at any compaction on > table A. Any compaction pass over A will first convert the TTL data into tombstones. Then, any subsequent pass that includes A *and all other sstables containing rows with the same key* will drop th

Re: size tiered compaction - improvement

2012-04-17 Thread Jonathan Ellis
On Sat, Apr 14, 2012 at 3:27 AM, Radim Kolar wrote: > forceUserDefinedCompaction would be more usefull if you could do compaction > on 2 tables. You absolutely can. That's what the "user defined" part is: you give it the exact list of sstables you want compacted. -- J

Re: [RELEASE CANDIDATE] Apache Cassandra 1.1.0-rc1 released

2012-04-17 Thread Jonathan Ellis
vailable using the 11x branch (see >> http://wiki.apache.org/cassandra/DebianPackaging). >> >> Thank you for your help in testing and have fun with it. >> >> [1]: http://goo.gl/XwH7J (CHANGES.txt) >> [2]: http://goo.gl/JocLX (NEWS.txt) >> [3]: https://issues.apache.org/jira/browse/CASSANDRA >> [4]: user@cassandra.apache.org >> [5]: >> http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=shortlog;h=re >> fs/tags/cassandra-1.1.0-rc1 -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Why so many SSTables?

2012-04-10 Thread Jonathan Ellis
      Index Type: KEYS >   Compaction Strategy: > org.apache.cassandra.db.compaction.LeveledCompactionStrategy >   Compression Options: >     sstable_compression: org.apache.cassandra.io.compress.SnappyCompressor > > Is it a bug? If not, how can we tune Cassandra to avoid this? > > Regards, > > Romain -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: leveled compaction - improve log message

2012-04-09 Thread Jonathan Ellis
apidshare/querycache-hc-19706-Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19707-Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19708-Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19709-Data.db,/var/lib/cassandra/data/rapidshare/querycache-hc-19710-Data.db,/var/lib/cass

Re: Bulk loading errors with 1.0.8

2012-04-09 Thread Jonathan Ellis
rg.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81) > > This one sounds like a null key added to the SSTable at some point, > but I'm rather confident I'm checking for key nullity. The stacktrace indicates an error with the very first key in the ss

Re: tombstones problem with 1.0.8

2012-04-03 Thread Jonathan Ellis
ot;. > Could this be having an impact since we continually add and remove columns > even while a major compact is executing? > > > Thanks, > Ross > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: really bad select performance

2012-04-03 Thread Jonathan Ellis
to complete and takes about the same amount of time > whether the limit is 1, 100 or 1000. > > > Thanks for any help, > Chris -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: column’s timestamp

2012-04-03 Thread Jonathan Ellis
the column’s name)? > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/column-s-timestamp-tp7429905p7429905.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com. > > > -

Re: Largest 'sensible' value

2012-04-03 Thread Jonathan Ellis
> franc.car...@sirca.org.au | www.sirca.org.au > > Tel: +61 2 9236 9118 > > Level 9, 80 Clarence St, Sydney NSW 2000 > > PO Box H58, Australia Square, Sydney NSW 1215 > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: size tiered compaction - improvement

2012-04-03 Thread Jonathan Ellis
5) of its size, and this range will get increased with sstable age. - > 1 month old will have range for example (0.2 - 1.8). -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

Re: Cannot start cassandra node anymore

2012-03-27 Thread Jonathan Ellis
w it got like that is another question. What was the schema change ? >> >> Cheers >> >> > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com

  1   2   3   4   5   6   7   8   9   10   >