Any Job opening for Cassandra Administrator in your team/company?

2024-01-30 Thread Daniel Johnson
Hi, Hope you all are well. Just wanted to understand if there is a Job opening in your company/team for Cassandra Administrator. I have around 10 years of experience. If you know anything then, Please email me. Thanks in Advance Regards Daniel

Unsubscribe

2023-10-25 Thread Daniel Stibor
Hey, I'd like to unsubscribe. Thanks

Apache Cassandra performance tuning - call for contribution

2022-02-09 Thread Daniel Seybold
introduce yourself and your company as well as comment on the results with your experience and assessment. If you are interested in contributing, feel free to reach out to me. Cheers, Daniel

Re: Empty Storage Directory in JVM Options

2020-04-15 Thread Daniel Kleviansky
Howdy all, this has been solved, and don't want to waste anyone's time. Just changed it in /usr/sbin/cassandra, and that fixed that problem. Thank you for reading, and for everyone's continual contribution to this community! Kindest regards, Daniel On Wed, Apr 15, 2020 at

Empty Storage Directory in JVM Options

2020-04-15 Thread Daniel Kleviansky
nstallation, before anything "extra or fancy" is added. Might anyone have any ideas? Kindest regards, Daniel

Re: [EXTERNAL] Availability issues for write/update/read workloads (up to 100s downtime) in case of a Cassandra node failure

2018-11-23 Thread Daniel Seybold
help to further investigate the issue let me know and I will rerun the experiments to create the logs and traces. Many thanks again for your help. Cheers, Daniel Am 16.11.2018 um 15:08 schrieb Alexander Dejanovski: Hi Daniel, it seems like the driver isn't detecting that the node

Re: [EXTERNAL] Availability issues for write/update/read workloads (up to 100s downtime) in case of a Cassandra node failure

2018-11-16 Thread Daniel Seybold
, Cheers, Daniel Am 09.11.2018 um 19:04 schrieb Durity, Sean R: The VMs’ memory (4 GB) seems pretty small for Cassandra. What heap size are you using? Which garbage collector? Are you seeing long GC times on the nodes? The basic rule of thumb is to give the Cassandra heap 50% of the RAM on the

paging through cql query on django

2018-03-05 Thread Daniel Santos
I have two queries. One that gives me the first page from a cassandra table, and another one that retrieves the successive pages. The fist one is like : select * from images_by_user where token(iduser) = token(5) limit 10 allow filtering; The successive ones are : select * from images_

Re: Cassandra Needs to Grow Up by Version Five!

2018-02-21 Thread Daniel Hölbling-Inzko
Templates or Helm Charts) would be really useful. Also a list of all the projects that Cassandra goes well with (like TLP Reaper and and Netflix's Priam etc..) greetings Daniel On Wed, 21 Feb 2018 at 07:23 Kenneth Brotman wrote: > If you watch this video through you'll see why usability is

Re: Cassandra Needs to Grow Up by Version Five!

2018-02-20 Thread Daniel Hölbling-Inzko
ting larger we could spare the resources to operate these things, but switching from a well-understood RDBMs schema to Cassandra is now incredibly hard and will probably take years. greetings Daniel On Tue, 20 Feb 2018 at 05:56 James Briggs wrote: > Kenneth: > > What you said is not wron

What happens to coordinators and clients when I drain a node?

2017-11-22 Thread Daniel Woo
new requests immediately there could be some noisy exceptions to the client, right? After a node is drained, it might take 10 minutes to upgrade and restart it, during that 10 minutes, what happens to the read and write requests if the consistency level is ALL? -- Thanks & Regards, Daniel

LWT and non-LWT mixed

2017-10-10 Thread Daniel Woo
value. But my tests shows that this often fails, does anybody know why? -- Thanks & Regards, Daniel

Re: Does NTP affects LWT's ballot UUID?

2017-10-10 Thread Daniel Woo
> On Tue, Oct 10, 2017 at 9:07 AM, Daniel Woo > wrote: > >> Hi guys, >> >> The ballot UUID should be monotonically increasing on each coordinator, >> but the UUID in cassandra is version 1 (timestamp based), what happens if >> the NTP service adju

Does NTP affects LWT's ballot UUID?

2017-10-10 Thread Daniel Woo
Hi guys, The ballot UUID should be monotonically increasing on each coordinator, but the UUID in cassandra is version 1 (timestamp based), what happens if the NTP service adjusts system clock while a two phase paxos prepare/commit is in progress? -- Thanks & Regards, Daniel

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-07 Thread Daniel Hölbling-Inzko
tty overengineered, imo, given you can just save the pagination > state as Andy Tolbert pointed out. > > On Oct 4, 2017, at 8:38 AM, Daniel Hölbling-Inzko < > daniel.hoelbling-in...@bitmovin.com> wrote: > > Thanks for pointing me to Elassandra. > Have you had any experience running th

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-04 Thread Daniel Hölbling-Inzko
y that step for as long as possible since it would add a lot of complexity and another layer of eventual consistency I'd rather not deal with at the moment :) greetings Daniel On Wed, 4 Oct 2017 at 08:36 Greg Saylor wrote: > Without knowing other details, of course, have you considered

Re: Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-03 Thread Daniel Hölbling-Inzko
t question would be: How long is the paginationState from the driver current? I was thinking about inserting the paginationState with a TTL into another Cassandra table - not sure if that's smart though. greetings Daniel On Tue, 3 Oct 2017 at 12:20 kurt greaves wrote: > I get the impre

Migrating a Limit/Offset Pagination and Sorting to Cassandra

2017-10-03 Thread Daniel Hölbling-Inzko
don't want to be writing a Subclass of the Entity for each Table to add the @Table annotation. greetings Daniel

Re: Datastax Driver Mapper & Secondary Indexes

2017-09-26 Thread Daniel Hölbling-Inzko
Hi, I also just figured out that there is no schema generation off the mapper. Thanks for pointing me to the secondary index info. I'll have a look. greetings Daniel On Tue, 26 Sep 2017 at 09:42 kurt greaves wrote: > If you've created a secondary index you simply query it by speci

Datastax Driver Mapper & Secondary Indexes

2017-09-26 Thread Daniel Hölbling-Inzko
er sources - am I missing something or is this missing from the client library? greetings Daniel

Re: Bootstrapping a new Node with Consistency=ONE

2017-08-03 Thread Daniel Hölbling-Inzko
e the data yet so a repair needs to be run. Awesome - thanks so much. greetings Daniel On Thu, 3 Aug 2017 at 09:56 Oleksandr Shulgin wrote: > On Thu, Aug 3, 2017 at 9:33 AM, Daniel Hölbling-Inzko < > daniel.hoelbling-in...@bitmovin.com> wrote: > >> No I set Auto bootstrap to t

Re: Bootstrapping a new Node with Consistency=ONE

2017-08-03 Thread Daniel Hölbling-Inzko
false? > > > -- > Jeff Jirsa > > > On Aug 2, 2017, at 11:52 PM, Daniel Hölbling-Inzko < > daniel.hoelbling-in...@bitmovin.com> wrote: > > Thanks Jeff. How do I determine that bootstrap is finished? Haven't seen > that anywhere so far. > > Reads via

Re: Bootstrapping a new Node with Consistency=ONE

2017-08-02 Thread Daniel Hölbling-Inzko
ce (tcp/7000), but the guarantee is that data should be consistent by > the time bootstrap finishes > > > > > -- > Jeff Jirsa > > > > On Aug 2, 2017, at 1:53 AM, Daniel Hölbling-Inzko < > daniel.hoelbling-in...@bitmovin.com> wrote: > > > > Hi, > &

Re: Bootstrapping a new Node with Consistency=ONE

2017-08-02 Thread Daniel Hölbling-Inzko
al DC). As I said this was a small issue here - we only were seeing the issue for 5 minutes. But considering how miniscule the amount of data to replicate was (400 rows with a total of 500kb) I am a bit worried on how to do this once loads increases. greetings Daniel On Wed, 2 Aug 2017 at 11:50

Bootstrapping a new Node with Consistency=ONE

2017-08-02 Thread Daniel Hölbling-Inzko
way to start up a node that does not serve client requests but does replicate data? greetings Daniel

Re: Data Loss irreparabley so

2017-07-27 Thread Daniel Hölbling-Inzko
In that vein, Cassandra support Auto compaction and incremental repair. Does this mean I have to set up cron jobs on each node to do a nodetool repair or is this taken care of by Cassandra anyways? How often should I run nodetool repair Greetings Daniel Jeff Jirsa schrieb am Do. 27. Juli 2017 um

Re: Understanding gossip and seeds

2017-07-22 Thread Daniel Hölbling-Inzko
Seeds are there to bootstrap a node for the very first time when it's has zero knowledge about the ring. I think I also read somewhere that seed nodes are periodically queried for some sanity checks and therefore one should not include too many nodes in the seed list. kurt greaves schrieb am Sa.

resultSetMetadata returned by PreparedStatement for sum(int) should be bigint

2017-07-07 Thread Daniel Woo
ctice for this? -- Thanks & Regards, Daniel

Re: Don't print Ping caused error logs

2017-06-19 Thread Daniel Hölbling-Inzko
requests? Having a bunch of seed nodes would be easier I guess. Greetings Daniel Akhil Mehra schrieb am Mo. 19. Juni 2017 um 11:44: > Just in case you are not aware using a load balancer is an anti patter. > Please refer to ( > http://docs.datastax.com/en/landing_page/doc/landing_page

Re: Restarting nodes and reported load

2017-06-02 Thread Daniel Steuernol
to Al Tobey's tuning guide frequently if nothing else for the tools he mentions and notes on the java gc. I want to say heap size of 15G sounds a little high but I am starting to talk a bit out of my depth when it comes to java tuning. see datastax's official cassandra 2.1 jvm tuning

Re: Restarting nodes and reported load

2017-06-01 Thread Daniel Steuernol
On Jun 1 2017, at 10:33 am, Victor Chen wrote: Hi Daniel,In my experience when a node shows DN and then comes back up by itself that sounds some sort of gc pause (especially if nodtool status when run from the "DN" node itself shows it i

Re: Restarting nodes and reported load

2017-06-01 Thread Daniel Steuernol
uld be super helpful On May 31 2017, at 5:07 pm, Anthony Grasso wrote: Hi Daniel,When you say that the nodes have to be restarted, are you just restarting the Cassandra service or are you restarting the machine?How are you reclaiming disk space at t

Re: Restarting nodes and reported load

2017-05-30 Thread Daniel Steuernol
the day are dangerous men, for they may act their dreams with open eyes, to make it possible.” — T.E. Lawrence On Tue, May 30, 2017 at 2:00 PM, tommaso barbugli <tbarbu...@gmail.com> wrote:Am I the only one thinking 3TB is way too much data for a single node on a VM?On Tue, May 30, 2017 at 10:3

Re: Restarting nodes and reported load

2017-05-30 Thread Daniel Steuernol
the dreamers of the day are dangerous men, for they may act their dreams with open eyes, to make it possible.” — T.E. Lawrence On Tue, May 30, 2017 at 1:36 PM, Daniel Steuernol <dan...@sendwithus.com> wrote:I don't believe incremental repair is enabled, I have never enabled it on

Re: Restarting nodes and reported load

2017-05-30 Thread Daniel Steuernol
enabled and snapshots are occupying the space.run nodetool clearsnapshot command.On Tue, May 30, 2017 at 11:12 AM, Daniel Steuernol <dan...@sendwithus.com> wrote:It's 3-4TB per node, and by load rises, I'm talking about load as reported by nodetool status.

Re: Restarting nodes and reported load

2017-05-30 Thread Daniel Steuernol
, May 30, 2017 at 11:12 AM, Daniel Steuernol <dan...@sendwithus.com> wrote:It's 3-4TB per node, and by load rises, I'm talking about load as reported by nodetool status. On May 30 2017, at 10:25 am, daemeon reiydelle <d

Re: Restarting nodes and reported load

2017-05-30 Thread Daniel Steuernol
r in total?On Tue, May 30, 2017 at 6:48 PM, Daniel Steuernol <dan...@sendwithus.com> wrote:I should also mention that I am running cassandra 3.10 on the cluster On May 29 2017, at 9:43 am, Daniel Steuernol <dan...@sendwithus.com> wrote:

Re: Restarting nodes and reported load

2017-05-30 Thread Daniel Steuernol
I should also mention that I am running cassandra 3.10 on the cluster On May 29 2017, at 9:43 am, Daniel Steuernol wrote: The cluster is running with RF=3, right now each node is storing about 3-4 TB of data. I'm

Re: Restarting nodes and reported load

2017-05-29 Thread Daniel Steuernol
s a good marker to decide on whether to increase disk space vs provisioning a new node? On May 29 2017, at 9:35 am, tommaso barbugli wrote: Hi Daniel,This is not normal. Possibly a capacity problem. Whats the RF, how m

Restarting nodes and reported load

2017-05-29 Thread Daniel Steuernol
, is this normal? Also does cassandra need to be restarted every few days for best performance? Any insight on this behaviour would be helpful.Cheers,Daniel - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For

Re: Cassandra Snapshots and directories

2017-05-12 Thread Daniel Hölbling-Inzko
eally have to go through this columnfamily by columnfamily which is annoying. greetings Daniel On Thu, 11 May 2017 at 22:48 Varun Gupta wrote: > > I did not get your question completely, with "snapshot files are mixed > with files and backup files". > > When you call

Re: Nodes stopping

2017-05-11 Thread Daniel Steuernol
ct initiated at Spotify: https://github.com/thelastpickle/cassandra-reaper.C*heers,---Alain Rodriguez - @arodream - al...@thelastpickle.comFranceThe Last Pickle - Apache Cassandra Consultinghttp://www.thelastpickle.com2017-05-11 23:04 GMT+01:00 Alain RODRIGUEZ <arodr...@gm

Re: Nodes stopping

2017-05-11 Thread Daniel Steuernol
wrote: Have a look at dmesg. It have already happened to me regarding type i instances at AWS. On 11-05-2017 22:17, Daniel Steuernol wrote: I had 2 nodes go down today, here is the ERRORs from the system log on both nodes https://gist.githu

Re: Nodes stopping

2017-05-11 Thread Daniel Steuernol
10 pm, Cogumelos Maravilha wrote: Can you grep ERROR system.log On 11-05-2017 21:52, Daniel Steuernol wrote: There is nothing in the system log about it being drained or shutdown, I'm not sure how els

Re: Nodes stopping

2017-05-11 Thread Daniel Steuernol
down, OR pre-empting cassandra process?On Thu, May 11, 2017 at 1:30 PM, Daniel Steuernol <dan...@sendwithus.com> wrote:I have a 6 node cassandra cluster running, and frequently a node will go down with no obvious error in the logs. This is starting to happen quite often, almost daily now. Any s

Nodes stopping

2017-05-11 Thread Daniel Steuernol
I have a 6 node cassandra cluster running, and frequently a node will go down with no obvious error in the logs. This is starting to happen quite often, almost daily now. Any suggestions on how to track down what is causing the node to stop?

Cassandra Snapshots and directories

2017-05-11 Thread Daniel Hölbling-Inzko
cause this way it's much easier to just backup the whole data directory. greetings Daniel

Re: Cassandra 3.10 has partial partition key search but does it result in a table scan?

2017-05-09 Thread Daniel Hölbling-Inzko
If you have to allow filtering for the query to work it usually always results in a table scan. greetings Daniel On Tue, 9 May 2017 at 15:33 Jon Haddad wrote: > I don’t see any way it wouldn’t. Have you tried tracing it? > > > On May 9, 2017, at 8:32 AM, Kant Kodali wrote: &g

Re: Assertions being hit on Cassandra 3.5 cluster (UnfilteredRowIterators.concat)

2017-03-22 Thread Daniel Miranda
has not caused the issue again yet. I do not have row cache saving enabled, and the issue persisted between node restarts, which it's somewhat strange. I couldn't reproduce the issue with any other tables. I can produce a sanitized dump of the SSTable if a developer desires. -- Regar

Re: Assertions being hit on Cassandra 3.5 cluster (UnfilteredRowIterators.concat)

2017-03-22 Thread Daniel Miranda
Thank you for the pointer Michael, I'll try to investigate if this is the same bug I am seeing. I am afraid it might not be, since I'm observing the error periodically, not just during compactions, and the traceback seems different. Regards, Daniel On Wed, Mar 22, 2017 at 1:27 PM Mich

Assertions being hit on Cassandra 3.5 cluster (UnfilteredRowIterators.concat)

2017-03-22 Thread Daniel Miranda
;t seem to find any information about it from someone else or any bug reports. Should I bother running an SSTable scrub? Is it a known issue that is fixed in subsequent versions? Thanks in advance, Daniel --- WARN [SharedPool-Worker-1] 2017-03-16 18:54:35,587 AbstractLocalAwareExecutorServic

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-10 Thread Daniel Hölbling-Inzko
olumn1 text, > column2 text, > column3 text, > PRIMARY KEY (column1, column2) > > The query is *select * from mykeyspace.test where column1='x';* > > @Daniel, the replication factor is 3. That's why I don't understand why I > get these ti

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-10 Thread Daniel Hölbling-Inzko
The LOCAL_QUORUM works on the available replicas in the dc. So if your replication factor is 2 and you have 10 nodes you can still only loose 1. With a replication factor of 3 you can loose one node and still satisfy the query. Ryan Svihla schrieb am Do. 9. März 2017 um 18:09: > whats your keyspa

unsubscribe

2017-03-07 Thread Daniel Rathbone
-- sent from Dan Rathbone's tech/work email account http://rathboneventures.com - my company http://danrathbone.com -- personal site

Re: Question on configuring Apache Cassandra with LDAP

2017-03-03 Thread Daniel Kleviansky
! Kindest regards, Daniel On 4 Mar 2017, 07:18 +1100, Sam Tunnicliffe , wrote: > This is something that has been discussed before and there's an JIRA open for > it already, it looks like progress has stalled but you might get some > pointers from the linked WIP branch. > > https

Re: Reaper repair seems to "hang"

2017-01-03 Thread Daniel Kleviansky
lastpickle/cassandra-reaper/issues/39 Kind regards, Daniel On Wed, Jan 4, 2017 at 6:31 AM, Bhuvan Rawal wrote: > Hi Daniel, > > We faced a similar issue during repair with reaper. We ran repair with > more repair threads than number of cassandra nodes. But on and off repair > was getti

Reaper repair seems to "hang"

2017-01-02 Thread Daniel Kleviansky
as I'd have to sanitize them before sending them out, so please let me know if there is anything else I can provide, and I'll do my best to get it to you. ​Kind regards, Daniel

Nodetool Repair Best Practices

2016-11-21 Thread Daniel Subak
Hey everyone, We've just migrated to a new Cassandra cluster running 3.7 and wanted to get some information on best practices when running nodetool repair; our last cluster was 1.2 and per the documentation it seems that a lot of behavior has changed between those versions. >From a read of the do

Re: Cassandra Node Restart Stuck in STARTING?

2016-11-16 Thread Daniel Subak
> different part of the startup process (you’d be seeing different log > messages), and would eventually complete. > > > > > > > > *From: *Daniel Subak > *Reply-To: *"user@cassandra.apache.org" > *Date: *Wednesday, November 16, 2016 at 11:05 AM >

Cassandra Node Restart Stuck in STARTING?

2016-11-16 Thread Daniel Subak
Hey everyone, Ran into an issue running a node restart where "nodetool netstats" reported the node as "STARTING" with no streams when run locally. "nodetool status" run on other nodes reported that node as "DN". Both of those were expected. However, tailing the logs, there didn't seem to be anythi

Re: High Usage of Survivor Space

2016-10-26 Thread Daniel Kleviansky
point, otherwise, sorry for the unnecessary emails. ;) Daniel On Thu, Oct 27, 2016 at 11:25 AM, Daniel Kleviansky wrote: > ​Hi everyone, > > Organisation is running Cassandra for Windows v2.2.5 > One of our development (non-load testing) clusters has a total of 6 nodes > across two

High Usage of Survivor Space

2016-10-26 Thread Daniel Kleviansky
. Kindest regards, Daniel Kleviansky

RE: performance question

2016-04-12 Thread Gross, Daniel
this usually caught. For example, sometimes we see results of searchers and additional suggestions of subset of criteria to use. Thanks, Daniel From: Jack Krupansky [mailto:jack.krupan...@gmail.com] Sent: Wednesday, April 13, 2016 04:25 To: user@cassandra.apache.org Subject: Re: performance

performance question

2016-04-12 Thread Gross, Daniel
= XL, price <50 USD, short-sleves, etc. Thanks, Daniel - Intel Israel (74) Limited This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution

AW: Strange behavior of timestamp column

2015-10-05 Thread Daniel Stucky
Please forget about this email, there was a long forgotten client running somwhere in our data center that caused this problem. Von: Daniel Stucky [mailto:daniel.stu...@empolis.com] Gesendet: Montag, 5. Oktober 2015 09:02 An: user@cassandra.apache.org Betreff: Strange behavior of timestamp

Re: Is HEAP_NEWSIZE configuration is no more useful from cassandra 2.1 ?

2015-10-05 Thread Daniel Chia
G1GC still has an Eden size, however, it's strongly recommended *NOT* to set the new gen size G1GC and just let it figure it out based on your target pause time. Thanks, Daniel On Sun, Oct 4, 2015 at 4:11 PM, Tushar Agrawal wrote: > If you are using CMS garbage collector then you still

Strange behavior of timestamp column

2015-10-05 Thread Daniel Stucky
ce this effect). Before this time was a cassandra restart, as we increased server side timeouts. Anybody any idea what is causing this problem ? Thanks, Daniel

when a node is dead in Cassandra cluster

2015-09-21 Thread Shenghua(Daniel) Wan
lost nodes from the clients? Thanks a lot! -- Regards, Shenghua (Daniel) Wan

RE: Is Cassandra really Strong consistency?

2015-09-06 Thread Daniel Schulz
Cassandra is not changing clock settings; it does use it to omit TTL'ed rows in compaction phases. So make sure your nodes agree on the very same time using e.g. NTP. It is very crucial for data integrity on most distributed systems. Date: Sun, 6 Sep 2015 13:10:14 +0100 Subject: Re: Is Cassandra

Re: Question about how to remove data

2015-08-20 Thread Daniel Chia
your problems. Others might have other suggestions, but you could potentially use sstable2json to see the raw contents of the sstable on disk and see why data is still there. Thanks, Daniel On Thu, Aug 20, 2015 at 12:55 PM, Analia Lorenzatto < analialorenza...@gmail.com> wrote: > Hello, &g

Re: Question about how to remove data

2015-08-20 Thread Daniel Chia
Is this a LCS family, or Size Tiered? Manually running compaction on LCS doesn't do anything until C* 2.2 ( https://issues.apache.org/jira/browse/CASSANDRA-7272) Thanks, Daniel On Wed, Aug 19, 2015 at 6:56 PM, Analia Lorenzatto < analialorenza...@gmail.com> wrote: > Hello Micha

Re: Cassandra 2.2, 3.0, and beyond

2015-06-11 Thread Daniel Compton
; will 3.1 still see bugfixes at this point when I decide to upgrade to 3.7? > -- -- Daniel

Re: Deserialize the collection type data from the SSTable file

2015-06-10 Thread Daniel Chia
Hi Yong, Glad the code was helpful. I believe it serializes using List> for maps so that it can store the Key of the map as well. Thanks for pointing out the edge case! Thanks, Daniel On Wed, Jun 10, 2015 at 6:39 AM, java8964 wrote: > Thanks, Daniel. > > I didn't realize th

Re: Deserialize the collection type data from the SSTable file

2015-06-08 Thread Daniel Chia
sera/mapreducer/CQLMapper.java#L85 Thanks, Daniel On Mon, Jun 8, 2015 at 1:22 PM, java8964 wrote: > Hi, Cassandra users: > > I have a question related to how to Deserialize the new collection types > data in the Cassandra 2.x. (The exactly version is C 2.0.10). > > I create the foll

Re: Regarding JIRA

2015-06-01 Thread Daniel Compton
Hi Kiran There's no charges for raising issues in the Apache Cassandra JIRA or emailing the list. However as I'm sure you're aware, members of this list and on JIRA are mostly volunteers, so there's also no guarantee of support or response time. -- Daniel. On Tue, Jun 2, 2

Re: read-only DC (or oneway replication)

2015-05-25 Thread Daniel Compton
Could you use Cassandra security roles so that only your application on the untrusted site had write permissions? http://docs.datastax.com/en/cassandra/2.1/cassandra/security/secure_intro.html On Mon, 25 May 2015 at 7:34 pm Andreas Baumhof wrote: > Hi, > > > > We operate several Cassandra cluste

Incorrect override of manifest.json?

2015-04-16 Thread Daniel Pyykkö
this is a bug, or if I should write one? //Kind Regards, Daniel public void snapshotWithoutFlush(String snapshotName, Predicate predicate) { for (ColumnFamilyStore cfs : concatWithIndexes()) { final JSONArray filesJSONArr = new JSONArray();

Re: Less frequent flushing with LCS

2015-03-02 Thread Daniel Chia
Do the tables look like they're being flushed every hour? It seems like the setting memtable_flush_after_mins which I believe defaults to 60 could also affect how often your tables are flushed. Thanks, Daniel On Mon, Mar 2, 2015 at 11:49 AM, Dan Kinder wrote: > I see, thanks for t

Re: Cassandra on Ceph

2015-02-01 Thread Daniel Compton
nst local disks, you will lose a lot of the advantages of this running it on Ceph. Daniel. On Mon, 2 Feb 2015 at 1:11 am Baskar Duraikannu < baskar.duraika...@outlook.com> wrote: > What is the reason for running Cassandra on Ceph? I have both running in > my environment but doing

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-28 Thread Shenghua(Daniel) Wan
> virtual nodes. But in your experiment, you saw 3*257 mapper. Is that > because of the setting cassandra.input.split.size=3? It is nothing with > node number=3. Otherwise, I am confused why there are 256 virtual nodes on > every cassandra node. > > On Wed, Jan 28, 2015 at 12:2

Re: Controlling the MAX SIZE of sstables after compaction

2015-01-28 Thread Daniel Chia
They have an experimental 2.0 that works (we're using it). Thanks, Daniel On Tue, Jan 27, 2015 at 11:50 AM, Mikhail Strebkov wrote: > It is open sourced but works only with C* 1.x as far as I know. > > Mikhail > > > On Tuesday, January 27, 2015, Mohammed Guller &

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-28 Thread Shenghua(Daniel) Wan
a more reasonable number of connections. > We do this, using code similar to this patch > https://github.com/michaelsembwever/cassandra/pull/2/files > > ~mck > > ¹ https://issues.apache.org/jira/browse/CASSANDRA-8358 > -- Regards, Shenghua (Daniel) Wan

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Shenghua(Daniel) Wan
On Tue, Jan 27, 2015 at 11:04 PM, Shenghua(Daniel) Wan < > wansheng...@gmail.com> wrote: > >> Hi, Huiliang, >> Great to hear from you, again! >> Image you have 3 nodes, replication factor=1, and using default number of >> tokens. You will have 3*256 mappers... In

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Shenghua(Daniel) Wan
there is any incorrect reasoning here. Thanks. On Tue, Jan 27, 2015 at 11:21 PM, Huiliang Zhang wrote: > In that case, each node will have 256/3 connections at most. Still 256 > mappers. Someone please correct me if I am wrong. > > On Tue, Jan 27, 2015 at 11:04 PM, Shenghua

Re: cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Shenghua(Daniel) Wan
7, 2015 at 9:34 PM, Shenghua(Daniel) Wan < > wansheng...@gmail.com> wrote: > >> By default, each C* node is set with 256 tokens. On a local 1-node C* >> server, my hadoop drop creates 256 connections to the server. Is there any >> way to control this behavior? e.g. reduce

Re: Re: full-tabe scan - extracting all data from C*

2015-01-27 Thread Shenghua(Daniel) Wan
t; } > > For Spark, the code skeleton is: > > val rdd = sc.cassandraTable("ks", "table") > > then call various standard Spark API to process the table parallelly. > > I have not used CqlInputFormat. > > At 2015-01-28 13:38:20, "Shenghua(Daniel

Re: full-tabe scan - extracting all data from C*

2015-01-27 Thread Shenghua(Daniel) Wan
or Spark to speed up the > extraction process. > > > > I wanted to do a quick survey and find out how many people on this mailing > list have successfully used approach #1 or #2 for extracting large datasets > (terabytes) from C*. Also, if you have used some other techniques, it would > be great if you could share your approach with the group. > > > > Mohammed > > > > -- Regards, Shenghua (Daniel) Wan

Re: full-tabe scan - extracting all data from C*

2015-01-27 Thread Shenghua(Daniel) Wan
datasets > (terabytes) from C*. Also, if you have used some other techniques, it would > be great if you could share your approach with the group. > > > > Mohammed > > > > -- Regards, Shenghua (Daniel) Wan

cqlinputformat and retired cqlpagingingputformat creates lots of connections to query the server

2015-01-27 Thread Shenghua(Daniel) Wan
nd I also tried CqlPagingInputFormat, which has same behavior. Thank you. -- Regards, Shenghua (Daniel) Wan

Re: conditional batches across two tables?

2014-11-16 Thread Daniel Compton
Hi Kevin Have you looked at Cassandra's lightweight transactions? It sounds like they might work for you http://www.datastax.com/documentation/cassandra/2.0/cassandra/dml/dml_ltwt_transaction_c.html. -- Daniel > On 17/11/2014, at 1:51 pm, Kevin Burton wrote: > > I’m tryin

Re: How do you run integration tests for your cassandra code?

2014-10-14 Thread Daniel Compton
At SMX we use https://github.com/SMX-LTD/ccm-clj for our Cassandra integration tests. ccm-clj is a Clojure wrapper around CCM. -- Daniel > On 14/10/2014, at 6:54 pm, Ranjib Dey wrote: > > you can use tools like chef along side vagrant to bring a cassandra. I > personall

Re: efficiently generate complete database dump in text format

2014-10-09 Thread Daniel Chia
You might also want to consider tools like https://github.com/Netflix/aegisthus for the last step, which can help you deal with tombstones and de-duplicate data. Thanks, Daniel On Thu, Oct 9, 2014 at 12:19 AM, Gaurav Bhatnagar wrote: > Hi, >We have a Cassandra database column

Re: Adjusting readahead for SSD disk seeks

2014-09-24 Thread Daniel Chia
their read latency reducing ra. Thanks, Daniel On Wed, Sep 24, 2014 at 4:15 PM, DuyHai Doan wrote: > "does it typically have to read in the entire SStable into memory > (assuming the bloom filter said yes)?" --> No, it would be perf killer. > > On the read path, after B

Re: CPU consumption of Cassandra

2014-09-23 Thread Daniel Chia
ment-13821243 Ticket reports 45% performance increase in reading slices compared to trunk in 2.1 Thanks, Daniel On Tue, Sep 23, 2014 at 5:08 PM, DuyHai Doan wrote: > I had done some benching in the past when we faced high CPU usage even > though data set is very small, sitting entirely

Re: EBS SSD <-> Cassandra ?

2014-06-18 Thread Daniel Chia
While they guarantee IOPS, they don't really make any guarantees about latency. Since EBS goes over the network, there's so many things in the path of getting at your data, I would be concerned with random latency spikes, unless proven otherwise. Thanks, Daniel On Wed, Jun 18, 2014

Re: Is the updating compaction strategy from 'sized tiered' to 'leveled' automatic or need to be done manually?

2014-05-05 Thread Daniel Chia
If you want to trigger a conversion to LCS of the on-disk sstables, doing "nodetool compact " should achieve what you want. Be warned, if you have a lot of data in the CF, this could potentially take a while depending on your compaction throttling. Thanks, Daniel On Sun, May 4, 201

Re: Multiget performance

2014-04-09 Thread Daniel Chia
Are you making the 100 calls in serial, or in parallel? Thanks, Daniel On Tue, Apr 8, 2014 at 11:22 PM, Allan C wrote: > Hi all, > > I've always been told that multigets are a Cassandra anti-pattern for > performance reasons. I ran a quick test tonight to prove it to my

Re: replication_factor: ?

2014-03-07 Thread Daniel Curry
3487 <http://www.linkedin.com/in/jlacefield> <http://www.datastax.com/what-we-offer/products-services/training/virtual-training> On Fri, Mar 7, 2014 at 10:26 AM, Daniel Curry mailto:daniel.cu...@arrayent.com>> wrote: I would like to know on what i

Re: replication_factor: ?

2014-03-07 Thread Daniel Curry
(RF+1)/2) have to be able to fulfil the request. On Fri, Mar 7, 2014 at 9:26 AM, Daniel Curry mailto:daniel.cu...@arrayent.com>> wrote: I would like to know on what is the rule of thumb for "replication_factor:" number? I think the answer is depends on how m

replication_factor: ?

2014-03-07 Thread Daniel Curry
1.3 ( that will be upgraded to 3.2.4). Thank you. -- Daniel Curry Sr. Linux System Administrator, Network Operations PGP : AD5A 96DC 7556 A020 B8E7 0E4D 5D5E 9BA5 C83E 8C92 Arrayent, Inc. 2317 Broadway Street, Suite 20 Redwood City, CA 94063 dan...@arrayent.com 650-260-4520

  1   2   3   >