Hello, I'm loading Cassandra (v3.10.0.1652) data into a Kafka (v1.0.0) topic
via CDC and the org.apache.cassandra.db.commitlog.CommitLogReader. All seems to
fit together, but I am seeing an "Invalid partitioner RandomPartitioner" error
thrown. Is CDC compatible with the RandomPartitioner? There
Thanks, Jeff, will definitely check the trace. Also, one strange thing I
noticed, with number of threads till '64', the latency is around 3ms but as
the number of threads increases latency also increases. Eventually, at
thread count, 609 latency is around 30ms. I am using a single client to
loadtes
Could be the cause. I would run 2 and then 4 concurrent clients to see how they
behave. What’s your client written in? How are you managing your connection?
--
Rahul Singh
rahul.si...@anant.us
Anant Corporation
On Feb 6, 2018, 8:50 AM -0500, mohsin k , wrote:
> Thanks, Jeff, will definitely che
Nigel,
Are you using something like this or rolled your own?
https://github.com/smartcat-labs/cassandra-kafka-connector/tree/master/cassandra-cdc
Ive used it in a docker composition and it seemed to work fine for me.
https://github.com/smartcat-labs/cassandra-kafka-connector/blob/master/cassand
Thanks Rahul, I looked at the smartcat implementation, and am doing something
very similar. Unfortunately, I’m using a mixed DSE and Apache codebase, which
may not help.
Anyway, if CDC worked for you with a random partitioner that’s good news, as
its more likely my code that is wrong. I will ju
Not too much delving needed, I upgraded jamm to v0.3.2. I’m not entirely sure
why this was required, it seems a little obscure, but I’m back on track.
Many Thanks
Nigel
From: Nigel LEACH
Sent: 06 February 2018 14:25
To: user@cassandra.apache.org
Subject: RE: Cassandra CDC
Thanks Rahul, I looked
This does look like a very viable solution. Thanks.
Could you give us some pointers/documentation on :
- how can we build such SSTables using spark jobs, maybe
https://github.com/Netflix/sstable-adaptor ?
- how do we send these tables to cassandra? does a simple SCP work?
- what is the recommen
@Rahul, I am using cassandra-stress tool.
On Tue, Feb 6, 2018 at 7:37 PM, Rahul Singh
wrote:
> Could be the cause. I would run 2 and then 4 concurrent clients to see how
> they behave. What’s your client written in? How are you managing your
> connection?
>
> --
> Rahul Singh
> rahul.si...@anant
Thanks for the response!
So, the best solution I can come up with is catching the
InvalidQueryException and check whether its message contains the phrase
"conflicts with an existing column". Seems to work, but super-ugly.
I do assume that in general, if a request fails, it does not permanen
Hello.
Another thing that you can try is the use the describe table query to get
the table schema and parse it. Once done you can check whether column
exists or not.
With Regards
Irtiza Ali
On 6 Feb 2018 21:35, "Oliver Ruebenacker" wrote:
> Thanks for the response!
>
> So, the best soluti
Hello,
Is there a describe query in CQL? I don't see one on
http://cassandra.apache.org/doc/latest/cql/index.html.
I also can't find such a query in the DataStax Java driver API.
Thanks!
Best, Oliver
On Tue, Feb 6, 2018 at 11:48 AM, Irtiza Ali wrote:
> Hello.
>
> Another thin
Yes describe query is available cqlsh. Try the example given below:
Example:
cqlsh> describe keyspaceName.tableName;
It will return the schema of the table.
On 6 Feb 2018 21:55, "Oliver Ruebenacker" wrote:
>
> Hello,
>
> Is there a describe query in CQL? I don't see one on
> http://ca
Hello Romain,
I want to test criteo but have some doubts. Graphite is not good for me
because data is stored in a whisper file, which is not accurate and I have
scientific purposes.
Do I have to run the java application (jar) in every node of my cluster?
Is the internal storage a round-robin data
Hi -
I am running a 29 node cluster spread over 4 DC's in EC2, using C* 3.11.1
on Ubuntu. Occasionally I have the need to restart nodes in the cluster,
but every time I do, I see errors and application (nodejs) timeouts.
I restart a node like this:
nodetool disablethrift && nodetool disablegossi
We use Spark2Cassandra (this fork works with C*3.0
https://github.com/leoromanovsky/Spark2Cassandra )
SSTables are streamed to Cassandra by Spark2Cassandra (so you need to open port
7000 accordingly).During benchmark we used 25 EMR nodes but in production we
use less nodes to be more gentle wit
On 02/06/2018 12:58 PM, Mike Torra wrote:
>
> I restart a node like this:
>
> nodetool disablethrift && nodetool disablegossip && nodetool drain
> sudo service cassandra restart
Just a guess here - are you really only using thrift?
(ie. `nodetool disablebinary`)
> When I do that, I very often g
Ah got it. Good stuff.
--
Rahul Singh
rahul.si...@anant.us
Anant Corporation
On Feb 6, 2018, 9:40 AM -0500, Nigel LEACH ,
wrote:
> Not too much delving needed, I upgraded jamm to v0.3.2. I’m not entirely sure
> why this was required, it seems a little obscure, but I’m back on track.
>
> Many T
Unless you abbreviated, your data model is questionable (SELECT without any
equality in the WHERE clause on the partition key will always cause a range
scan, which is super inefficient). Since you're doing LOCAL_ONE and a range
scan, timeouts sorta make sense - the owner of at least one range would
Hello,
this link might also be helpful to you for querying table schema.
Link:
https://docs.datastax.com/en/cql/3.3/cql/cql_using/useQuerySystemTable.html
Best, Iriiza
On Tue, Feb 6, 2018 at 9:55 PM, Oliver Ruebenacker wrote:
>
> Hello,
>
> Is there a describe query in CQL? I don't s
Has anyone run into the issue mentioned below?
-- Forwarded message --
From: test user
Date: Tue, Feb 6, 2018 at 3:28 PM
Subject: Hints folder missing in Cassandra
To: user-subscr...@cassandra.apache.org
Hello All,
I am using Cassandra 3.10. I have 3-node cluster (say node0,
20 matches
Mail list logo