I tried to split my cluster and ran into this error, which I did not see in
the tests I performed.
ERROR [pool-1-thread-52165] 2013-09-19 21:48:08,262 Cassandra.java (line
3250) Internal error processing describe_ring
java.lang.IllegalStateException: datacenter (DC103) has no more endpoints,
(3) r
1) Can't
2) Interesting
3) Interesting
4) Remove all the Hints and OpsCenter data files
I used 4 to get it working.
On 13 August 2013 11:23, Robert Coli wrote:
> On Tue, Aug 13, 2013 at 11:14 AM, Ashley Martens
> wrote:
>
> > INFO [main] 2013-08-13 18:14:13,759 DatabaseD
INFO [main] 2013-08-13 18:14:13,674 AbstractCassandraDaemon.java (line
115) Heap size: 8568963072/8568963072
INFO [main] 2013-08-13 18:14:13,674 AbstractCassandraDaemon.java (line
116) Classpath:
/usr/share/cassandra/antlr-3.1.3.jar:/usr/share/cassandra/apache-cassandra-0.7.10.jar:/usr/share/cass
ble at
> http://archive.apache.org/dist/cassandra/, but debian packages are not
> guaranteed to be there forever).
>
> --
> Sylvain
>
> On Thu, Mar 29, 2012 at 6:14 AM, Ashley Martens
> wrote:
> > Using this apt source list:
> >
> > deb http://www.apac
:
> On 03/28/2012 07:45 PM, Ashley Martens wrote:
> > Where the F^$% have the packages for 06x gone?
>
> Easy there, pardner.
>
> > http://www.apache.org/dist/cassandra/debian/dists/06x/main/binary-amd64/
> >
> > Is empty. What gives?
>
> While the reposito
Where the F^$% have the packages for 06x gone?
http://www.apache.org/dist/cassandra/debian/dists/06x/main/binary-amd64/
Is empty. What gives?
This is a production node on real hardware. I like the strace idea, do you
have a workable command line for that?
On Wed, Oct 12, 2011 at 1:13 PM, Mohit Anchlia wrote:
> Yes. If you have exhausted all the options I think it will be good to
> see if this issue persists accross other nodes after yo
I guess it could be an option but I can't puppet the Oracle JDK install so I
would rather not.
On Wed, Oct 12, 2011 at 12:35 PM, Erik Forkalsrud wrote:
> On 10/12/2011 11:33 AM, Ashley Martens wrote:
>
> java version "1.6.0_20"
> OpenJDK Runtime Environment (IcedTea6
We have 20 nodes in this cluster.
Yes, however are you recommending that I decommission the node?
I noted the compaction because it is common for the last line in the log
file. For reference:
INFO [FlushWriter:12] 2011-10-12 18:10:09,823 Memtable.java (line 157)
Writing Memtable-HintsColumnFamily
No.
On Wed, Oct 12, 2011 at 11:46 AM, Brandon Williams wrote:
> Anything from the OOM killer in the last few lines from dmesg?
>
>
Ubuntu 10.10
java version "1.6.0_20"
OpenJDK Runtime Environment (IcedTea6 1.9.9) (6b20-1.9.9-0ubuntu1~10.10.2)
OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode)
Always the same node. No other nodes in this cluster, which all have the
same hardware and OS, have this issue.
I don't see any re
The thing is we only see that error once every so often. Additional, since
Cassandra is not logging a shutdown message then it must be a violent
termination, which leaves no traces in the system logs. It's possible that
there is something wrong with the hardware, but the OS side I don't see what
wo
Tue Oct 11 21:34:10 UTC 2011 - Fuck this Cassandra bullshit... it died again
Tue Oct 11 22:06:10 UTC 2011 - Fuck this Cassandra bullshit... it died again
Tue Oct 11 22:36:10 UTC 2011 - Fuck this Cassandra bullshit... it died again
Wed Oct 12 00:40:10 UTC 2011 - Fuck this Cassandra bullshit... it di
deploy@mobage-prod-cassandra150:~$ grep -i 'killed process'
/var/log/messages
deploy@mobage-prod-cassandra150:~$
On Tue, Oct 11, 2011 at 5:57 PM, Jonathan Ellis wrote:
> grep -i 'killed process' /var/log/messages
>
>
So we created a script to check if Cassandra is alive and run it every two
minutes. Here are some results for today:
Tue Oct 11 18:28:09 UTC 2011 - F this Cassandra bullshit... it died again
Tue Oct 11 19:00:10 UTC 2011 - F this Cassandra bullshit... it died again
Tue Oct 11 19:30:10 UTC 2011 - F
It is actually not at the exact same time of the day. It varies but happens
within certain blocks of time, like between 00hr and 02hr. The could be up
for hours or it could crash again in 15 minutes. The memory is fine, just
using a larger footprint than 0.6 in all ways.
On Mon, Oct 10, 2011 at 1:
I have check both the output file and the system log, neither have errors in
them. I don't believe anything external is killing the process, I could be
wrong but this node's setup is the same as all my other nodes (including
hardware) so it doesn't make much sense.
jsvc.exec -user cassandra -home
Okay, this is still a problem. This node keeps dieing at 1am every day, most
times without an error in the log. I'd appriciate any help in tracking down
why.
Additionally, I don't understand why 0.7.x using *way* more RAM than 0.6.x
and 0.8.x, from a top or ps perspective. I'm now watching the JVM
I could be wrong. I just looked the amount of memory being used and it's
huge. WTF?
No OOM errors appear and the memory used is far below physical and Java max.
I changed the JAR to 0.7.8 to see if that works. If so I'll find a way to
roll out that version instead of 0.7.9.
I'm getting the following exception on a 0.7.9 node before the node crashes.
I don't have this problem with the other nodes running 0.7.8. Does anyone
know what the problem is?
ERROR [Thread-47] 2011-10-05 05:07:03,840 AbstractCassandraDaemon.java (line
133) Fatal exception in thread Thread[Thread
Could you reproduce it?
INFO [769787724@qtp-311722089-9825] 2011-08-23 22:07:53,750 SolrCore.java
(line 1370) [users] webapp=/solandra path=/select
params={fl=*,score&start=0&q=+(+(first_name:hatice^1.2)+(first_name:hatice~0.9^1.0)++)+AND+(+(last_name:ali^3.0)+(last_name:ali~0.9^2.1)++)+&wt=ruby&qt=standard&rows=1}
statu
We are getting an error in our Solandra search when the search string
contains a space. Is anyone else seeing this?
*Net::HTTPFatalError*: 500 "null java.
lang.ArrayIndexOutOfBoundsException null
java.lang.ArrayIndexOutOfBoundsException request:
http://10.103.1.70:8983/solandra/users~27/selector
Multiple cores it is. Thanks.
Does Solandra support multiple schemas? For example I have staging and test
data in two different keyspaces in Cassandra and want that echoed in
Solandra. Possible?
No shared seeds. Downright freaky.
Nope. Clean system.
On Wed, Aug 10, 2011 at 3:22 PM, Nick Bailey wrote:
> Did you perhaps start up the second cluster with data from the test
> cluster? If you accidentally copied the system tables over, cassandra
> would recognize the saved tokens/ips from the test cluster and attempt
> to goss
I just had a strange issue with a solandra ring. We had a two node test
cluster running in one data center and then started up a second 5 node
cluster in another data center. The seed in the first DC was in that DC and
the seed in the second DC was in the second DC, so the two rings should not
have
which is designed to make
> adding datacenters easier.
>
> On Thu, Jul 28, 2011 at 6:57 AM, Ashley Martens wrote:
>> Thank you. For 0.7 are the steps similar?
>>
>>
>>
>> On Jul 27, 2011, at 19:56, Jonathan Ellis wrote:
>>
>>> As yo
th RUS and RAS.)
>
> The wrong way:
> - Switch to RAS, then start adding nodes in the new DC. As soon as
> you add the first node in DC2, RAS will try to replicate ALL the rows
> in DC1 to it. Usually this overwhelms the DC2 node and it dies a
> fiery death.
>
> On Wed, Jul
I have a current 0.6.x cluster in a single datacenter with RackUnaware and
am looking to expand into a second data center. I know I need to change to
RackAwareStrategy however, I'm not sure what will happen to my data when I
restart the nodes in the current cluster before I even add the new DC. Wil
32 matches
Mail list logo
