We are trying to add new data center in us-east. Servers in each DC are running inside VPC. We currently have a cluster in us-west and all servers are running 2.0.7. The two DCs are talking via VPN. listen_address and broadcast_address have private ip. Our endpoint_snitch is GossipingPropertyFileSnitch. All the required ports are open across VPC and we could telnet from one DC to the other.
We see this exception when we add a new node in the new dc(us-east) INFO [HANDSHAKE-/10.0.51.81] 2014-09-15 16:38:26,896 OutboundTcpConnection.java (line 386) Handshaking version with /10.0.51.81 DEBUG [WRITE-/10.0.52.81] 2014-09-15 16:38:29,038 OutboundTcpConnection.java (line 333) Target max version is -2147483648; no version information yet, will retry TRACE [HANDSHAKE-/10.0.52.81] 2014-09-15 16:38:29,038 OutboundTcpConnection.java (line 393) Cannot handshake version with / 10.0.52.81 java.nio.channels.AsynchronousCloseException at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:205) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:412) at sun.nio.ch.SocketAdaptor$SocketInputStream.read(SocketAdaptor.java:203) at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:103) at java.io.InputStream.read(InputStream.java:101) at sun.nio.ch.ChannelInputStream.read(ChannelInputStream.java:81) at java.io.DataInputStream.readInt(DataInputStream.java:387) at org.apache.cassandra.net.OutboundTcpConnection$1.run(OutboundTcpConnection.java:387) What are we missing here? Thanks Dinesh
