Hi, We have a 2 DC setup on version 0.7.9 and have observed the following: 1. Using a property file snitch, with dynamic snitch turned on. The performance of LOCAL_QUORUM operations is poor for a while (around a minute) after a cluster restart before drastically improving. 2. With the same setup, after each period as defined by dynamic_snitch_reset_interval_in_ms, the LOCAL_QUORUM performance greatly degrades before drastically improving again within a minute. 3. With the dynamic snitch turned off, LOCAL_QUORUM operations perform extremely poorly... same as the 1st minute after a restart. 4. With dynamic snitch turned on, QUORUM operations' performance is about the same as using LOCAL_QUORUM when the dynamic snitch is off or the first minute after a restart with the snitch turned on.
All of this seem to point to LOCAL_QUORUM operations not differentiating our DCs using the property file snitch and its performance effectively degrades to that of QUORUM when dynamic snitch doesn't have appropriate scores. Our main concern is the performance degradation at the periods defined by dynamic_snitch_reset_interval_in_ms. The DynamicEndpointSnitch in steady state assigns scores that matches the DCs we've configured through the network topology property file. Our network topology property file appears to be properly configured and have been confirmed through the EndpointSnitchInfo mbean. Please advice. Thanks, Shu Medio Systems
