you are getting this issue because the CORE clients uses topology for load balancing by default, you can solve this issue disabling topology for loadbalancing, i.e. useTopologyForLoadBalancing=false
Oh wow. I completely missed that even though it's in the docs. Thanks for pointing that out.
Many thanks, Elric