Hi all, I first tried with Artemis 2.7.0 but I didn't make it, now I'm trying with Artemis 2.9.0, still looking for some luck.
What I want to achieve is a basic shared storage master/slave cluster with static discovery. I have a java client that connects to the master. Java code is provided below. Test steps: 1. start master server 2. start slave server 3. start client app 4. kill master server The Java app gives exception and stop sending/receiving messages. Failover is not happening. Any help would be very appreciated. Thanks, Lorenzo ______________ Here Java client code: static final String ARTEMIS_CLUSTER_URL_1M = "tcp://artemis-1M:61616?ha=true&retryInterval=1000&retryIntervalMultiplier=1.0&reconnectAttempts=-1"; static final String ARTEMIS_CLUSER_USERNAME = "ADMIN.USER"; static final String ARTEMIS_CLUSTER_PASSWORD = "XxXxX"; int CONS_THREADS = 20; int PROD_THREADS = 1; ActiveMQConnectionFactory connectionFactory = new ActiveMQConnectionFactory(ARTEMIS_CLUSTER_URL_1M, ARTEMIS_CLUSER_USERNAME, ARTEMIS_CLUSTER_PASSWORD); Connection consConn = connectionFactory.createConnection(); consConn.start(); Connection prodConn = connectionFactory.createConnection(); prodConn.start(); ExecutorService executor = Executors.newFixedThreadPool(CONS_THREADS); for (int i=0 ; i < CONS_THREADS; i++) { executor.execute(new ArtemisConsumer(consConn)); } for (int i=0 ; i < PROD_THREADS; i++) { executor.execute(new ArtemisProducer(prodConn)); } ... public class ArtemisConsumer implements Runnable { private Connection connection = null; public ArtemisConsumer(Connection connection) { this.connection = connection; } public void run() { try { Session session = connection.createSession(false, Session.AUTO_ACKNOWLEDGE); Queue queue = session.createQueue("jms.artemis-test-queue"); MessageConsumer consumer = session.createConsumer(queue); consumer.setMessageListener(new SimpleMessageListner(session)); } catch (Exception e) { System.out.println("Caught exception!" + e); e.printStackTrace(); } } } ... public class ArtemisProducer implements Runnable{ private static String MESSAGE; private static Connection connection = null; private int name; public ArtemisProducer(Connection connection) { this.connection = connection; if(MESSAGE==null) { MESSAGE = createMessage(); } } public void run() { try { Session session = connection.createSession(false, Session .AUTO_ACKNOWLEDGE); Queue queue = session.createQueue("jms.artemis-test-queue"); MessageProducer producer = session.createProducer(queue); producer.setDeliveryMode(DeliveryMode.PERSISTENT); int p=0; while (p < 50000) { TextMessage message = session.createTextMessage(MESSAGE); producer.send(message); } producer.close(); session.close(); } catch (Exception e) { System.out.println("Caught exception! " + e); e.printStackTrace(); } } private String createMessage() { byte[] array = new byte[runCfg.msgSize*1024]; // length is bounded by 7 new Random().nextBytes(array); return new String(array, Charset.forName("UTF-8")); } ... public class SimpleMessageListner implements MessageListener{ private Session session; public SimpleMessageListner(Session session) { this.session = session; } public SimpleMessageListner(Session session) { this.session = session; } @Override public void onMessage(Message message) { ... } } ... Here the client exception: Caught exception! javax.jms.JMSException: AMQ219014: Timed out after waiting 30,000 ms for response when sending packet 71 javax.jms.JMSException: AMQ219014: Timed out after waiting 30,000 ms for response when sending packet 71 at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.sendBlocking(ChannelImpl.java:454) at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.sendBlocking(ChannelImpl.java:358) at org.apache.activemq.artemis.core.protocol.core.impl.ActiveMQSessionContext.sendFullMessage(ActiveMQSessionContext.java:554) at org.apache.activemq.artemis.core.client.impl.ClientProducerImpl.sendRegularMessage(ClientProducerImpl.java:303) at org.apache.activemq.artemis.core.client.impl.ClientProducerImpl.doSend(ClientProducerImpl.java:275) at org.apache.activemq.artemis.core.client.impl.ClientProducerImpl.send(ClientProducerImpl.java:128) at org.apache.activemq.artemis.jms.client.ActiveMQMessageProducer.doSendx(ActiveMQMessageProducer.java:485) at org.apache.activemq.artemis.jms.client.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:195) at com.activemq.test.perf.artemis.producer.ArtemisProducer.run(ArtemisProducer.java:39) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: ActiveMQConnectionTimedOutException[errorType=CONNECTION_TIMEDOUT message=AMQ219014: Timed out after waiting 30,000 ms for response when sending packet 71] ... 12 more Here master configuration: <?xml version='1.0'?> <configuration xmlns="urn:activemq" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xi="http://www.w3.org/2001/XInclude" xsi:schemaLocation="urn:activemq /schema/artemis-configuration.xsd"> <core xmlns="urn:activemq:core" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:activemq:core "> <name>artemis-1M</name> <persistence-enabled>true</persistence-enabled> <journal-type>ASYNCIO</journal-type> <paging-directory>/vagrant_data/data/paging</paging-directory> <bindings-directory>/vagrant_data/data/bindings</bindings-directory> <journal-directory>/vagrant_data/data/journal</journal-directory> <large-messages-directory>/vagrant_data/data/large-messages</large-messages-directory> <journal-datasync>true</journal-datasync> <journal-min-files>2</journal-min-files> <journal-pool-files>10</journal-pool-files> <journal-file-size>10M</journal-file-size> <journal-buffer-timeout>16000</journal-buffer-timeout> <journal-max-io>4096</journal-max-io> <disk-scan-period>5000</disk-scan-period> <max-disk-usage>90</max-disk-usage> <critical-analyzer>true</critical-analyzer> <critical-analyzer-timeout>120000</critical-analyzer-timeout> <critical-analyzer-check-period>60000</critical-analyzer-check-period> <critical-analyzer-policy>HALT</critical-analyzer-policy> <ha-policy> <shared-store> <master> <failover-on-shutdown>true</failover-on-shutdown> </master> </shared-store> </ha-policy> <cluster-user>ADMIN.USER</cluster-user> <cluster-password>XxXxX</cluster-password> <cluster-connections> <cluster-connection name="artemis-cluster"> <connector-ref>artemis-1M</connector-ref> <static-connectors allow-direct-connections-only="true"> <connector-ref>artemis-1S</connector-ref> </static-connectors> </cluster-connection> </cluster-connections> <connectors> <connector name="artemis-1M">tcp://artemis-1M:61616</connector> <connector name="artemis-1S">tcp://artemis-1S:61616</connector> </connectors> <acceptors> <acceptor name="artemis">tcp://0.0.0.0:61616</acceptor> </acceptors> <security-settings> <security-setting match="#"> <permission type="createNonDurableQueue" roles="amq"/> <permission type="deleteNonDurableQueue" roles="amq"/> <permission type="createDurableQueue" roles="amq"/> <permission type="deleteDurableQueue" roles="amq"/> <permission type="createAddress" roles="amq"/> <permission type="deleteAddress" roles="amq"/> <permission type="consume" roles="amq"/> <permission type="browse" roles="amq"/> <permission type="send" roles="amq"/> <permission type="manage" roles="amq"/> </security-setting> </security-settings> <address-settings> <address-setting match="activemq.management#"> <dead-letter-address>DLQ</dead-letter-address> <expiry-address>ExpiryQueue</expiry-address> <redelivery-delay>0</redelivery-delay> <max-size-bytes>-1</max-size-bytes> <message-counter-history-day-limit>10</message-counter-history-day-limit> <address-full-policy>PAGE</address-full-policy> <auto-create-queues>true</auto-create-queues> <auto-create-addresses>true</auto-create-addresses> <auto-create-jms-queues>true</auto-create-jms-queues> <auto-create-jms-topics>true</auto-create-jms-topics> </address-setting> <address-setting match="#"> <dead-letter-address>DLQ</dead-letter-address> <expiry-address>ExpiryQueue</expiry-address> <redelivery-delay>0</redelivery-delay> <max-size-bytes>-1</max-size-bytes> <message-counter-history-day-limit>10</message-counter-history-day-limit> <address-full-policy>PAGE</address-full-policy> <auto-create-queues>true</auto-create-queues> <auto-create-addresses>true</auto-create-addresses> <auto-create-jms-queues>true</auto-create-jms-queues> <auto-create-jms-topics>true</auto-create-jms-topics> </address-setting> <address-setting match="jms.#"> <redistribution-delay>1000</redistribution-delay> </address-setting> </address-settings> <addresses> <address name="DLQ"> <anycast> <queue name="DLQ" /> </anycast> </address> <address name="ExpiryQueue"> <anycast> <queue name="ExpiryQueue" /> </anycast> </address> </addresses> <broker-plugins> <broker-plugin class-name="org.apache.activemq.artemis.core.server.plugin.impl.LoggingActiveMQServerPlugin"> <property key="LOG_ALL_EVENTS" value="false"/> <property key="LOG_CONNECTION_EVENTS" value="true"/> <property key="LOG_SESSION_EVENTS" value="true"/> <property key="LOG_CONSUMER_EVENTS" value="false"/> <property key="LOG_DELIVERING_EVENTS" value="false"/> <property key="LOG_SENDING_EVENTS" value="false"/> <property key="LOG_INTERNAL_EVENTS" value="true"/> </broker-plugin> </broker-plugins> </core> </configuration> ... Here slave configuration: <?xml version='1.0'?> <configuration xmlns="urn:activemq" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xi="http://www.w3.org/2001/XInclude" xsi:schemaLocation="urn:activemq /schema/artemis-configuration.xsd"> <core xmlns="urn:activemq:core" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:activemq:core "> <name>artemis-1S</name> <persistence-enabled>true</persistence-enabled> <journal-type>ASYNCIO</journal-type> <paging-directory>/vagrant_data/data/paging</paging-directory> <bindings-directory>/vagrant_data/data/bindings</bindings-directory> <journal-directory>/vagrant_data/data/journal</journal-directory> <large-messages-directory>/vagrant_data/data/large-messages</large-messages-directory> <journal-datasync>true</journal-datasync> <journal-min-files>2</journal-min-files> <journal-pool-files>10</journal-pool-files> <journal-file-size>10M</journal-file-size> <journal-buffer-timeout>16000</journal-buffer-timeout> <journal-max-io>4096</journal-max-io> <disk-scan-period>5000</disk-scan-period> <max-disk-usage>90</max-disk-usage> <critical-analyzer>true</critical-analyzer> <critical-analyzer-timeout>120000</critical-analyzer-timeout> <critical-analyzer-check-period>60000</critical-analyzer-check-period> <critical-analyzer-policy>HALT</critical-analyzer-policy> <ha-policy> <shared-store> <slave> <failover-on-shutdown>true</failover-on-shutdown> <allow-failback>true</allow-failback> </slave> </shared-store> </ha-policy> <cluster-user>ADMIN.USER</cluster-user> <cluster-password>XxXxX</cluster-password> <cluster-connections> <cluster-connection name="artemis-cluster"> <connector-ref>artemis-1S</connector-ref> <static-connectors allow-direct-connections-only="true"> <connector-ref>artemis-1M</connector-ref> </static-connectors> </cluster-connection> </cluster-connections> <connectors> <connector name="artemis-1M">tcp://artemis-1M:61616</connector> <connector name="artemis-1S">tcp://artemis-1S:61616</connector> </connectors> <acceptors> <acceptor name="artemis">tcp://0.0.0.0:61616</acceptor> </acceptors> <security-settings> <security-setting match="#"> <permission type="createNonDurableQueue" roles="amq"/> <permission type="deleteNonDurableQueue" roles="amq"/> <permission type="createDurableQueue" roles="amq"/> <permission type="deleteDurableQueue" roles="amq"/> <permission type="createAddress" roles="amq"/> <permission type="deleteAddress" roles="amq"/> <permission type="consume" roles="amq"/> <permission type="browse" roles="amq"/> <permission type="send" roles="amq"/> <permission type="manage" roles="amq"/> </security-setting> </security-settings> <address-settings> <address-setting match="activemq.management#"> <dead-letter-address>DLQ</dead-letter-address> <expiry-address>ExpiryQueue</expiry-address> <redelivery-delay>0</redelivery-delay> <max-size-bytes>-1</max-size-bytes> <message-counter-history-day-limit>10</message-counter-history-day-limit> <address-full-policy>PAGE</address-full-policy> <auto-create-queues>true</auto-create-queues> <auto-create-addresses>true</auto-create-addresses> <auto-create-jms-queues>true</auto-create-jms-queues> <auto-create-jms-topics>true</auto-create-jms-topics> </address-setting> <address-setting match="#"> <dead-letter-address>DLQ</dead-letter-address> <expiry-address>ExpiryQueue</expiry-address> <redelivery-delay>0</redelivery-delay> <max-size-bytes>-1</max-size-bytes> <message-counter-history-day-limit>10</message-counter-history-day-limit> <address-full-policy>PAGE</address-full-policy> <auto-create-queues>true</auto-create-queues> <auto-create-addresses>true</auto-create-addresses> <auto-create-jms-queues>true</auto-create-jms-queues> <auto-create-jms-topics>true</auto-create-jms-topics> </address-setting> <address-setting match="jms.#"> <redistribution-delay>1000</redistribution-delay> </address-setting> </address-settings> <addresses> <address name="DLQ"> <anycast> <queue name="DLQ" /> </anycast> </address> <address name="ExpiryQueue"> <anycast> <queue name="ExpiryQueue" /> </anycast> </address> </addresses> <broker-plugins> <broker-plugin class-name="org.apache.activemq.artemis.core.server.plugin.impl.LoggingActiveMQServerPlugin"> <property key="LOG_ALL_EVENTS" value="false"/> <property key="LOG_CONNECTION_EVENTS" value="true"/> <property key="LOG_SESSION_EVENTS" value="true"/> <property key="LOG_CONSUMER_EVENTS" value="false"/> <property key="LOG_DELIVERING_EVENTS" value="false"/> <property key="LOG_SENDING_EVENTS" value="false"/> <property key="LOG_INTERNAL_EVENTS" value="true"/> </broker-plugin> </broker-plugins> </core> </configuration> Here master server logs: 2019-06-12 08:06:20,573 INFO [org.apache.activemq.artemis.integration.bootstrap] AMQ101000: Starting ActiveMQ Artemis Server 2019-06-12 08:06:20,641 INFO [org.apache.activemq.artemis.core.server] AMQ221000: live Message Broker is starting with configuration Broker Configuration (clustered=true,journalDirectory=/vagrant_data/data/journal,bindingsDirectory=/vagrant_data/data/bindings,largeMessagesDirectory=/vagrant_data/data/large-messages,pagingDirectory=/vagrant_data/data/paging) 2019-06-12 08:06:20,644 INFO [org.apache.activemq.artemis.core.server] AMQ221006: Waiting to obtain live lock 2019-06-12 08:06:20,648 INFO [org.apache.activemq.artemis.core.server] AMQ221054: libaio was found but the filesystem does not support AIO. Switching the configuration into NIO. Journal path: /vagrant_data/data/journal 2019-06-12 08:06:20,700 INFO [org.apache.activemq.artemis.core.server] AMQ221013: Using NIO Journal 2019-06-12 08:06:20,763 INFO [org.apache.activemq.artemis.core.server] AMQ221057: Global Max Size is being adjusted to 1/2 of the JVM max size (-Xmx). being defined as 1,073,741,824 2019-06-12 08:06:20,935 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE 2019-06-12 08:06:20,942 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP 2019-06-12 08:06:20,947 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ 2019-06-12 08:06:20,962 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-mqtt-protocol]. Adding protocol support for: MQTT 2019-06-12 08:06:20,968 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-openwire-protocol]. Adding protocol support for: OPENWIRE 2019-06-12 08:06:20,971 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP 2019-06-12 08:06:21,129 INFO [org.apache.activemq.artemis.core.server] AMQ221034: Waiting indefinitely to obtain live lock 2019-06-12 08:06:21,129 INFO [org.apache.activemq.artemis.core.server] AMQ221035: Live Server Obtained live lock 2019-06-12 08:06:23,234 INFO [org.apache.activemq.artemis.core.server] AMQ221080: Deploying address DLQ supporting [ANYCAST] 2019-06-12 08:06:23,236 INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying ANYCAST queue DLQ on address DLQ 2019-06-12 08:06:23,237 INFO [org.apache.activemq.artemis.core.server] AMQ221080: Deploying address ExpiryQueue supporting [ANYCAST] 2019-06-12 08:06:23,237 INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying ANYCAST queue ExpiryQueue on address ExpiryQueue 2019-06-12 08:06:23,629 INFO [org.apache.activemq.artemis.core.server] AMQ221020: Started EPOLL Acceptor at 0.0.0.0:61616 for protocols [CORE,MQTT,AMQP,HORNETQ,STOMP,OPENWIRE] 2019-06-12 08:06:23,631 INFO [org.apache.activemq.artemis.core.server] AMQ221007: Server is now live 2019-06-12 08:06:23,632 INFO [org.apache.activemq.artemis.core.server] AMQ221001: Apache ActiveMQ Artemis Message Broker version 2.9.0 [artemis-1M, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2] 2019-06-12 08:06:24,233 INFO [org.apache.activemq.hawtio.branding.PluginContextListener] Initialized activemq-branding plugin 2019-06-12 08:06:24,441 INFO [org.apache.activemq.hawtio.plugin.PluginContextListener] Initialized artemis-plugin plugin 2019-06-12 08:06:25,462 INFO [io.hawt.HawtioContextListener] Initialising hawtio services 2019-06-12 08:06:25,596 INFO [io.hawt.system.ConfigManager] Configuration will be discovered via system properties 2019-06-12 08:06:25,599 INFO [io.hawt.jmx.JmxTreeWatcher] Welcome to hawtio 1.5.5 : http://hawt.io/ : Don't cha wish your console was hawt like me? ;-) 2019-06-12 08:06:25,644 INFO [io.hawt.jmx.UploadManager] Using file upload directory: /var/lib/artemis/tmp/uploads 2019-06-12 08:06:25,736 INFO [io.hawt.web.AuthenticationFilter] Starting hawtio authentication filter, JAAS realm: "activemq" authorized role(s): "amq" role principal classes: "org.apache.activemq.artemis.spi.core.security.jaas.RolePrincipal" 2019-06-12 08:06:25,820 INFO [io.hawt.web.JolokiaConfiguredAgentServlet] Jolokia overridden property: [key=policyLocation, value=file:/var/lib/artemis/etc/jolokia-access.xml] 2019-06-12 08:06:25,888 INFO [io.hawt.web.RBACMBeanInvoker] Using MBean [hawtio:type=security,area=jmx,rank=0,name=HawtioDummyJMXSecurity] for role based access control 2019-06-12 08:06:26,302 INFO [io.hawt.system.ProxyWhitelist] Initial proxy whitelist: [localhost, 127.0.0.1, 10.0.2.15, 192.168.1.10, artemis-1M] 2019-06-12 08:06:27,479 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server started at http://192.168.1.10:8161 2019-06-12 08:06:27,480 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia REST API available at http://192.168.1.10:8161/console/jolokia 2019-06-12 08:06:27,481 INFO [org.apache.activemq.artemis] AMQ241004: Artemis Console available at http://192.168.1.10:8161/console 2019-06-12 08:06:36,106 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=4d972f93, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@7844fa34[ID=4d972f93, local= /192.168.1.10:61616, remote=/192.168.1.20:40612]] 2019-06-12 08:06:36,106 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=1281a797, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@7af04c08[ID=1281a797, local= /192.168.1.10:61616, remote=/192.168.1.20:40610]] 2019-06-12 08:06:39,704 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=ef541e18, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@46cd9da2[ID=ef541e18, local= /192.168.1.10:61616, remote=/192.168.1.20:40614]] 2019-06-12 08:06:52,584 INFO [io.hawt.web.LoginServlet] hawtio login is using 1800 sec. HttpSession timeout 2019-06-12 08:07:14,993 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=8e78eb87, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@41dbb1cc[ID=8e78eb87, local= /192.168.1.10:61616, remote=/192.168.1.1:61125]] 2019-06-12 08:07:15,087 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c357e5d5-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,116 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c357e5d5-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,132 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3679d46-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,150 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3679d46-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,166 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c36d90b7-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,174 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c36d90b7-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,178 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c36fdaa8-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,183 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c36fdaa8-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,202 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3722499-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,215 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3722499-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,221 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c376434a-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,227 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c376434a-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,236 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c378b44b-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,246 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c378b44b-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,258 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c37bc18c-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,266 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c37bc18c-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,273 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c37e0b7d-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,281 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c37e0b7d-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,285 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3802e5e-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,288 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3802e5e-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,297 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c382031f-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,301 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c382031f-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,328 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c38648e0-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,353 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c38648e0-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,388 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c38cffa1-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,395 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c38cffa1-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,401 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c391e1a2-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,405 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c391e1a2-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,413 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3938f53-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,422 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3938f53-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,425 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3958b24-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,432 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3958b24-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,439 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c397ae05-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,446 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c397ae05-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,472 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c39982c6-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,475 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c39982c6-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,483 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c39e16a7-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,488 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c39e16a7-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,495 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3a01278-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,500 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3a01278-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:15,505 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c3a1c029-8d23-11e9-87cd-0a0027000007, session connectionID: 8e78eb87 2019-06-12 08:07:15,509 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c3a1c029-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:25,153 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=a77a2904, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@58a54051[ID=a77a2904, local= /192.168.1.10:61616, remote=/192.168.1.1:61130]] 2019-06-12 08:07:25,163 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c962fc9c-8d23-11e9-87cd-0a0027000007, session connectionID: a77a2904 2019-06-12 08:07:25,165 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c962fc9c-8d23-11e9-87cd-0a0027000007, key: jms-session, data: 2019-06-12 08:07:25,173 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841002: created session name: c964d15d-8d23-11e9-87cd-0a0027000007, session connectionID: a77a2904 2019-06-12 08:07:25,178 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841004: added session metadata for session name : c964d15d-8d23-11e9-87cd-0a0027000007, key: jms-session, data: ... Here slave server logs: 2019-06-12 08:06:33,465 INFO [org.apache.activemq.artemis.integration.bootstrap] AMQ101000: Starting ActiveMQ Artemis Server 2019-06-12 08:06:33,534 INFO [org.apache.activemq.artemis.core.server] AMQ221000: backup Message Broker is starting with configuration Broker Configuration (clustered=true,journalDirectory=/vagrant_data/data/journal,bindingsDirectory=/vagrant_data/data/bindings,largeMessagesDirectory=/vagrant_data/data/large-messages,pagingDirectory=/vagrant_data/data/paging) 2019-06-12 08:06:33,561 INFO [org.apache.activemq.artemis.core.server] AMQ221032: Waiting to become backup node 2019-06-12 08:06:33,567 INFO [org.apache.activemq.artemis.core.server] AMQ221033: ** got backup lock 2019-06-12 08:06:33,596 INFO [org.apache.activemq.artemis.core.server] AMQ221054: libaio was found but the filesystem does not support AIO. Switching the configuration into NIO. Journal path: /vagrant_data/data/journal 2019-06-12 08:06:33,714 INFO [org.apache.activemq.artemis.core.server] AMQ221013: Using NIO Journal 2019-06-12 08:06:34,015 INFO [org.apache.activemq.artemis.core.server] AMQ221057: Global Max Size is being adjusted to 1/2 of the JVM max size (-Xmx). being defined as 1,073,741,824 2019-06-12 08:06:34,290 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-server]. Adding protocol support for: CORE 2019-06-12 08:06:34,295 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-amqp-protocol]. Adding protocol support for: AMQP 2019-06-12 08:06:34,306 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-hornetq-protocol]. Adding protocol support for: HORNETQ 2019-06-12 08:06:34,312 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-mqtt-protocol]. Adding protocol support for: MQTT 2019-06-12 08:06:34,319 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-openwire-protocol]. Adding protocol support for: OPENWIRE 2019-06-12 08:06:34,328 INFO [org.apache.activemq.artemis.core.server] AMQ221043: Protocol module found: [artemis-stomp-protocol]. Adding protocol support for: STOMP 2019-06-12 08:06:34,578 INFO [org.apache.activemq.artemis.core.server] AMQ221109: Apache ActiveMQ Artemis Backup Server version 2.9.0 [46af3acc-7654-11e9-a97e-08002741bcc2] started, waiting live to fail before it gets active 2019-06-12 08:06:35,452 INFO [org.apache.activemq.hawtio.branding.PluginContextListener] Initialized activemq-branding plugin 2019-06-12 08:06:36,245 INFO [org.apache.activemq.hawtio.plugin.PluginContextListener] Initialized artemis-plugin plugin 2019-06-12 08:06:38,629 INFO [io.hawt.HawtioContextListener] Initialising hawtio services 2019-06-12 08:06:38,951 INFO [org.apache.activemq.artemis.core.server] AMQ221080: Deploying address DLQ supporting [ANYCAST] 2019-06-12 08:06:38,952 INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying ANYCAST queue DLQ on address DLQ 2019-06-12 08:06:38,953 INFO [org.apache.activemq.artemis.core.server] AMQ221080: Deploying address ExpiryQueue supporting [ANYCAST] 2019-06-12 08:06:38,954 INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying ANYCAST queue ExpiryQueue on address ExpiryQueue 2019-06-12 08:06:39,058 INFO [io.hawt.system.ConfigManager] Configuration will be discovered via system properties 2019-06-12 08:06:39,068 INFO [io.hawt.jmx.JmxTreeWatcher] Welcome to hawtio 1.5.5 : http://hawt.io/ : Don't cha wish your console was hawt like me? ;-) 2019-06-12 08:06:39,118 INFO [io.hawt.jmx.UploadManager] Using file upload directory: /var/lib/artemis/tmp/uploads 2019-06-12 08:06:39,261 INFO [io.hawt.web.AuthenticationFilter] Starting hawtio authentication filter, JAAS realm: "activemq" authorized role(s): "amq" role principal classes: "org.apache.activemq.artemis.spi.core.security.jaas.RolePrincipal" 2019-06-12 08:06:39,356 INFO [io.hawt.web.JolokiaConfiguredAgentServlet] Jolokia overridden property: [key=policyLocation, value=file:/var/lib/artemis/etc/jolokia-access.xml] 2019-06-12 08:06:39,441 INFO [io.hawt.web.RBACMBeanInvoker] Using MBean [hawtio:type=security,area=jmx,rank=0,name=HawtioDummyJMXSecurity] for role based access control 2019-06-12 08:06:39,851 INFO [io.hawt.system.ProxyWhitelist] Initial proxy whitelist: [localhost, 127.0.0.1, 10.0.2.15, 192.168.1.20, artemis-1S] 2019-06-12 08:06:39,959 INFO [org.apache.activemq.artemis.core.server] AMQ221020: Started EPOLL Acceptor at 0.0.0.0:61616 for protocols [CORE,MQTT,AMQP,HORNETQ,STOMP,OPENWIRE] 2019-06-12 08:06:39,960 INFO [org.apache.activemq.artemis.core.server] AMQ221010: Backup Server is now live 2019-06-12 08:06:40,250 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=e1b1f737, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@1c515571[ID=e1b1f737, local= /192.168.1.20:61616, remote=/192.168.1.10:54368]] 2019-06-12 08:06:40,250 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841000: created connection: RemotingConnectionImpl [ID=a0e1f8ac, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@1f2afd93[ID=a0e1f8ac, local= /192.168.1.20:61616, remote=/192.168.1.10:54370]] 2019-06-12 08:06:40,481 INFO [org.apache.activemq.artemis] AMQ241001: HTTP Server started at http://192.168.1.20:8161 2019-06-12 08:06:40,481 INFO [org.apache.activemq.artemis] AMQ241002: Artemis Jolokia REST API available at http://192.168.1.20:8161/console/jolokia 2019-06-12 08:06:40,481 INFO [org.apache.activemq.artemis] AMQ241004: Artemis Console available at http://192.168.1.20:8161/console 2019-06-12 08:06:54,451 INFO [io.hawt.web.LoginServlet] hawtio login is using 1800 sec. HttpSession timeout 2019-06-12 08:08:39,951 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841001: destroyed connection: RemotingConnectionImpl [ID=e1b1f737, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@1c515571[ID=e1b1f737, local= /192.168.1.20:61616, remote=/192.168.1.10:54368]] 2019-06-12 08:08:39,961 INFO [org.apache.activemq.artemis.core.server.plugin.impl] AMQ841001: destroyed connection: RemotingConnectionImpl [ID=a0e1f8ac, clientID=null, nodeID=46af3acc-7654-11e9-a97e-08002741bcc2, transportConnection=org.apache.activemq.artemis.core.remoting.impl.netty.NettyServerConnection@1f2afd93[ID=a0e1f8ac, local= /192.168.1.20:61616, remote=/192.168.1.10:54370]] 2019-06-12 08:10:35,979 WARN [org.apache.activemq.artemis.core.client] AMQ212037: Connection failure has been detected: AMQ219011: Did not receive data from server for org.apache.activemq.artemis.core.remoting.impl.netty.NettyConnection@f6a0824[ID=b80942d6, local= /192.168.1.20:40612, remote=artemis-1M/192.168.1.10:61616] [code=CONNECTION_TIMEDOUT] -- Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html