[ 
https://issues.apache.org/jira/browse/BEAM-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423437#comment-17423437
 ] 

Miguel Anzo commented on BEAM-8453:
-----------------------------------

Hi, I have been trying to get this issue resolved but I have some questions 
about how to proceed.

I initially thought this could be a concurrency issue, as that is what the test 
is about, but after analyzing the code and logs it seems that the 
NullPointerException is happening 
[here|https://github.com/apache/beam/blob/9a4cdfba601bae9165928d1a4df8035785b4c871/sdks/java/io/jms/src/test/java/org/apache/beam/sdk/io/jms/JmsIOTest.java#L386]
 which is when the test reads the first messages before the second thread is 
started and that has made me rethink that it might be a concurrency issue. 
Inside the advance() method the exception happens during the 
[receive()|https://github.com/apache/beam/blob/9a4cdfba601bae9165928d1a4df8035785b4c871/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsIO.java#L503]
 method, there where trying to reproduce the error locally my only success 
getting the same error was closing the consumer before the read happens, could 
it be that the flake happens because a closed consumer?

I have seen also that there have been other issues with the checkpoint 
finalization on JmsIO, is there someone with knowledge is this IO that can 
answer me some questions regarding the finalizaCheckpoint part and how the 
consumer is created/closed?

Thanks

> Failure in org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety
> ------------------------------------------------------------------------
>
>                 Key: BEAM-8453
>                 URL: https://issues.apache.org/jira/browse/BEAM-8453
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-jms
>            Reporter: Kenneth Knowles
>            Assignee: Miguel Anzo
>            Priority: P1
>              Labels: flake
>             Fix For: Not applicable
>
>
> {code}
> Caused by: java.lang.NullPointerException: (No message provided)
> at 
> org.apache.beam.sdk.io.jms.JmsIOTest.lambda$withSlowAcks$2(JmsIOTest.java:463)
> at 
> org.apache.beam.sdk.io.jms.JmsIOTest.lambda$proxyMethod$6(JmsIOTest.java:489)
> at com.sun.proxy.$Proxy62.receiveNoWait(Unknown Source)
> at org.apache.beam.sdk.io.jms.JmsIO$UnboundedJmsReader.advance(JmsIO.java:512)
> at 
> org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety(JmsIOTest.java:381)
> ...
> {code}
> stdout:
> {code}
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService 
> doStartPersistenceAdapter
> INFO: Using Persistence Adapter: MemoryPersistenceAdapter
> Oct 21, 2019 9:52:32 PM org.apache.activemq.store.kahadb.plist.PListStoreImpl 
> doStart
> INFO: 
> PListStore:[/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit@2/src/sdks/java/io/jms/activemq-data/localhost/tmp_storage]
>  started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: Apache ActiveMQ 5.13.1 (localhost, 
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is starting
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.TransportConnector start
> INFO: Connector vm://localhost started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: Apache ActiveMQ 5.13.1 (localhost, 
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: For help or more information please see: http://activemq.apache.org
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost, 
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is shutting down
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.TransportConnector stop
> INFO: Connector vm://localhost stopped
> Oct 21, 2019 9:52:33 PM org.apache.activemq.store.kahadb.plist.PListStoreImpl 
> doStop
> INFO: 
> PListStore:[/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit@2/src/sdks/java/io/jms/activemq-data/localhost/tmp_storage]
>  stopped
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost, 
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) uptime 0.512 seconds
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost, 
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is shutdown
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to